-- Logs begin at Fri 2021-12-10 13:29:59 UTC, end at Fri 2021-12-10 14:38:46 UTC. -- Dec 10 14:16:14.789507 dv-neutron-821401-2-hyperv systemd[1]: Started Devstack devstack@q-svc.service. Dec 10 14:16:17.628748 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.common.config [-] Logging enabled! Dec 10 14:16:17.629351 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev273 Dec 10 14:16:17.629492 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103699) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 10 14:16:17.632770 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.common.config [-] Logging enabled! Dec 10 14:16:17.633029 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev273 Dec 10 14:16:17.633352 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103699) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 10 14:16:17.634315 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 10 14:16:17.634554 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 10 14:16:17.634919 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 10 14:16:17.635166 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 10 14:16:17.635395 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 10 14:16:17.635721 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.636162 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Dec 10 14:16:17.636479 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.636779 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.637076 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.637376 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.637701 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.637988 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.638278 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.638580 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.638967 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.639260 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.639547 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.639840 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.640126 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] config_source = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.640414 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.640704 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.640993 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] debug = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.641277 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.641745 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.642156 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.642438 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.642731 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.643012 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.643294 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.643574 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.643862 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.644194 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] host = dv-neutron-821401-2-hyperv {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.644476 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.644763 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.645052 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.645353 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.645641 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.646437 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.646738 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.647001 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] log_dir = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.647281 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] log_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.647558 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.647846 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.648133 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.648426 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.648651 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.648873 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.649175 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.649480 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.649761 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.650038 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.650314 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.650589 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.650863 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.651131 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.651419 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.651706 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.651993 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.652272 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.652549 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.652822 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.653097 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.653384 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.653694 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.653970 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.654247 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.654536 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.654804 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.655077 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.655378 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.655665 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.655949 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.656237 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.656511 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.656793 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.657066 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.657338 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] use_journal = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.657636 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] use_json = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.657910 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.658181 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.658464 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.658737 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.659010 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.659282 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.659556 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.659839 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:17.660137 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.660434 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.660733 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.661168 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.662060 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.662349 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.662640 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.662923 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.663210 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.663497 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.663791 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.664071 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.664361 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.664638 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.664933 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.665240 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.665561 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.665856 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.666137 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.666417 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.666694 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.666976 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.667266 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.667546 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.667836 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.668127 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.668407 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.668705 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.668991 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.669286 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.669607 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.669883 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.670163 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.670453 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.670731 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.671004 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.671281 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.671570 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.671851 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.672125 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.672410 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.672690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.672965 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.673236 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.673537 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.673831 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.674110 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.674382 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.674654 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.674931 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.675207 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.675490 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.675768 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.676040 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.676313 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.676591 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.676861 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.677339 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.677453 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.677724 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.678001 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.678274 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.678546 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.678818 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.679088 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.679357 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.679627 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.679897 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.680174 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.680444 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.680723 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.680991 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.681262 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.681559 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.681847 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.682149 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.682432 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.682713 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.682995 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.683276 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.683555 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.683837 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.684118 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.684397 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.684671 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.684961 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.685246 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.685806 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.686090 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.686394 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.686691 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.686968 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.687253 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.687531 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.687811 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.688096 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.688383 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.688679 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.688975 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.689273 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.689606 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.689901 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.690188 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.690500 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.690785 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:17.691003 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 10 14:16:17.691247 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=103699) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Dec 10 14:16:18.119669 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=103699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 10 14:16:18.119954 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=103699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 10 14:16:18.120266 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=103699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 10 14:16:18.120605 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.manager [-] Loading core plugin: ml2 Dec 10 14:16:18.450899 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.451197 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.451481 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.452780 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.453060 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.453330 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.499621 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.499906 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.500178 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.514390 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.514678 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.514954 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.544212 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.544498 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.544775 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.582216 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.582500 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.582770 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.934580 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.935192 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.935192 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.935700 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:18.936411 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.036204 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.036563 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.036855 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.037139 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.037439 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.037768 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.038040 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.038308 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.038572 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.038866 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.039138 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.039418 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.039683 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.039949 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.040215 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.040489 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.040756 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.041036 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.041317 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.041618 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.041899 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.042160 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.042451 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.042839 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.043097 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.043352 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.043752 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=103699) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 10 14:16:19.043993 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=103699) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 10 14:16:19.044231 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=103699) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 10 14:16:19.044468 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=103699) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 10 14:16:19.044704 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=103699) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 10 14:16:19.044939 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=103699) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 10 14:16:19.045302 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Dec 10 14:16:19.048446 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Dec 10 14:16:19.053137 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Dec 10 14:16:19.057055 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(350, 399)])]) Dec 10 14:16:19.058725 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Dec 10 14:16:19.059185 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Dec 10 14:16:19.059524 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Dec 10 14:16:19.059915 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Dec 10 14:16:19.063341 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Dec 10 14:16:19.063598 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Dec 10 14:16:19.063957 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Dec 10 14:16:19.069925 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Dec 10 14:16:19.092872 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Dec 10 14:16:19.093326 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.093660 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=103699) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Dec 10 14:16:19.094029 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.095425 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=103699) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Dec 10 14:16:19.095709 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Dec 10 14:16:19.095959 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Dec 10 14:16:19.099216 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.099507 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:19.163237 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Dec 10 14:16:19.163484 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Dec 10 14:16:19.163724 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Dec 10 14:16:19.164095 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Dec 10 14:16:19.186614 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_db.sqlalchemy.engines [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 10 14:16:19.810970 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Initializing driver for type 'gre' Dec 10 14:16:19.811537 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] gre ID ranges: [(1, 1000)] Dec 10 14:16:20.038939 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Initializing driver for type 'local' Dec 10 14:16:20.039589 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Initializing driver for type 'vlan' Dec 10 14:16:20.107646 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] VlanTypeDriver initialization complete Dec 10 14:16:20.107946 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Initializing driver for type 'vxlan' Dec 10 14:16:20.108475 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] vxlan ID ranges: [(1, 1000)] Dec 10 14:16:20.307602 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Initializing extension driver 'port_security' Dec 10 14:16:20.307941 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.extensions.port_security [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] PortSecurityExtensionDriver initialization complete Dec 10 14:16:20.308277 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Initializing mechanism driver 'openvswitch' Dec 10 14:16:20.308619 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Initializing mechanism driver 'hyperv' Dec 10 14:16:20.315613 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.plugins.ml2.plugin [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=103699) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:16:20.316472 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > port after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.316844 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > port after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.317196 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > port after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.318290 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=103699) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 10 14:16:20.318724 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > subnet after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.319079 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > subnet after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.319424 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > subnet after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.319827 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=103699) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 10 14:16:20.320236 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > network after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.320586 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > network after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.320930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > network after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.321330 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=103699) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 10 14:16:20.321765 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > security_group after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.322118 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > security_group after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.322459 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > security_group after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.322863 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=103699) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 10 14:16:20.323271 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.323617 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.323959 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.324357 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=103699) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 10 14:16:20.324764 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > address_group after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.325107 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > address_group after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.325510 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > address_group after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.331281 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=103699) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 10 14:16:20.331281 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] ML2 OVO RPC backend initialized. {{(pid=103699) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Dec 10 14:16:20.331281 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router_interface after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.331281 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.331281 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > network before_response 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.331714 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > networks before_response 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.331714 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > port before_response 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.331714 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > ports before_response 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.331714 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > subnet before_response 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332012 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > subnets before_response 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332012 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > network after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332012 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > network after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332012 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > network after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332302 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > port after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332302 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > port after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332302 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > port after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332302 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > subnet after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332669 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > subnet after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332669 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > subnet after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.332979 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.plugin [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Modular L2 Plugin initialization complete Dec 10 14:16:20.333292 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading services supported by the core plugin {{(pid=103699) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Dec 10 14:16:20.334292 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.plugins.ml2.managers [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Got port-security extension from driver 'port_security' Dec 10 14:16:20.334798 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.extensions.vlantransparent [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Disabled vlantransparent extension. Dec 10 14:16:20.335289 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=103699) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Dec 10 14:16:20.335983 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading Plugin: router Dec 10 14:16:20.371561 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router_interface before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.371889 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router after_create 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.372260 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router before_create 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.372622 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.372996 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.373351 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router after_delete 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.373741 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > floatingip after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.374209 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > floatingip after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.374573 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router after_create 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.374922 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router after_update 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.375281 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router after_update 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.375632 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.375989 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router after_update 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.376399 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router precommit_update 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.376772 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: port after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.377116 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: port after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.377481 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: subnet after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.377822 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.378171 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > port precommit_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.378516 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router precommit_create 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.378857 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: port before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.379204 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router precommit_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.379555 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router after_update 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.379893 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router precommit_delete 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.380242 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router precommit_create 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.380600 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router_interface after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.380944 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router precommit_update 55549900 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.381820 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > agent after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.382182 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > agent after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.382516 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > network after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.383382 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Tracking information for resource: router configured {{(pid=103699) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 10 14:16:20.383708 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Tracking information for resource: floatingip configured {{(pid=103699) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 10 14:16:20.388583 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.db.l3_agentschedulers_db [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Dec 10 14:16:20.389159 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: port after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.389546 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: port after_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.389903 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: port after_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.390256 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: port after_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.391041 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router before_create 55550100 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.391410 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router precommit_delete 55550100 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.391777 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router precommit_create 55550100 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.392135 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > router precommit_update 55550100 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.397647 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.services.provider_configuration [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service providers = [] {{(pid=103699) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Dec 10 14:16:20.398014 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.db.servicetype_db [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=103699) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Dec 10 14:16:20.400942 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.services.service_base [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=103699) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 10 14:16:20.401285 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.services.service_base [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=103699) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 10 14:16:20.401652 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.services.service_base [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=103699) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 10 14:16:20.402539 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.services.service_base [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=103699) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 10 14:16:20.402908 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.services.service_base [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Default provider is not specified for service type L3_ROUTER_NAT Dec 10 14:16:20.403292 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=103699) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 10 14:16:20.403596 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Dec 10 14:16:20.414334 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=103699) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 10 14:16:20.414670 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading Plugin: auto_allocate Dec 10 14:16:20.420465 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: network precommit_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.420828 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: network precommit_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.421345 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=103699) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 10 14:16:20.421691 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading Plugin: tag Dec 10 14:16:20.428435 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=103699) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 10 14:16:20.428763 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading Plugin: timestamp Dec 10 14:16:20.432564 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=103699) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 10 14:16:20.432892 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading Plugin: network_ip_availability Dec 10 14:16:20.438605 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.438976 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.439333 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.440044 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=103699) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 10 14:16:20.440367 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading Plugin: flavors Dec 10 14:16:20.445867 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=103699) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 10 14:16:20.446196 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading Plugin: revisions Dec 10 14:16:20.450482 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=103699) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 10 14:16:20.450874 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_concurrency.lockutils [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.331s {{(pid=103699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 10 14:16:20.451614 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=103699) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Dec 10 14:16:20.451946 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Initializing extension manager. Dec 10 14:16:20.452459 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: __init__.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.452798 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: __pycache__ {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.453130 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.453507 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: address_group.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.454252 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.454812 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: address-group Dec 10 14:16:20.455134 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: address_scope.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.455843 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.456357 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: address-scope Dec 10 14:16:20.456677 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: admin_state_down_before_update.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.457626 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.458144 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: router-admin-state-down-before-update Dec 10 14:16:20.458464 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: agent.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.460492 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.461016 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: agent Dec 10 14:16:20.461338 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: agent_resources_synced.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.462297 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.462820 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: agent-resources-synced Dec 10 14:16:20.463145 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: allowedaddresspairs.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.464939 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.465500 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: allowed-address-pairs Dec 10 14:16:20.465827 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: auto_allocated_topology.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.466927 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.467451 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: auto-allocated-topology Dec 10 14:16:20.467773 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: availability_zone.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.468460 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.468974 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: availability_zone Dec 10 14:16:20.469292 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: availability_zone_filter.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.470389 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.470900 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: availability_zone_filter Dec 10 14:16:20.471219 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: data_plane_status.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.472130 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.472640 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension data-plane-status not supported by any of loaded plugins Dec 10 14:16:20.472955 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: default_subnetpools.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.473899 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.474413 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: default-subnetpools Dec 10 14:16:20.474730 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: dhcpagentscheduler.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.475565 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.476077 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: dhcp_agent_scheduler Dec 10 14:16:20.476396 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: dns.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.477308 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.477852 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension dns-integration not supported by any of loaded plugins Dec 10 14:16:20.478174 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: dns_domain_ports.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.479088 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.479604 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension dns-domain-ports not supported by any of loaded plugins Dec 10 14:16:20.479923 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.480843 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.481380 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Dec 10 14:16:20.481721 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: dvr.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.482386 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.482897 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: dvr Dec 10 14:16:20.483215 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: ecmp_routes.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.484120 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.484630 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension ecmp_routes not supported by any of loaded plugins Dec 10 14:16:20.484946 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: empty_string_filtering.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.485882 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.486396 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: empty-string-filtering Dec 10 14:16:20.486712 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.487612 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.488120 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Dec 10 14:16:20.488441 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.489344 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.489880 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Dec 10 14:16:20.490201 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: external_net.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.491141 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.491651 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: external-net Dec 10 14:16:20.491969 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: extra_dhcp_opt.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.492921 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.493462 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: extra_dhcp_opt Dec 10 14:16:20.493775 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: extraroute.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.494673 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.495202 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: extraroute Dec 10 14:16:20.495525 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: extraroute_atomic.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.498250 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.498788 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: extraroute-atomic Dec 10 14:16:20.499117 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: filter_validation.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.499795 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.500314 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: filter-validation Dec 10 14:16:20.500638 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: fip_pf_description.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.501591 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.502106 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Dec 10 14:16:20.502431 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: fip_port_details.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.503355 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.504151 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: fip-port-details Dec 10 14:16:20.504475 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: flavors.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.505757 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.506820 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: flavors Dec 10 14:16:20.507145 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.508833 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.509359 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Dec 10 14:16:20.509715 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: floatingip_pools.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.510412 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.510931 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: floatingip-pools Dec 10 14:16:20.511255 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: ip_allocation.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.512182 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.512695 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension ip_allocation not supported by any of loaded plugins Dec 10 14:16:20.513017 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.513968 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.514485 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: ip-substring-filtering Dec 10 14:16:20.514813 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: l2_adjacency.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.515745 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.516267 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension l2_adjacency not supported by any of loaded plugins Dec 10 14:16:20.516590 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: l3.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.517619 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.518145 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: router Dec 10 14:16:20.518470 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: l3_conntrack_helper.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.520745 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.521287 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Dec 10 14:16:20.521711 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.523274 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.523796 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: ext-gw-mode Dec 10 14:16:20.524123 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.525039 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.525590 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: l3-ha Dec 10 14:16:20.525915 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: l3_flavors.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.526860 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.527377 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: l3-flavors Dec 10 14:16:20.527704 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.528613 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.529125 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: l3-port-ip-change-not-allowed Dec 10 14:16:20.529476 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: l3agentscheduler.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.530532 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.531053 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: l3_agent_scheduler Dec 10 14:16:20.531380 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: local_ip.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.533140 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.533701 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension local_ip not supported by any of loaded plugins Dec 10 14:16:20.534032 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: logging.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.535521 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.536065 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension logging not supported by any of loaded plugins Dec 10 14:16:20.536402 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: metering.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.537272 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.537921 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: metering Dec 10 14:16:20.538255 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.539356 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.539864 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: metering_source_and_destination_fields Dec 10 14:16:20.540190 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: multiprovidernet.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.541121 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.541791 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: multi-provider Dec 10 14:16:20.542117 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: netmtu.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.543029 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.543541 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: net-mtu Dec 10 14:16:20.543866 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: netmtu_writable.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.544774 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.545289 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: net-mtu-writable Dec 10 14:16:20.545638 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: network_availability_zone.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.546308 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.546819 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: network_availability_zone Dec 10 14:16:20.547138 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: network_ip_availability.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.548241 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.548764 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: network-ip-availability Dec 10 14:16:20.549087 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: network_segment_range.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.549866 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.550376 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension network-segment-range not supported by any of loaded plugins Dec 10 14:16:20.550697 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: pagination.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.551670 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.552000 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: pagination Dec 10 14:16:20.552318 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: port_device_profile.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.553785 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.554305 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: port-device-profile Dec 10 14:16:20.554626 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.555551 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.556067 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: port-mac-address-regenerate Dec 10 14:16:20.556393 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.557298 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.557850 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: port-numa-affinity-policy Dec 10 14:16:20.558173 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: port_resource_request.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.559075 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.559585 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension port-resource-request not supported by any of loaded plugins Dec 10 14:16:20.559906 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: port_resource_request_groups.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.561119 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.561653 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension port-resource-request-groups not supported by any of loaded plugins Dec 10 14:16:20.561975 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: portbindings.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.562901 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.563415 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: binding Dec 10 14:16:20.563735 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: portbindings_extended.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.565002 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.565556 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: binding-extended Dec 10 14:16:20.565884 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: portsecurity.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.566812 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.567331 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: port-security Dec 10 14:16:20.567656 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: project_id.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.569249 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.569602 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: project-id Dec 10 14:16:20.570037 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: providernet.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.570972 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.571490 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: provider Dec 10 14:16:20.571810 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.575497 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.576031 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos not supported by any of loaded plugins Dec 10 14:16:20.576363 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.577648 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.578173 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Dec 10 14:16:20.578498 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.579412 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.579930 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Dec 10 14:16:20.580253 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_default.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.581157 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.581704 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-default not supported by any of loaded plugins Dec 10 14:16:20.582027 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_fip.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.582668 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.583171 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-fip not supported by any of loaded plugins Dec 10 14:16:20.583490 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_fip_network_policy.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.584506 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension file qos_fip_network_policy.py wasn't loaded due to cannot import name 'qos_fip_network_policy' from 'neutron_lib.api.definitions' (/usr/local/lib/python3.8/dist-packages/neutron_lib/api/definitions/__init__.py) Dec 10 14:16:20.584836 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_gateway_ip.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.585770 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.586291 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-gateway-ip not supported by any of loaded plugins Dec 10 14:16:20.586620 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_port_network_policy.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.587544 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.588061 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-port-network-policy not supported by any of loaded plugins Dec 10 14:16:20.588384 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.589560 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.590080 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-pps-minimum not supported by any of loaded plugins Dec 10 14:16:20.590401 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_pps_rule.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.591577 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.592097 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-pps not supported by any of loaded plugins Dec 10 14:16:20.592422 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_rule_type_details.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.593332 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.593872 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-rule-type-details not supported by any of loaded plugins Dec 10 14:16:20.594195 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: qos_rules_alias.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.595230 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.595750 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension qos-rules-alias not supported by any of loaded plugins Dec 10 14:16:20.596072 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: quota_check_limit.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.596985 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.597530 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: quota-check-limit Dec 10 14:16:20.597854 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: quotasv2.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.598777 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.599103 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: quotas Dec 10 14:16:20.599421 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: quotasv2_detail.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.602589 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.602932 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: quota_details Dec 10 14:16:20.603264 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: rbac.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.604308 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.604842 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: rbac-policies Dec 10 14:16:20.605170 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: rbac_address_group.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.606130 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.606662 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: rbac-address-group Dec 10 14:16:20.606988 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: rbac_address_scope.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.607921 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.608449 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: rbac-address-scope Dec 10 14:16:20.608773 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: rbac_security_groups.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.609715 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.610244 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: rbac-security-groups Dec 10 14:16:20.610568 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: rbac_subnetpool.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.611479 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.611998 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: rbac-subnetpool Dec 10 14:16:20.612322 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: revisionifmatch.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.613243 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.613790 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: revision-if-match Dec 10 14:16:20.614112 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: revisions.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.615218 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.616377 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: standard-attr-revisions Dec 10 14:16:20.616703 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: router_availability_zone.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.617374 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.617920 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: router_availability_zone Dec 10 14:16:20.618243 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: routerservicetype.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.619151 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.619667 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension router-service-type not supported by any of loaded plugins Dec 10 14:16:20.619988 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.620972 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.621519 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: security-groups-normalized-cidr Dec 10 14:16:20.621889 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: security_groups_port_filtering.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.622759 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.623274 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: port-security-groups-filtering Dec 10 14:16:20.623596 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.624513 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.625030 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: security-groups-remote-address-group Dec 10 14:16:20.625352 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.626302 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.626821 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: security-groups-shared-filtering Dec 10 14:16:20.627149 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.627718 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Dec 10 14:16:20.628036 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: securitygroup.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.638420 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.638963 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: security-group Dec 10 14:16:20.639295 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: segment.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.640075 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.640591 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension segment not supported by any of loaded plugins Dec 10 14:16:20.640914 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.641868 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.642386 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Dec 10 14:16:20.642709 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: servicetype.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.643812 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.644342 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: service-type Dec 10 14:16:20.644668 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: sorting.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.645689 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.646018 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: sorting Dec 10 14:16:20.646337 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: standard_attr_segment.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.647275 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.647799 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension standard-attr-segment not supported by any of loaded plugins Dec 10 14:16:20.648118 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: standardattrdescription.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.648760 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.649277 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: standard-attr-description Dec 10 14:16:20.649623 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: stateful_security_group.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.650569 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.651089 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: stateful-security-group Dec 10 14:16:20.651415 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: stdattrs_common.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.651980 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Dec 10 14:16:20.652299 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.653237 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.653797 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Dec 10 14:16:20.654125 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: subnet_onboard.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.655197 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.655726 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: subnet_onboard Dec 10 14:16:20.656053 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.656972 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.657512 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Dec 10 14:16:20.657839 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: subnet_service_types.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.658766 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.659288 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: subnet-service-types Dec 10 14:16:20.659614 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: subnetallocation.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.660693 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.661363 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: subnet_allocation Dec 10 14:16:20.661715 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.662393 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.662905 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: subnetpool-prefix-ops Dec 10 14:16:20.663225 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.664175 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.664686 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Dec 10 14:16:20.665006 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: tagging.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.666082 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.666601 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: standard-attr-tag Dec 10 14:16:20.666933 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: timestamp.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.668132 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.668656 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loaded extension: standard-attr-timestamp Dec 10 14:16:20.668978 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: trunk.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.670038 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.670559 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension trunk not supported by any of loaded plugins Dec 10 14:16:20.670957 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: trunk_details.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.671879 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.672402 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension trunk-details not supported by any of loaded plugins Dec 10 14:16:20.672724 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: uplink_status_propagation.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.673666 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.674187 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension uplink-status-propagation not supported by any of loaded plugins Dec 10 14:16:20.674504 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Loading extension file: vlantransparent.py {{(pid=103699) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 10 14:16:20.675168 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=103699) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 10 14:16:20.675833 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extension vlan-transparent not supported by any of loaded plugins Dec 10 14:16:20.678813 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:network Dec 10 14:16:20.679340 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:subnet Dec 10 14:16:20.685535 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:subnetpool Dec 10 14:16:20.685535 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:port Dec 10 14:16:20.685535 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.685535 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service FLAVORS assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.685535 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.685535 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.685535 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:router Dec 10 14:16:20.685535 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:floatingip Dec 10 14:16:20.686129 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service METERING assigned prefix: /metering {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.686129 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.686129 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.686519 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103699) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:16:20.687519 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of CountableResource for resource:rbac_policy Dec 10 14:16:20.687966 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:security_group Dec 10 14:16:20.688405 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:security_group_rule Dec 10 14:16:20.689028 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service CORE assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.689358 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:subnetpool Dec 10 14:16:20.689732 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] subnetpool is already registered Dec 10 14:16:20.690186 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service CORE assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.690513 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:subnetpool Dec 10 14:16:20.690845 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] subnetpool is already registered Dec 10 14:16:20.693079 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.693591 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service FLAVORS assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.694730 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.695147 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.695479 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:router Dec 10 14:16:20.695817 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] router is already registered Dec 10 14:16:20.696224 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:floatingip Dec 10 14:16:20.696555 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] floatingip is already registered Dec 10 14:16:20.697007 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service METERING assigned prefix: /metering {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.697692 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of CountableResource for resource:rbac_policy Dec 10 14:16:20.698019 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] rbac_policy is already registered Dec 10 14:16:20.698433 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:security_group Dec 10 14:16:20.698765 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] security_group is already registered Dec 10 14:16:20.699169 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:security_group_rule Dec 10 14:16:20.699496 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] security_group_rule is already registered Dec 10 14:16:20.700183 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service CORE assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.700510 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:subnetpool Dec 10 14:16:20.700841 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] subnetpool is already registered Dec 10 14:16:20.701266 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.v2.resource_helper [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Service CORE assigned prefix: {{(pid=103699) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 10 14:16:20.701675 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Creating instance of TrackedResource for resource:subnetpool Dec 10 14:16:20.702003 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING neutron.quota.resource_registry [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] subnetpool is already registered Dec 10 14:16:20.702467 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: extensions {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.703922 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: address-groups {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.705445 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: address-scopes {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.706817 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: agents {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.707989 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: auto-allocated-topology {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.709274 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: availability_zones {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.710517 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: dhcp-networks {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.713090 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: dhcp-agents {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.713565 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: routers {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.715779 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: flavors {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.716947 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: service_profiles {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.718261 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: next_providers {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.719765 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: service_profiles {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.722328 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: floatingip-pools {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.723611 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: routers {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.725794 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: floatingips {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.727104 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: l3-routers {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.728477 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: l3-agents {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.730086 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: metering-labels {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.731460 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: metering-label-rules {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.732757 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: network-ip-availabilities {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.734057 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: bindings {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.735792 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: quotas {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.737399 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: quotas {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.739005 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: rbac-policies {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.740307 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: security-groups {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.742432 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: security-group-rules {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.745823 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: service-providers {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.745823 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: subnetpools {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.746513 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: subnetpools {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.747975 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.749690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.751505 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.753383 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.755214 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.757751 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.759445 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.761357 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.763166 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.765077 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron.api.extensions [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Extended resource: tags {{(pid=103699) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 10 14:16:20.771296 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING keystonemiddleware.auth_token [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 10 14:16:20.776222 dv-neutron-821401-2-hyperv neutron-server[103699]: WARNING keystonemiddleware.auth_token [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 10 14:16:20.785096 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_concurrency.lockutils [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Acquired lock "singleton_lock" {{(pid=103699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 10 14:16:20.785589 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_concurrency.lockutils [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Releasing lock "singleton_lock" {{(pid=103699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 10 14:16:20.786278 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO oslo_service.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Starting 2 workers Dec 10 14:16:20.791122 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Started child 103810 {{(pid=103699) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 10 14:16:20.795690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Started child 103811 {{(pid=103699) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 10 14:16:20.796661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:20.797289 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO neutron.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Neutron service started, listening on 0.0.0.0:9696 Dec 10 14:16:20.797902 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Publish callbacks [] for process, before_spawn {{(pid=103699) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:20.798232 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [-] (103810) wsgi starting up on http://0.0.0.0:9696 Dec 10 14:16:20.800360 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO oslo_service.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Starting 1 workers Dec 10 14:16:20.800488 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:20.801908 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [-] (103811) wsgi starting up on http://0.0.0.0:9696 Dec 10 14:16:20.806118 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Started child 103812 {{(pid=103699) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 10 14:16:20.806700 dv-neutron-821401-2-hyperv neutron-server[103699]: INFO oslo_service.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Starting 1 workers Dec 10 14:16:20.809982 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] calling RpcWorker wait() {{(pid=103812) _wait /opt/stack/neutron/neutron/service.py:128}} Dec 10 14:16:20.810966 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] returning from RpcWorker wait() {{(pid=103812) _wait /opt/stack/neutron/neutron/service.py:135}} Dec 10 14:16:20.811507 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Started child 103813 {{(pid=103699) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 10 14:16:20.812206 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:20.812308 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG neutron_lib.callbacks.manager [None req-ddec6147-b350-4816-8d83-7f8309b37a31 None None] Publish callbacks [] for process, after_spawn {{(pid=103699) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:20.812708 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:16:20.814177 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103699) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 10 14:16:20.814389 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 10 14:16:20.814575 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 10 14:16:20.814803 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 10 14:16:20.815166 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 10 14:16:20.815345 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 10 14:16:20.815871 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.816149 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.816396 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.816663 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:20.817124 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.817124 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.817521 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.817693 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:16:20.817793 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.818023 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.818295 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.818567 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.819281 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.819457 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.819728 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.820005 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.820382 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.820650 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.820892 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.821132 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.821305 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.821585 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.821842 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.822088 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.822356 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] debug = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.822596 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.823040 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.823277 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.823508 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.823741 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.824013 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.824258 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.824513 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.824744 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.824974 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.825209 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.825468 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.825708 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.825923 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.826203 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.826444 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.826648 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.826861 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.827330 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] host = dv-neutron-821401-2-hyperv {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.827548 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.827760 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.828001 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.828250 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.828490 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.828732 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.828975 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.829240 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.829509 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.829697 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.829934 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.830172 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.830385 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.830619 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.830764 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_options = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.830998 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.831290 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.831552 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.831745 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.831906 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.832153 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.832434 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.832595 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.832776 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.833006 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.833214 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.833460 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.833654 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.833884 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.834170 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.834417 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.834628 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.834833 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.835088 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.835332 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.835553 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.835778 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.836031 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.836279 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.836496 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.836705 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.836943 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.837168 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.837384 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.837655 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.837926 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.838193 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.838422 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.838657 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.838912 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.839134 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.839360 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.839585 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.839884 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.840096 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.840346 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.840576 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.840784 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.841010 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.841248 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.841469 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.841701 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_json = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.841931 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.842159 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.842414 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.842650 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.842819 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.843025 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.843232 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.843484 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.844828 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.845146 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.845532 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.845839 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.846133 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.846399 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.846670 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.846907 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.847181 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.847425 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.847746 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.848015 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.848284 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.848513 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.848804 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.849151 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.849454 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.849737 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.849982 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.850206 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.850489 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.850716 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.851009 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.851236 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.851481 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.851717 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.851943 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.852239 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.852507 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.852859 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.853139 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.853393 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.57/identity {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.853696 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.853936 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.854161 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.854383 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.854626 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.854851 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.855105 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.855400 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.855647 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.855868 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.856095 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.856349 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.856588 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.856903 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.857167 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.857434 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.857776 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.861064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.861064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.861064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.861064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.861064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.861064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.861064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.861064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.861064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.864930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.864930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.864930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.864930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.864930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.864930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.864930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.864930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.864930 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.867323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.867323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.867323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.867323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.867323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.867323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.867323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.867323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.867323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.868520 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.868520 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.868520 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.868520 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.868520 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.868520 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.868520 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.868520 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.868520 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.870685 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.870685 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.870685 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.870685 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.870685 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.870685 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.870685 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.870685 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.874881 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.874881 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.874881 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.874881 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.874881 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.874881 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.874881 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.874881 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.875690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.875690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.875690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.875690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.875690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.875690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.875690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.875690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.876286 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.876286 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.876286 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.876286 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.876286 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.876286 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.876286 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.878506 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.878506 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.878506 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.878506 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.878506 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.878506 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.878506 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.878506 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.884545 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.884545 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.884545 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.884545 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.884545 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.884545 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.884545 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.884545 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.885616 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.885616 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.885616 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.887198 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.887198 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.887198 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.887198 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.887198 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.887754 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.887754 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.887902 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.888531 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.888822 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.889112 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.889386 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.889693 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.890898 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.891172 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.57/identity {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.891445 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.891685 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.891961 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.892213 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.892845 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.893084 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.893323 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.893582 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.894447 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.894705 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.894956 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.895191 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.895417 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.895647 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.895878 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.896138 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.896361 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.896595 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.896877 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.897120 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.897347 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.897594 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.897832 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.898108 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.898329 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.898607 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.898878 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.899115 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.899370 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.899608 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.899851 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.900072 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.900314 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.900538 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.900755 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.900971 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.901192 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.901410 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.901671 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.901899 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.902117 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.902375 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.902634 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.902972 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.903249 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.903482 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.903724 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.903945 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.904183 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.904425 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.904671 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.904891 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.905111 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.905331 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.905601 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.905846 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.906099 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.906347 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.906566 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.906780 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.907000 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.907218 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.907518 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.907771 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.908088 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.908356 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.908596 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.908834 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.909117 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.909292 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.909562 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.909792 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.910013 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.910226 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.910478 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.910691 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.911121 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.911536 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.911758 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.912166 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.912937 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.913153 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.913488 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.913631 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.913856 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.914071 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.914302 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.914514 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.914728 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.914976 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.915202 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.915420 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.915691 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.915880 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.916092 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.916338 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.916555 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.916791 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.917082 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.917358 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.917636 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.917929 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.918176 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.918422 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.918679 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.919005 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.919221 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.919463 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.919684 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.919942 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.920181 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.920438 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.920780 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.921047 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.921308 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.921607 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.921860 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.922137 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.922392 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.922609 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.922920 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.923253 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.923527 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.923778 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.924006 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.924257 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.924486 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.924702 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.924941 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.925177 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.925433 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.925703 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.925934 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.926162 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.926397 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.926627 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.926867 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.927112 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.927344 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.927586 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.927823 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.928036 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 10 14:16:20.929050 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103699) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 10 14:16:20.929238 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 10 14:16:20.929372 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 10 14:16:20.929554 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 10 14:16:20.929728 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 10 14:16:20.929896 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 10 14:16:20.930093 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.930260 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.930400 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.930547 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.930741 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.930919 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.931125 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.931264 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.931399 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.931586 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.931732 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.931869 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.932004 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.932140 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.932276 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.932421 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.932558 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.932704 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.932849 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.932998 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.933135 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.933270 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.933406 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] debug = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.933587 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.933804 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.933971 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.934109 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.934259 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.934407 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.934565 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.934709 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.934873 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.935016 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.935432 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.935599 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.935743 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.935905 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.936118 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.936259 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.936395 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.936530 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.936666 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] host = dv-neutron-821401-2-hyperv {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.936813 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.936949 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.937084 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.937229 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.937366 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.937546 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.937705 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.937850 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.938017 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.938180 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.938344 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.938506 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.938661 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.938810 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.938946 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_options = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.939109 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.939253 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.939417 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.939597 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.939837 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.940068 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.940246 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.940412 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.940588 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.940901 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.940901 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.941902 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.941902 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.941902 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.941902 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.941902 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.941902 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.941902 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.942999 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.942999 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.942999 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.942999 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.942999 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.942999 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.942999 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.943602 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.943602 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.943602 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.943602 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.944850 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.944850 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.944850 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.944850 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.944850 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.944850 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.944850 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.944850 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.945716 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.945716 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.945716 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.945716 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.945716 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.945716 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.946289 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.946289 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.946289 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.946289 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_json = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.946670 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.946670 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.946969 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.946969 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.947132 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.947132 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.947327 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.947450 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 10 14:16:20.947607 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.948046 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.948046 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.948288 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.948288 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.948533 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.948533 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.948765 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.949527 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.949527 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.949527 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.949527 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.949527 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.949910 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.949910 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.950058 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.950136 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.950263 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.950425 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.950589 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.950756 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.950915 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.951331 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.951498 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.951660 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.951822 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.951985 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.952155 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.952317 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.952496 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.952660 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.952823 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.57/identity {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.952980 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.953138 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.953298 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.953480 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.953650 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.953816 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.953965 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.954132 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.954288 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.954454 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.954616 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.954780 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.954943 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.955106 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.955270 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.955434 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.955598 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.955784 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.955927 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.956088 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.956251 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.956414 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.956578 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.956742 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.956903 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.957077 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.957241 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.957403 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.957586 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.957750 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.957913 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.958075 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.958237 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.958401 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.958565 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.958728 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.958981 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.959166 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.959334 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.959497 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.959660 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.959822 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.959988 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.960150 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.960314 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.960477 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.960639 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.960802 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.960934 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:16:20.961026 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.961105 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.961265 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.961438 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.961615 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.961780 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.961943 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.962105 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.962267 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.962429 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.962592 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.962762 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.962961 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.963124 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.963286 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.963448 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.963770 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.963935 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.964098 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.964261 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.964423 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.964585 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.964750 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.964913 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.965055 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.965214 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.965378 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.965554 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.965715 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.965877 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.966039 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.966201 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.966349 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.966513 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.966748 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.966923 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.967085 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.967242 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 50824) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:16:20.967335 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.967415 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.967566 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.967730 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.967893 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.968060 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.968233 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.968396 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.968561 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.968724 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.968887 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.969047 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.969211 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.969374 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.969560 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.969723 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.969890 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.970063 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.970228 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.970392 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.970554 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.970740 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.970903 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.971064 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.971227 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.971390 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.971553 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.971716 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.971878 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.972041 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.972203 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.972366 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.972529 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.57/identity {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.972690 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.972853 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.973015 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.973177 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.973340 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.973601 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.973736 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.973870 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.974059 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.974183 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.974304 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.974443 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.974581 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.974736 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.975433 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.975592 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.975749 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.975906 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.976063 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.976220 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.976380 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.977894 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.977894 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.977894 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.977894 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.977894 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.977894 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.977894 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.977894 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.979045 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.979045 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.979045 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980136 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [-] 10.222.0.57 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0088294 Dec 10 14:16:20.980224 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980224 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980224 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980224 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980224 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980224 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980224 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980224 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980756 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980756 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980756 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980756 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980756 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.980756 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.981084 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.981084 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.981795 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.981795 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.981795 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.982092 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.982092 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.982789 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.982789 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.982789 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.982789 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.983554 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.984718 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.984718 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.984718 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.985169 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.985362 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.985587 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.985760 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.986729 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.986908 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.987073 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.987246 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.987411 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.987584 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.987731 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.987893 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.988055 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.988235 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.988395 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.988558 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.988721 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.988883 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.989045 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.989217 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.989375 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.989717 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.989879 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.990193 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.990366 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.991100 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.991266 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.991429 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.991592 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.991756 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.991918 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.992092 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.992255 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.992405 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.992568 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.992731 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.992892 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.993066 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.993231 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.993393 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.994359 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.994540 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.994687 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.994848 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.995082 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.995189 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.995350 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.995518 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.995655 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.995815 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.996618 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.996618 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.996618 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.996618 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.996618 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.996971 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.996971 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.997089 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.997225 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.997396 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998034 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998034 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998034 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998034 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998950 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998950 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998950 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998950 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998950 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.998950 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.999359 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.999359 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.999497 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.999573 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.999704 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:20.999867 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:21.000227 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:21.000227 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:21.000380 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:21.000489 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 10 14:16:21.000616 dv-neutron-821401-2-hyperv neutron-server[103699]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 10 14:16:32.844295 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e36c6ed4-7804-416d-a991-fe2bb4b8e855 None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:16:32.926014 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e36c6ed4-7804-416d-a991-fe2bb4b8e855 None None] No non-hosted networks {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Dec 10 14:16:32.937696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.agentschedulers_db [None req-e36c6ed4-7804-416d-a991-fe2bb4b8e855 None None] DHCP Agent not found on host dv-neutron-821401-2-hyperv {{(pid=103812) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Dec 10 14:16:33.067985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c3057a1e-96c3-47e4-8cca-766e19a056c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-552189'] for agent, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:35.097774 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-dbad69e5-1209-4ee1-bde4-586efc6f39d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-552189'] for agent, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:35.131450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-16d2db3a-6aaa-4181-88e1-c57886d1e7fc None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-neutron-821401-2-hyperv {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:16:35.131812 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-16d2db3a-6aaa-4181-88e1-c57886d1e7fc None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:16:35.703268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-16d2db3a-6aaa-4181-88e1-c57886d1e7fc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:36.170011 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-552189'] for agent, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:37.587238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-552189'] for agent, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:38.734602 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.db.l3_hamode_db [None req-e7317106-6955-4130-9a0c-494642572df0 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Dec 10 14:16:38.812230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-552189'] for agent, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:38.812894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.813239 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.813600 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.813929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.814446 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.814775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.815133 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.815469 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.815794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.816132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.816472 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.816951 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.817482 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:38.818138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-neutron-821401-2-hyperv', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:16:38.825906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-neutron-821401-2-hyperv', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:16:38.832938 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7317106-6955-4130-9a0c-494642572df0 None None] Routers set() bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:16:38.833337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7317106-6955-4130-9a0c-494642572df0 None None] Router IDs set() for agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 10 14:16:39.106110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 50918) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:16:39.596643 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING oslo_policy.policy [None req-a4618bea-323b-4e7e-b637-37432a8820e8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 10 14:16:39.597323 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING oslo_policy.policy [None req-a4618bea-323b-4e7e-b637-37432a8820e8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 10 14:16:39.827213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-a4618bea-323b-4e7e-b637-37432a8820e8 admin admin] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:16:39.828319 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a4618bea-323b-4e7e-b637-37432a8820e8 admin admin] 10.222.0.57 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7211978 Dec 10 14:16:42.445660 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 50934) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:16:42.749303 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-39f1c627-a34c-4dec-b73b-5fc03823336e admin admin] Request body: {'subnetpool': {'is_default': True, 'default_prefixlen': 26, 'shared': True, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:16:42.844901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.policy [None req-39f1c627-a34c-4dec-b73b-5fc03823336e admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103811) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 10 14:16:42.892310 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING oslo_policy.policy [None req-39f1c627-a34c-4dec-b73b-5fc03823336e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 10 14:16:42.892702 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING oslo_policy.policy [None req-39f1c627-a34c-4dec-b73b-5fc03823336e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 10 14:16:42.901024 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.quota [None req-39f1c627-a34c-4dec-b73b-5fc03823336e admin admin] Loaded quota_driver: . Dec 10 14:16:43.053327 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39f1c627-a34c-4dec-b73b-5fc03823336e admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8745561018872', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8745561019307', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8745561004343', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8745561055912', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8745561049744', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8745561042314', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1511573', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1516437', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3696599', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3786028'] for rbac-policy, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:43.222697 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39f1c627-a34c-4dec-b73b-5fc03823336e admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:43.224478 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-39f1c627-a34c-4dec-b73b-5fc03823336e admin admin] 10.222.0.57 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.7772942 Dec 10 14:16:46.017699 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 50946) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:16:46.312971 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Request body: {'network': {'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'name': 'private', 'admin_state_up': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:16:46.397709 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Made reservation on behalf of 0d94dc3116a446c6a105a1a503ec3fad for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:16:46.400511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:46.417943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:46.523183 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:46.557729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:46.576715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] vlan segment allocate from pool success with {'vlan_id': 369, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:16:46.603840 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8745562671225', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:46.604407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Unsubscribe: segment precommit_create {{(pid=103811) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 10 14:16:46.604913 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Added segment 1b21895d-bd39-48d5-ac61-663153bcf158 of type vlan for network 53d41211-17c9-4622-953d-52366ebc4713 Dec 10 14:16:46.621161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e419663c-faf2-4850-bd6a-282a6908d6a1,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:16:46.672006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.672364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.672703 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.673033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.673359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.673706 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.674041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.674366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.674696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.675022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.675338 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.675718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.676007 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Tracked resource versions report: Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: pushed versions: Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: { 'AddressGroup': {'1.2'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'ConntrackHelper': {'1.0'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'LocalIPAssociation': {'1.0'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Log': {'1.0'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Network': {'1.1'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Port': {'1.7'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'PortForwarding': {'1.2'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'QosPolicy': {'1.10'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SecurityGroup': {'1.5'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SecurityGroupRule': {'1.2'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SubPort': {'1.0'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Subnet': {'1.1'}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Trunk': {'1.1'}} Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: consumer versions: Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: { DHCP agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: L3 agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: Metadata agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: Metering agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: Open vSwitch agent@dv-neutron-821401-2-hyperv: { 'AddressGroup': '1.2', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'ConntrackHelper': '1.0', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'LocalIPAssociation': '1.0', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Log': '1.0', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Network': '1.1', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Port': '1.7', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'PortForwarding': '1.2', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'QosPolicy': '1.10', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SecurityGroup': '1.5', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SecurityGroupRule': '1.2', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SubPort': '1.0', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Subnet': '1.1', Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Trunk': '1.1'}} Dec 10 14:16:46.678067 dv-neutron-821401-2-hyperv neutron-server[103811]: {{(pid=103811) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 10 14:16:46.719240 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:46.809843 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:46.810821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:16:46.811510 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:46.901644 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.8828459 Dec 10 14:16:46.910057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f10a943-d098-42dc-9883-7f6a36b399a2 admin admin] Pushing event updated for resources: {'Network': ['ID=53d41211-17c9-4622-953d-52366ebc4713,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:16:46.922753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 53d41211-17c9-4622-953d-52366ebc4713 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:16:49.729582 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 50960) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:16:50.215614 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING oslo_policy.policy [None req-bd0d0a89-a2b2-4dff-ab6b-57657cb2b657 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 10 14:16:50.216236 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING oslo_policy.policy [None req-bd0d0a89-a2b2-4dff-ab6b-57657cb2b657 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 10 14:16:50.657183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.policy [None req-bd0d0a89-a2b2-4dff-ab6b-57657cb2b657 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103810) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 10 14:16:50.703994 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING oslo_policy.policy [None req-bd0d0a89-a2b2-4dff-ab6b-57657cb2b657 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 10 14:16:50.704384 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING oslo_policy.policy [None req-bd0d0a89-a2b2-4dff-ab6b-57657cb2b657 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 10 14:16:50.713746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd0d0a89-a2b2-4dff-ab6b-57657cb2b657 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:16:50.715627 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bd0d0a89-a2b2-4dff-ab6b-57657cb2b657 admin admin] 10.222.0.57 "GET /v2.0/networks/53d41211-17c9-4622-953d-52366ebc4713 HTTP/1.1" status: 200 len: 825 time: 0.9840539 Dec 10 14:16:50.754399 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b6ced711-e306-4c4a-9dd8-22767ad9aca6 admin admin] 10.222.0.57 "GET /v2.0/subnetpools/4e6b11e1-83aa-4577-b279-558b77cb9d6d HTTP/1.1" status: 200 len: 734 time: 0.0327146 Dec 10 14:16:50.763882 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'subnetpool_id': '4e6b11e1-83aa-4577-b279-558b77cb9d6d', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:16:50.765488 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.quota [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Loaded quota_driver: . Dec 10 14:16:50.884254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Made reservation on behalf of 0d94dc3116a446c6a105a1a503ec3fad for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:16:50.900274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:51.255748 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:51.325021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Checking segment: {'id': '1b21895d-bd39-48d5-ac61-663153bcf158', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:16:51.325373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Network hostable DHCP agents. Network: 53d41211-17c9-4622-953d-52366ebc4713, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:16:51.334866 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9c8c3321-80e1-4e17-bce6-dde0b7958814,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:16:51.347843 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Tracked resource versions report: Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: pushed versions: Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: { 'AddressGroup': {'1.2'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'ConntrackHelper': {'1.0'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'LocalIPAssociation': {'1.0'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Log': {'1.0'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Network': {'1.1'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Port': {'1.7'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'PortForwarding': {'1.2'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'QosPolicy': {'1.10'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SecurityGroup': {'1.5'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SecurityGroupRule': {'1.2'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SubPort': {'1.0'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Subnet': {'1.1'}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Trunk': {'1.1'}} Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: consumer versions: Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: { DHCP agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: L3 agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: Metadata agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: Metering agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: Open vSwitch agent@dv-neutron-821401-2-hyperv: { 'AddressGroup': '1.2', Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'ConntrackHelper': '1.0', Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'LocalIPAssociation': '1.0', Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Log': '1.0', Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Network': '1.1', Dec 10 14:16:51.354930 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Port': '1.7', Dec 10 14:16:51.356397 dv-neutron-821401-2-hyperv neutron-server[103810]: 'PortForwarding': '1.2', Dec 10 14:16:51.356397 dv-neutron-821401-2-hyperv neutron-server[103810]: 'QosPolicy': '1.10', Dec 10 14:16:51.356397 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SecurityGroup': '1.5', Dec 10 14:16:51.356397 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SecurityGroupRule': '1.2', Dec 10 14:16:51.356397 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SubPort': '1.0', Dec 10 14:16:51.356397 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Subnet': '1.1', Dec 10 14:16:51.356397 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Trunk': '1.1'}} Dec 10 14:16:51.356397 dv-neutron-821401-2-hyperv neutron-server[103810]: {{(pid=103810) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 10 14:16:51.432191 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Network 53d41211-17c9-4622-953d-52366ebc4713 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:16:51.489598 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 53d41211-17c9-4622-953d-52366ebc4713) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:16:51.494254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:16:51.494862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:51.499444 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e9c0268-347d-4704-a9e3-e74fc6e2d665 None None] Network 53d41211-17c9-4622-953d-52366ebc4713 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:16:51.555438 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cd166c4f-14ec-45c3-9c71-e5cf170e3f79 admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7948594 Dec 10 14:16:51.767798 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-53d41211-17c9-4622-953d-52366ebc4713', 'network_id': '53d41211-17c9-4622-953d-52366ebc4713', 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'fixed_ips': [{'subnet_id': '9c8c3321-80e1-4e17-bce6-dde0b7958814'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:16:51.769215 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:52.073669 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Allocated IP 172.20.0.2 (53d41211-17c9-4622-953d-52366ebc4713/9c8c3321-80e1-4e17-bce6-dde0b7958814/060aa4c2-4d44-401c-bb3c-650c9d9ec3de) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:16:52.312719 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:52.415458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:52.496089 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Network 53d41211-17c9-4622-953d-52366ebc4713 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:16:52.503075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:16:52.507280 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:16:52.510366 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Pushing event updated for resources: {'Port': ['ID=060aa4c2-4d44-401c-bb3c-650c9d9ec3de,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:16:52.519332 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.519696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.520042 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.520918 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.521255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.521606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.521950 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.522279 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.522622 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.522965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.523288 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.523606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.523923 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Tracked resource versions report: Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: pushed versions: Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: { 'AddressGroup': {'1.2'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'ConntrackHelper': {'1.0'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'LocalIPAssociation': {'1.0'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Log': {'1.0'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Network': {'1.1'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Port': {'1.7'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'PortForwarding': {'1.2'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'QosPolicy': {'1.10'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SecurityGroup': {'1.5'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SecurityGroupRule': {'1.2'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SubPort': {'1.0'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Subnet': {'1.1'}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Trunk': {'1.1'}} Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: consumer versions: Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: { DHCP agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: L3 agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: Metadata agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: Metering agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: Open vSwitch agent@dv-neutron-821401-2-hyperv: { 'AddressGroup': '1.2', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'ConntrackHelper': '1.0', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'LocalIPAssociation': '1.0', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Log': '1.0', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Network': '1.1', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Port': '1.7', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'PortForwarding': '1.2', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'QosPolicy': '1.10', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SecurityGroup': '1.5', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SecurityGroupRule': '1.2', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SubPort': '1.0', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Subnet': '1.1', Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Trunk': '1.1'}} Dec 10 14:16:52.525327 dv-neutron-821401-2-hyperv neutron-server[103812]: {{(pid=103812) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 10 14:16:52.597671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Attempting to bind port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:16:52.598009 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Attempting to bind port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '1b21895d-bd39-48d5-ac61-663153bcf158', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:16:52.598510 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Attempting to bind port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de on network 53d41211-17c9-4622-953d-52366ebc4713 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:16:52.603715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 16, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:16:52.604107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Checking segment: {'id': '1b21895d-bd39-48d5-ac61-663153bcf158', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:16:52.604574 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:52.605079 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Bound using segment: {'id': '1b21895d-bd39-48d5-ac61-663153bcf158', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:16:52.605725 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Bound port: 060aa4c2-4d44-401c-bb3c-650c9d9ec3de, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1b21895d-bd39-48d5-ac61-663153bcf158', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:16:52.606144 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:52.669847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] For port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:16:52.674369 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] For port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=060aa4c2-4d44-401c-bb3c-650c9d9ec3de,segment=NetworkSegment(1b21895d-bd39-48d5-ac61-663153bcf158),segment_id=1b21895d-bd39-48d5-ac61-663153bcf158)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:16:52.718134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:16:52.787087 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fda5be0c-0e8b-48a1-a06c-50495f3f7f9b None None] Pushing event updated for resources: {'Port': ['ID=060aa4c2-4d44-401c-bb3c-650c9d9ec3de,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:16:54.176691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 50980) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:16:54.487524 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-faa545a6-d870-49ab-9452-91d42bf71eb9 admin admin] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:16:54.488549 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-faa545a6-d870-49ab-9452-91d42bf71eb9 admin admin] 10.222.0.57 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3108826 Dec 10 14:16:57.105512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 50988) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:16:57.419454 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-eee87b70-9dd4-4ab5-9017-3d1da9ff83a7 admin admin] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:16:57.420431 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-eee87b70-9dd4-4ab5-9017-3d1da9ff83a7 admin admin] 10.222.0.57 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3139102 Dec 10 14:16:59.869597 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 5 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:17:00.257283 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 50998) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:17:00.562433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9e5955f5-0d30-4a84-b67d-f020c267e91a admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:17:00.666624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e5955f5-0d30-4a84-b67d-f020c267e91a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:00.668301 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e5955f5-0d30-4a84-b67d-f020c267e91a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:00.809719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e5955f5-0d30-4a84-b67d-f020c267e91a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:00.878475 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e5955f5-0d30-4a84-b67d-f020c267e91a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:00.948182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e5955f5-0d30-4a84-b67d-f020c267e91a admin admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:00.949394 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9e5955f5-0d30-4a84-b67d-f020c267e91a admin admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6909602 Dec 10 14:17:01.761518 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-673b5959-b22f-4bed-82e6-c8155cd1767c None None] Network 53d41211-17c9-4622-953d-52366ebc4713 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:17:01.853157 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-67acba7c-860f-4813-9664-55d98fecebba None None] Provisioning complete for port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:01.853602 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-67acba7c-860f-4813-9664-55d98fecebba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:02.037924 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-67acba7c-860f-4813-9664-55d98fecebba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:02.076246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-67acba7c-860f-4813-9664-55d98fecebba None None] For port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=060aa4c2-4d44-401c-bb3c-650c9d9ec3de,segment=NetworkSegment(1b21895d-bd39-48d5-ac61-663153bcf158),segment_id=1b21895d-bd39-48d5-ac61-663153bcf158)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:17:02.146949 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-67acba7c-860f-4813-9664-55d98fecebba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:02.193780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67acba7c-860f-4813-9664-55d98fecebba None None] Pushing event updated for resources: {'Port': ['ID=060aa4c2-4d44-401c-bb3c-650c9d9ec3de,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:02.266697 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-70baace9-c6e9-4dc0-b8da-8edb623d5e46 None None] Provisioning complete for port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:02.267301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70baace9-c6e9-4dc0-b8da-8edb623d5e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:02.491287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 060aa4c2-4d44-401c-bb3c-650c9d9ec3de up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:17:02.542718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:02.543004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:02.832238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4d4e65d-0e72-4c37-8cc6-45870e1710ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:03.548809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 51010) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:17:03.857072 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-f2741d87-a720-43c8-b088-64d20310f68a admin admin] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:17:03.858232 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f2741d87-a720-43c8-b088-64d20310f68a admin admin] 10.222.0.57 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3083730 Dec 10 14:17:05.088807 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ac842de3-8ca6-464e-afd9-bffb15ba8f02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:06.100401 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:06.431307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51028) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:17:06.572224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Request body: {'network': {'is_default': True, 'admin_state_up': True, 'name': 'public', 'router:external': True, 'provider:network_type': 'flat', 'provider:physical_network': 'physnet1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:17:06.637647 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Made reservation on behalf of 997bf4861c6149dbbe5e91189f29735d for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:17:06.639978 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:06.648668 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:06.719741 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:06.791522 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:06.808533 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Reserving flat network on physical network physnet1 {{(pid=103811) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Dec 10 14:17:06.825304 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36871cd3-dcc8-4e1f-a4c9-c9cc0e6aaf3d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:06.829827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:06.830168 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Added segment 6785f633-8195-41aa-a37a-3ccc06131823 of type flat for network d3f722ee-cbe4-47a4-9a81-587513423c57 Dec 10 14:17:06.877831 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:06.951802 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:06.952698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:17:06.953298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:07.008512 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] Pushing event updated for resources: {'Network': ['ID=d3f722ee-cbe4-47a4-9a81-587513423c57,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:07.018253 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network d3f722ee-cbe4-47a4-9a81-587513423c57 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:17:07.057309 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-38ac9250-e679-4fb3-9e14-268f89536bbc admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6248002 Dec 10 14:17:07.443459 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:08.745802 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:09.476342 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51046) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:17:09.608071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c64831e7-9225-466a-9375-8aec18362aed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:17:09.609360 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c64831e7-9225-466a-9375-8aec18362aed admin admin] 10.222.0.57 "GET /v2.0/subnets/9c8c3321-80e1-4e17-bce6-dde0b7958814 HTTP/1.1" status: 200 len: 849 time: 0.1320434 Dec 10 14:17:09.782878 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dfd59e51-0821-40cb-b577-6a03d6780c8f admin admin] 10.222.0.57 "GET /v2.0/routers/e19596b8-7ed1-456b-844f-30c032953305 HTTP/1.1" status: 200 len: 704 time: 0.1669643 Dec 10 14:17:10.047504 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:10.335437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Allocated IP 172.20.0.1 (53d41211-17c9-4622-953d-52366ebc4713/9c8c3321-80e1-4e17-bce6-dde0b7958814/ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:17:10.516662 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:10.637985 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:10.710225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Network 53d41211-17c9-4622-953d-52366ebc4713 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:17:10.719047 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:17:10.727478 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:17:10.728366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:10.746705 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Pushing event updated for resources: {'Port': ['ID=ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:10.902877 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-1adc52af-aba6-490a-8af4-5c1116dd61c3 None None] Provisioning complete for port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:10.903406 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1adc52af-aba6-490a-8af4-5c1116dd61c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:10.936300 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1adc52af-aba6-490a-8af4-5c1116dd61c3 None None] Port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:17:11.021652 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:11.224199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:11.265860 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:11.266639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:11.342526 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Pushing event updated for resources: {'Port': ['ID=ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:11.390005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Network 53d41211-17c9-4622-953d-52366ebc4713 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:17:11.391354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:17:11.560277 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-913024fc-c40d-4077-b2c1-cb86ac6353ea None None] Provisioning complete for port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:11.563744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-913024fc-c40d-4077-b2c1-cb86ac6353ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:11.603372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Router e19596b8-7ed1-456b-844f-30c032953305 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:17:11.635608 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-913024fc-c40d-4077-b2c1-cb86ac6353ea None None] Port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:17:11.696636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:17:11.702391 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2fcd0e6d-fb00-418b-bd63-e6252b73c5e0 admin admin] 10.222.0.57 "PUT /v2.0/routers/e19596b8-7ed1-456b-844f-30c032953305/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9132519 Dec 10 14:17:11.706392 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Sync routers for ids ['e19596b8-7ed1-456b-844f-30c032953305'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:17:11.719713 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Routers {'e19596b8-7ed1-456b-844f-30c032953305'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:17:11.720542 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:17:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e19596b8-7ed1-456b-844f-30c032953305'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:17:11.914011 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Set router e19596b8-7ed1-456b-844f-30c032953305 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:17:12.336691 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e19596b8-7ed1-456b-844f-30c032953305', 'name': 'router1', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:17:00Z', 'updated_at': '2021-12-10T14:17:10Z', 'revision_number': 2, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'gw_port_host': None, '_interfaces': [{'id': 'ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573', 'name': '', 'network_id': '53d41211-17c9-4622-953d-52366ebc4713', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'mac_address': 'fa:16:3e:8a:6f:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e19596b8-7ed1-456b-844f-30c032953305', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:17:10Z', 'updated_at': '2021-12-10T14:17:11Z', 'revision_number': 2, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'subnets': [{'id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '4e6b11e1-83aa-4577-b279-558b77cb9d6d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:17:12.387358 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Checking router: e19596b8-7ed1-456b-844f-30c032953305 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:17:12.387725 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Updating router e19596b8-7ed1-456b-844f-30c032953305 port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:17:12.435419 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:12.956026 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:13.014400 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:13.107251 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Pushing event updated for resources: {'Port': ['ID=ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:13.138315 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.138675 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.139026 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.139369 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.139705 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.140039 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.140376 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.140710 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.141060 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.141410 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.141780 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.142108 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.142436 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Tracked resource versions report: Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: pushed versions: Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: { 'AddressGroup': {'1.2'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'ConntrackHelper': {'1.0'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'LocalIPAssociation': {'1.0'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Log': {'1.0'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Network': {'1.1'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Port': {'1.7'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'PortForwarding': {'1.2'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'QosPolicy': {'1.10'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SecurityGroup': {'1.5'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SecurityGroupRule': {'1.2'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SubPort': {'1.0'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Subnet': {'1.1'}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Trunk': {'1.1'}} Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: consumer versions: Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: { DHCP agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: L3 agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: Metadata agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: Metering agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: Open vSwitch agent@dv-neutron-821401-2-hyperv: { 'AddressGroup': '1.2', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'ConntrackHelper': '1.0', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'LocalIPAssociation': '1.0', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Log': '1.0', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Network': '1.1', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Port': '1.7', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'PortForwarding': '1.2', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'QosPolicy': '1.10', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SecurityGroup': '1.5', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SecurityGroupRule': '1.2', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SubPort': '1.0', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Subnet': '1.1', Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Trunk': '1.1'}} Dec 10 14:17:13.143871 dv-neutron-821401-2-hyperv neutron-server[103813]: {{(pid=103813) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 10 14:17:13.193472 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Attempting to bind port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:17:13.193881 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Attempting to bind port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '1b21895d-bd39-48d5-ac61-663153bcf158', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:17:13.194319 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Attempting to bind port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 on network 53d41211-17c9-4622-953d-52366ebc4713 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:17:13.199749 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 17, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:17:13.200171 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Checking segment: {'id': '1b21895d-bd39-48d5-ac61-663153bcf158', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:17:13.200648 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:13.201047 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Bound using segment: {'id': '1b21895d-bd39-48d5-ac61-663153bcf158', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:17:13.201603 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Bound port: ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1b21895d-bd39-48d5-ac61-663153bcf158', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '53d41211-17c9-4622-953d-52366ebc4713'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:17:13.202006 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:13.266003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c677c364-c7ed-4962-97bf-4bd75031e5ac None None] Provisioning complete for port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:13.266576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c677c364-c7ed-4962-97bf-4bd75031e5ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:13.271309 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] For port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:17:13.289915 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] For port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573,segment=NetworkSegment(1b21895d-bd39-48d5-ac61-663153bcf158),segment_id=1b21895d-bd39-48d5-ac61-663153bcf158)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:17:13.299433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c677c364-c7ed-4962-97bf-4bd75031e5ac None None] Port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:17:13.335262 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:13.393059 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Routers {'e19596b8-7ed1-456b-844f-30c032953305'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:17:13.393705 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:17:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e19596b8-7ed1-456b-844f-30c032953305'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:17:13.432571 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9b83f1-2179-4736-89db-109154e166ad None None] Pushing event updated for resources: {'Port': ['ID=ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:13.490147 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] Set router e19596b8-7ed1-456b-844f-30c032953305 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:17:13.620848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-845d8a87-a261-49a4-8064-bf779bcedb15 None None] Provisioning complete for port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:13.621386 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-845d8a87-a261-49a4-8064-bf779bcedb15 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:13.701438 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e19596b8-7ed1-456b-844f-30c032953305', 'name': 'router1', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:17:00Z', 'updated_at': '2021-12-10T14:17:10Z', 'revision_number': 2, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'gw_port_host': None, '_interfaces': [{'id': 'ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573', 'name': '', 'network_id': '53d41211-17c9-4622-953d-52366ebc4713', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'mac_address': 'fa:16:3e:8a:6f:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e19596b8-7ed1-456b-844f-30c032953305', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:17:10Z', 'updated_at': '2021-12-10T14:17:13Z', 'revision_number': 4, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'subnets': [{'id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '4e6b11e1-83aa-4577-b279-558b77cb9d6d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:17:13.703717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-845d8a87-a261-49a4-8064-bf779bcedb15 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:13.731840 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e9f97b4-6d87-422f-a351-3de2ea7e3a6a None None] The sync data for ids ['e19596b8-7ed1-456b-844f-30c032953305'] in dv-neutron-821401-2-hyperv is: [{'id': 'e19596b8-7ed1-456b-844f-30c032953305', 'name': 'router1', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:17:00Z', 'updated_at': '2021-12-10T14:17:10Z', 'revision_number': 2, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'gw_port_host': None, '_interfaces': [{'id': 'ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573', 'name': '', 'network_id': '53d41211-17c9-4622-953d-52366ebc4713', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'mac_address': 'fa:16:3e:8a:6f:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e19596b8-7ed1-456b-844f-30c032953305', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:17:10Z', 'updated_at': '2021-12-10T14:17:13Z', 'revision_number': 4, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'subnets': [{'id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '4e6b11e1-83aa-4577-b279-558b77cb9d6d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:17:13.736320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-845d8a87-a261-49a4-8064-bf779bcedb15 None None] For port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573,segment=NetworkSegment(1b21895d-bd39-48d5-ac61-663153bcf158),segment_id=1b21895d-bd39-48d5-ac61-663153bcf158)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:17:13.791819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-845d8a87-a261-49a4-8064-bf779bcedb15 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:13.841745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-845d8a87-a261-49a4-8064-bf779bcedb15 None None] Pushing event updated for resources: {'Port': ['ID=ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:14.152488 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51056) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:17:14.260625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e97f3ec-8b5f-4f43-9730-afeb2d10367f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:17:14.262027 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0e97f3ec-8b5f-4f43-9730-afeb2d10367f admin admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 842 time: 0.1085587 Dec 10 14:17:14.272479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Request body: {'subnet': {'gateway_ip': '172.26.2.1', 'enable_dhcp': False, 'cidr': '172.26.2.0/24', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'ip_version': 4, 'name': 'public-subnet'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:17:14.363145 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Made reservation on behalf of 997bf4861c6149dbbe5e91189f29735d for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:17:14.365463 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:14.722356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:17:14.722809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:14.777811 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0a301be8-98a1-419e-a7a8-56be819ae1b9,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:14.786590 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:17:14.786840 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Network hostable DHCP agents. Network: d3f722ee-cbe4-47a4-9a81-587513423c57, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:17:14.883115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:17:14.980585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, d3f722ee-cbe4-47a4-9a81-587513423c57) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:17:14.985047 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:17:14.985698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:14.990340 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bb893e3-85cb-46a7-9c16-c211de4b5304 None None] Network d3f722ee-cbe4-47a4-9a81-587513423c57 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:17:15.069292 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-87467d8d-e7fb-4ac0-9628-fef889edb153 admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8001497 Dec 10 14:17:15.097945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af7e00e4-2d03-4e34-9174-af76bab7901f None None] Network d3f722ee-cbe4-47a4-9a81-587513423c57 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:17:17.558752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51064) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:17:17.697134 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-870a75ca-8fbb-40eb-b26a-039d4bb23792 admin admin] 10.222.0.57 "GET /v2.0/routers/e19596b8-7ed1-456b-844f-30c032953305 HTTP/1.1" status: 200 len: 710 time: 0.1372344 Dec 10 14:17:17.783141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72ba2666-1008-4fb7-8bb6-470abc84528e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:17:17.784744 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-72ba2666-1008-4fb7-8bb6-470abc84528e admin admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 886 time: 0.0818300 Dec 10 14:17:17.794328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:17:18.104102 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:18.402614 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:18.478526 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:18.618002 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Allocated IP 172.26.2.224 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/d40064eb-9d6a-4b06-a016-b2dfb0b21ba2) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:17:18.718894 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:18.820186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:18.861853 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:17:18.868140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:17:18.869934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:17:18.873183 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Pushing event updated for resources: {'Port': ['ID=d40064eb-9d6a-4b06-a016-b2dfb0b21ba2,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:19.172033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:19.373548 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:19.377030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:19.485462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Router e19596b8-7ed1-456b-844f-30c032953305 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:17:19.669476 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:17:19.673671 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:19.674784 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2a65be84-689d-4efc-a864-de3462b56443 admin admin] 10.222.0.57 "PUT /v2.0/routers/e19596b8-7ed1-456b-844f-30c032953305 HTTP/1.1" status: 200 len: 890 time: 1.8836195 Dec 10 14:17:20.493402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:17:20.543907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:20.544194 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:20.765013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Sync routers for ids ['e19596b8-7ed1-456b-844f-30c032953305'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:17:20.776819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Routers {'e19596b8-7ed1-456b-844f-30c032953305'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:17:20.777179 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:17:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e19596b8-7ed1-456b-844f-30c032953305'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:17:20.987624 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Set router e19596b8-7ed1-456b-844f-30c032953305 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:17:21.374570 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e19596b8-7ed1-456b-844f-30c032953305', 'name': 'router1', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.224'}], 'enable_snat': True}, 'gw_port_id': 'd40064eb-9d6a-4b06-a016-b2dfb0b21ba2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:17:00Z', 'updated_at': '2021-12-10T14:17:18Z', 'revision_number': 4, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'gw_port': {'id': 'd40064eb-9d6a-4b06-a016-b2dfb0b21ba2', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:3c:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e19596b8-7ed1-456b-844f-30c032953305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:17:18Z', 'updated_at': '2021-12-10T14:17:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573', 'name': '', 'network_id': '53d41211-17c9-4622-953d-52366ebc4713', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'mac_address': 'fa:16:3e:8a:6f:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e19596b8-7ed1-456b-844f-30c032953305', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:17:10Z', 'updated_at': '2021-12-10T14:17:13Z', 'revision_number': 5, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'subnets': [{'id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '4e6b11e1-83aa-4577-b279-558b77cb9d6d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:17:21.493169 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Checking router: e19596b8-7ed1-456b-844f-30c032953305 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:17:21.493557 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Updating router e19596b8-7ed1-456b-844f-30c032953305 port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:17:21.539244 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:21.897008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:21.968760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:22.021843 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7780c05-e3d1-4a9f-a9e5-e9158b07727c None None] Pushing event updated for resources: {'Port': ['ID=d40064eb-9d6a-4b06-a016-b2dfb0b21ba2,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:22.024076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Attempting to bind port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:17:22.024437 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Attempting to bind port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:17:22.024793 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Attempting to bind port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:17:22.030102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 17, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:17:22.030474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:17:22.030868 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:22.031255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:17:22.031712 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Bound port: d40064eb-9d6a-4b06-a016-b2dfb0b21ba2, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:17:22.032104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:22.081084 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] For port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:17:22.084610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] For port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d40064eb-9d6a-4b06-a016-b2dfb0b21ba2,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:17:22.146473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:22.210423 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Routers {'e19596b8-7ed1-456b-844f-30c032953305'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:17:22.211061 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:17:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e19596b8-7ed1-456b-844f-30c032953305'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:17:22.213961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7780c05-e3d1-4a9f-a9e5-e9158b07727c None None] Pushing event updated for resources: {'Port': ['ID=d40064eb-9d6a-4b06-a016-b2dfb0b21ba2,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:22.255086 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51076) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:17:22.324437 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] Set router e19596b8-7ed1-456b-844f-30c032953305 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:17:22.369202 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-58fc1857-0048-4919-a4ce-8cbd0d088d87 admin admin] 10.222.0.57 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1129856 Dec 10 14:17:22.543023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e19596b8-7ed1-456b-844f-30c032953305', 'name': 'router1', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.224'}], 'enable_snat': True}, 'gw_port_id': 'd40064eb-9d6a-4b06-a016-b2dfb0b21ba2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:17:00Z', 'updated_at': '2021-12-10T14:17:18Z', 'revision_number': 4, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'gw_port': {'id': 'd40064eb-9d6a-4b06-a016-b2dfb0b21ba2', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:3c:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e19596b8-7ed1-456b-844f-30c032953305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:17:18Z', 'updated_at': '2021-12-10T14:17:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573', 'name': '', 'network_id': '53d41211-17c9-4622-953d-52366ebc4713', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'mac_address': 'fa:16:3e:8a:6f:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e19596b8-7ed1-456b-844f-30c032953305', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:17:10Z', 'updated_at': '2021-12-10T14:17:13Z', 'revision_number': 5, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'subnets': [{'id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '4e6b11e1-83aa-4577-b279-558b77cb9d6d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:17:22.575944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f652165-9db4-4b3a-a599-8d0b022f646a None None] The sync data for ids ['e19596b8-7ed1-456b-844f-30c032953305'] in dv-neutron-821401-2-hyperv is: [{'id': 'e19596b8-7ed1-456b-844f-30c032953305', 'name': 'router1', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.224'}], 'enable_snat': True}, 'gw_port_id': 'd40064eb-9d6a-4b06-a016-b2dfb0b21ba2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:17:00Z', 'updated_at': '2021-12-10T14:17:18Z', 'revision_number': 4, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'gw_port': {'id': 'd40064eb-9d6a-4b06-a016-b2dfb0b21ba2', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:3c:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e19596b8-7ed1-456b-844f-30c032953305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:17:18Z', 'updated_at': '2021-12-10T14:17:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573', 'name': '', 'network_id': '53d41211-17c9-4622-953d-52366ebc4713', 'tenant_id': '0d94dc3116a446c6a105a1a503ec3fad', 'mac_address': 'fa:16:3e:8a:6f:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e19596b8-7ed1-456b-844f-30c032953305', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:17:10Z', 'updated_at': '2021-12-10T14:17:13Z', 'revision_number': 5, 'project_id': '0d94dc3116a446c6a105a1a503ec3fad', 'subnets': [{'id': '9c8c3321-80e1-4e17-bce6-dde0b7958814', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '4e6b11e1-83aa-4577-b279-558b77cb9d6d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:17:24.518571 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d40064eb-9d6a-4b06-a016-b2dfb0b21ba2 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:17:24.581895 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:24.582274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:24.665171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:24.687301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d40064eb-9d6a-4b06-a016-b2dfb0b21ba2,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:17:24.758913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:24.822448 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=d40064eb-9d6a-4b06-a016-b2dfb0b21ba2,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:17:26.509255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d40064eb-9d6a-4b06-a016-b2dfb0b21ba2 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:17:26.586893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:17:26.587427 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:32.814302 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70040e7a-bcee-4923-aba9-abafcecfec74 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:35.071299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c5f073fc-0efd-4ea2-a518-ee28a1e22293 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:36.094102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:36.868828 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 5 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:17:37.499614 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:17:38.769146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:02.864705 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a5ebe011-403f-4397-a7e8-55dac91a40f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:05.087357 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9dda6274-d45a-429f-91de-f6fcdef759a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:06.116812 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:07.476639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:08.826314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:13.868153 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 5 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:18:32.823693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-303503f0-fb53-431f-bac2-41f5f2ef7349 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:35.098120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4ee2792-e59e-4e90-9cfc-538959fc61da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:36.170984 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:37.469779 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:38.724629 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:50.095991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51592) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:18:50.156235 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-42c1809b-4ca5-4cad-af35-73c435faf362 admin admin] GET failed (client error): The resource could not be found. Dec 10 14:18:50.157540 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-42c1809b-4ca5-4cad-af35-73c435faf362 admin admin] 10.222.0.57 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0605733 Dec 10 14:18:50.316992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b6e161d-810e-4156-8661-3f79a7515245 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:18:50.318413 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8b6e161d-810e-4156-8661-3f79a7515245 admin admin] 10.222.0.57 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1563218 Dec 10 14:18:50.869317 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 5 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:18:52.718014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51602) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:18:52.817677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-311179d0-ba4f-4d76-bcbc-27e600c11d7c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:18:52.819031 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-311179d0-ba4f-4d76-bcbc-27e600c11d7c admin admin] 10.222.0.57 "GET /v2.0/subnets/9c8c3321-80e1-4e17-bce6-dde0b7958814 HTTP/1.1" status: 200 len: 849 time: 0.1000345 Dec 10 14:18:52.830235 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:18:52.912559 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Publish callbacks [] for subnet, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:53.106572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8745562688988'] for subnet, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:53.135690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:18:53.136466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:53.137789 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] 10.222.0.57 "PUT /v2.0/subnets/9c8c3321-80e1-4e17-bce6-dde0b7958814 HTTP/1.1" status: 200 len: 868 time: 0.3122737 Dec 10 14:18:53.144641 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdcbe561-3e91-4793-bbbe-7360fe2ba9be None None] Network 53d41211-17c9-4622-953d-52366ebc4713 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:18:53.165127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9c8c3321-80e1-4e17-bce6-dde0b7958814,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:18:53.173566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.173930 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.174266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.174748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.175088 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.175416 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.175743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.176068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.176460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.176774 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.177096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.177445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.177751 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c96e379-a2db-4913-b192-02555ce875d3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:18:53.465592 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b8aacb02-27b8-4249-bc38-c70980ac10ba None None] Provisioning complete for port 060aa4c2-4d44-401c-bb3c-650c9d9ec3de triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:18:53.465969 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b8aacb02-27b8-4249-bc38-c70980ac10ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:53.555610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b8aacb02-27b8-4249-bc38-c70980ac10ba None None] Provisioning complete for port ffb8cc4e-a822-4412-a8f9-5b8bb6a1c573 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:18:53.555893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b8aacb02-27b8-4249-bc38-c70980ac10ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:18:55.527491 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51610) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:18:55.728470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3279f9e-9b34-4c82-9a41-33fc18752654 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:18:55.728937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3279f9e-9b34-4c82-9a41-33fc18752654 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:18:55.730486 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e3279f9e-9b34-4c82-9a41-33fc18752654 admin admin] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2020285 Dec 10 14:18:58.092701 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51618) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:18:58.226027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49a06653-2722-4baf-80b1-1eedc21aa5a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:18:58.226498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49a06653-2722-4baf-80b1-1eedc21aa5a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:18:58.228038 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-49a06653-2722-4baf-80b1-1eedc21aa5a0 admin admin] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1343539 Dec 10 14:19:00.602961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51626) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:00.731883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75050f7e-3d46-43bb-9178-8a69cbe6a5ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:00.733243 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-75050f7e-3d46-43bb-9178-8a69cbe6a5ec admin admin] 10.222.0.57 "GET /v2.0/networks/53d41211-17c9-4622-953d-52366ebc4713 HTTP/1.1" status: 200 len: 869 time: 0.1293755 Dec 10 14:19:02.826612 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-78806a88-ab08-4250-938f-16651f5abf5b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:03.073606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51634) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:03.197567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99c7af30-e60b-461f-af79-8d2335da35c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:03.198947 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-99c7af30-e60b-461f-af79-8d2335da35c1 admin admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 886 time: 0.1243560 Dec 10 14:19:05.074383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-adfb6ccd-be78-4989-b21b-79bbbb0fb95b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:05.563615 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 51642) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:05.706099 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91bd307c-0c72-4aa3-a4ef-00ce82c32395 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:05.706547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91bd307c-0c72-4aa3-a4ef-00ce82c32395 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:05.708094 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-91bd307c-0c72-4aa3-a4ef-00ce82c32395 admin admin] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1435328 Dec 10 14:19:06.123329 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:07.489012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:08.087782 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 51652) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:08.179069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ef7b0cd-1091-43eb-8d03-e4f646c6741c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:08.179769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ef7b0cd-1091-43eb-8d03-e4f646c6741c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:08.181269 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9ef7b0cd-1091-43eb-8d03-e4f646c6741c admin admin] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0925360 Dec 10 14:19:08.725894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:10.554594 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 51660) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:10.640262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d28499f9-d836-45ca-985c-b9b9798a7ef1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:10.641648 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d28499f9-d836-45ca-985c-b9b9798a7ef1 admin admin] 10.222.0.57 "GET /v2.0/subnets/0a301be8-98a1-419e-a7a8-56be819ae1b9 HTTP/1.1" status: 200 len: 816 time: 0.0861003 Dec 10 14:19:13.020298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51668) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:13.112759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16f47e78-f865-4038-b4a0-4a4e8f7bdf1d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:13.114123 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-16f47e78-f865-4038-b4a0-4a4e8f7bdf1d admin admin] 10.222.0.57 "GET /v2.0/subnets/9c8c3321-80e1-4e17-bce6-dde0b7958814 HTTP/1.1" status: 200 len: 868 time: 0.0928795 Dec 10 14:19:27.868040 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 5 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:19:32.848463 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5a978b66-0fbe-446c-8df6-ae1be13eed1c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:35.079748 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a87f190a-c495-464f-afec-89d39692b041 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:36.119860 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:37.479511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:38.464216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 51722) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:38.511430 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-2a128530-b824-4d17-85f8-f919e2e02527 admin admin] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:19:38.512431 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2a128530-b824-4d17-85f8-f919e2e02527 admin admin] 10.222.0.57 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0472722 Dec 10 14:19:38.739260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:41.023122 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51730) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:41.082728 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-df11734d-95a3-4fcb-8464-c093204dd63e admin admin] GET failed (client error): The resource could not be found. Dec 10 14:19:41.083998 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-df11734d-95a3-4fcb-8464-c093204dd63e admin admin] 10.222.0.57 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0599396 Dec 10 14:19:41.170650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a98a985e-dce2-4c37-8e2a-e2083d6adf6d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:41.172168 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a98a985e-dce2-4c37-8e2a-e2083d6adf6d admin admin] 10.222.0.57 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0836091 Dec 10 14:19:43.569684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51738) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:43.616160 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:19:43.724688 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Made reservation on behalf of 997bf4861c6149dbbe5e91189f29735d for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:19:43.726962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:43.754958 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.services.revisions.revision_plugin [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Could not find related network for resource to bump revision. Dec 10 14:19:43.765285 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] vlan segment allocate from pool success with {'vlan_id': 394, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:19:43.773532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:43.774971 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Added segment a2596c3a-0899-41f0-bb1f-fb5ad0e587a3 of type vlan for network 451c62e4-c5cd-4def-a9e4-dc9a77a86dd1 Dec 10 14:19:43.814464 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:43.941901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:43.942830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:43.943405 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:43.999027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] Pushing event updated for resources: {'Network': ['ID=451c62e4-c5cd-4def-a9e4-dc9a77a86dd1,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:19:44.009111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 451c62e4-c5cd-4def-a9e4-dc9a77a86dd1 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:19:44.173949 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c5ddd975-4137-4871-b22c-75d7e41ebba5 admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6031489 Dec 10 14:19:46.572470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51746) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:19:46.632129 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-0547b53e-756f-4a94-8d7c-6490c843abaa admin admin] GET failed (client error): The resource could not be found. Dec 10 14:19:46.633370 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0547b53e-756f-4a94-8d7c-6490c843abaa admin admin] 10.222.0.57 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0599449 Dec 10 14:19:46.703965 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ba9d57d-163c-4060-8cef-af72d851c244 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:46.705339 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6ba9d57d-163c-4060-8cef-af72d851c244 admin admin] 10.222.0.57 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0662694 Dec 10 14:19:46.715287 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Request body: {'subnet': {'description': 'shared-subnet', 'name': 'shared-subnet', 'cidr': '192.168.233.0/24', 'ip_version': 4, 'network_id': '451c62e4-c5cd-4def-a9e4-dc9a77a86dd1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:19:46.841642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Made reservation on behalf of 997bf4861c6149dbbe5e91189f29735d for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:19:46.843768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:47.142539 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:47.190929 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cad32b17-833c-4d2a-86ca-6997d2b229ab,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:19:47.205721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Checking segment: {'id': 'a2596c3a-0899-41f0-bb1f-fb5ad0e587a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '451c62e4-c5cd-4def-a9e4-dc9a77a86dd1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:19:47.206074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Network hostable DHCP agents. Network: 451c62e4-c5cd-4def-a9e4-dc9a77a86dd1, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:19:47.313368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Network 451c62e4-c5cd-4def-a9e4-dc9a77a86dd1 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:19:47.390070 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 451c62e4-c5cd-4def-a9e4-dc9a77a86dd1) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:19:47.394117 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:19:47.394654 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:47.399334 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2676144b-5bf6-4658-adb6-de17d3ca548a None None] Network 451c62e4-c5cd-4def-a9e4-dc9a77a86dd1 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:19:47.487794 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9f4820ee-2cc9-4f8b-991e-fd7c207eb429 admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7758524 Dec 10 14:19:47.511225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-451c62e4-c5cd-4def-a9e4-dc9a77a86dd1', 'network_id': '451c62e4-c5cd-4def-a9e4-dc9a77a86dd1', 'project_id': '997bf4861c6149dbbe5e91189f29735d', 'fixed_ips': [{'subnet_id': 'cad32b17-833c-4d2a-86ca-6997d2b229ab'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:19:47.512159 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:47.656731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Allocated IP 192.168.233.2 (451c62e4-c5cd-4def-a9e4-dc9a77a86dd1/cad32b17-833c-4d2a-86ca-6997d2b229ab/5176a588-7c04-42fa-8016-e0e7ed8e6040) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:19:47.799730 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:47.902587 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:47.945986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Network 451c62e4-c5cd-4def-a9e4-dc9a77a86dd1 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:19:47.948890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:19:47.951500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:19:47.958572 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Pushing event updated for resources: {'Port': ['ID=5176a588-7c04-42fa-8016-e0e7ed8e6040,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:19:47.969129 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.969514 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.969858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.970193 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.970520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.970846 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.971185 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.971510 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.971882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.972225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.972549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.972861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:47.973173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:19:48.118879 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Attempting to bind port 5176a588-7c04-42fa-8016-e0e7ed8e6040 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:19:48.119246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Attempting to bind port 5176a588-7c04-42fa-8016-e0e7ed8e6040 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'a2596c3a-0899-41f0-bb1f-fb5ad0e587a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '451c62e4-c5cd-4def-a9e4-dc9a77a86dd1'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:19:48.119605 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Attempting to bind port 5176a588-7c04-42fa-8016-e0e7ed8e6040 on network 451c62e4-c5cd-4def-a9e4-dc9a77a86dd1 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:19:48.125383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 19, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:19:48.125781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Checking segment: {'id': 'a2596c3a-0899-41f0-bb1f-fb5ad0e587a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '451c62e4-c5cd-4def-a9e4-dc9a77a86dd1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:19:48.126180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:48.126574 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Bound using segment: {'id': 'a2596c3a-0899-41f0-bb1f-fb5ad0e587a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '451c62e4-c5cd-4def-a9e4-dc9a77a86dd1'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:19:48.127038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Bound port: 5176a588-7c04-42fa-8016-e0e7ed8e6040, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a2596c3a-0899-41f0-bb1f-fb5ad0e587a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '451c62e4-c5cd-4def-a9e4-dc9a77a86dd1'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:19:48.127432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:48.188601 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] For port 5176a588-7c04-42fa-8016-e0e7ed8e6040, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:19:48.191151 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] For port 5176a588-7c04-42fa-8016-e0e7ed8e6040, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5176a588-7c04-42fa-8016-e0e7ed8e6040,segment=NetworkSegment(a2596c3a-0899-41f0-bb1f-fb5ad0e587a3),segment_id=a2596c3a-0899-41f0-bb1f-fb5ad0e587a3)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:19:48.264907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:48.323642 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cbffddc-ee7b-4add-8c6b-4b054d649385 None None] Pushing event updated for resources: {'Port': ['ID=5176a588-7c04-42fa-8016-e0e7ed8e6040,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:19:48.656226 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5176a588-7c04-42fa-8016-e0e7ed8e6040 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:19:48.710067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 5176a588-7c04-42fa-8016-e0e7ed8e6040 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:19:48.710434 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:48.790819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:48.826102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 5176a588-7c04-42fa-8016-e0e7ed8e6040, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5176a588-7c04-42fa-8016-e0e7ed8e6040,segment=NetworkSegment(a2596c3a-0899-41f0-bb1f-fb5ad0e587a3),segment_id=a2596c3a-0899-41f0-bb1f-fb5ad0e587a3)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:19:48.910583 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:48.973276 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=5176a588-7c04-42fa-8016-e0e7ed8e6040,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:19:49.182412 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e74f0b74-e802-47bd-8bfc-d71422af51d1 None None] Network 451c62e4-c5cd-4def-a9e4-dc9a77a86dd1 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:19:49.294913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-306f3a43-5780-4a9f-b315-3615c4996ae3 None None] Provisioning complete for port 5176a588-7c04-42fa-8016-e0e7ed8e6040 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:19:49.295524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-306f3a43-5780-4a9f-b315-3615c4996ae3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:49.708962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ef21003d-52a3-4a73-9b42-9f3c0a3a2d29 None None] Provisioning complete for port 5176a588-7c04-42fa-8016-e0e7ed8e6040 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:19:49.709665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ef21003d-52a3-4a73-9b42-9f3c0a3a2d29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:19:50.565132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5176a588-7c04-42fa-8016-e0e7ed8e6040 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:19:50.613823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 5176a588-7c04-42fa-8016-e0e7ed8e6040 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:19:50.614110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:02.852400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7b95aae-673b-4ad5-8e8b-18c6cbcfbabc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:04.866740 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 5 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:20:05.069896 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a92a89b7-676b-42b4-baac-a14e05df84b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:06.189493 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:07.484225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:08.766564 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:32.857564 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e8a75b24-ac27-4672-afec-45d7ec2ae6fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:35.074062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2d148d69-4b28-44ec-82b9-4b7deee14e14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:36.152629 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:37.513775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:38.770882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:20:41.866524 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 5 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:21:02.855391 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-31a66e97-5ebe-4e43-a955-0cca458c3374 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:05.089971 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-38d575c0-8e35-4ade-8733-bc330ff3e09e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:06.112082 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:07.488688 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:08.740894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:14.687624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 51790) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:21:14.693408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-66e3d733-8853-45a4-8484-9e0599378187 tempest-verify_tempest_config-170332316 tempest-verify_tempest_config-170332316-project] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:21:14.694426 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-66e3d733-8853-45a4-8484-9e0599378187 tempest-verify_tempest_config-170332316 tempest-verify_tempest_config-170332316-project] 10.222.0.57 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0058656 Dec 10 14:21:15.224262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51808) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:21:15.327187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:15.397718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:15.471790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:15.519544 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=8dd9c91397d646f98d7486b83f3c37b3&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2941833 Dec 10 14:21:15.520380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb043328-4d8e-48e4-8201-ee39cb35e224,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:21:15.522207 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 51814) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:21:15.527107 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.527475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.527821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.528157 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.528606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.528942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.529262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.529630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.529971 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.530300 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.530624 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.530945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.531263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ab8d9a0-e85f-4df5-9092-0f200ce9780e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.601083 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:15.621733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:15.768851 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:15.771441 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:15.772661 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/eb043328-4d8e-48e4-8201-ee39cb35e224 HTTP/1.1" status: 204 len: 168 time: 0.2493143 Dec 10 14:21:15.780433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb043328-4d8e-48e4-8201-ee39cb35e224,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:21:15.787038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.787397 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.787744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.788069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.788402 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.788731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.789068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.789468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.789788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.790184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.790399 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.790719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:15.791115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc7e8f46-169b-4cac-b4ba-8e0e344c43f4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:21:18.864294 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 5 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:21:32.842711 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-37e46cce-919e-4d29-9710-8bf2d1dc1611 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:35.076810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9dfa5109-009e-4e60-803a-40be38c1bd6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:36.133951 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:37.471189 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:38.722142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:21:55.862979 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 5 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:22:02.841970 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f333aaa4-d593-4b86-8ab0-6081fc5f984c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:05.070247 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-961d4903-e1ba-4272-8d75-1f24e7c6be8f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:06.132214 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:07.504044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:08.726775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:31.000138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-552189'] for agent, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:32.829732 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cdf58936-e7d8-4169-b3b9-bd775cc954ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:32.862212 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:22:35.063382 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5954e734-d36f-40f3-a3b5-28f904360725 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:36.137756 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:37.491728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:38.732033 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:22:45.788921 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 51884) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:22:45.889835 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5c8ab533-bb04-4300-bbd0-7c4dace15f2d admin admin] 10.222.0.57 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.0997579 Dec 10 14:22:48.249536 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 51894) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:22:48.310555 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-54fb2b6c-812e-4595-8f32-baf68e56b5a3 admin admin] 10.222.0.57 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.0598981 Dec 10 14:23:00.958390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:02.867188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e129b296-0488-48d5-bb3e-9785ce861c7d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:05.078696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2bcf96db-e9bf-4108-a3a7-e1dbb89ac5b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:06.158217 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:07.512691 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:08.725370 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:09.862141 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:23:30.953126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:32.844574 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e52384ac-3412-44db-aa80-2cbb744525c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:35.078732 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d16e76f8-b74b-4a16-86f0-70473c60b40d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:36.147316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:37.517725 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:38.752713 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:23:46.860953 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:24:00.952432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:01.536908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52024) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:01.839377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-545692020-network', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:01.927534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Made reservation on behalf of 5f6602a0e1ae4bc9b52f0259e63b6e7a for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:01.929909 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:01.939569 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.014191 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.078467 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.104556 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] vlan segment allocate from pool success with {'vlan_id': 389, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:02.115377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a43dab61-8dc1-4dde-b5f4-df32084521ea,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:02.123883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.124231 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Added segment 1af6b7ee-efdc-44ed-822a-b8fd8a223e56 of type vlan for network 1cc2d855-81bd-4d95-a565-455c7130be80 Dec 10 14:24:02.126683 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.127050 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.127386 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.127721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.128052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.128418 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.128765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.129088 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.129438 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.129933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.130258 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.130579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.130988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Tracked resource versions report: Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: pushed versions: Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: { 'AddressGroup': {'1.2'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'ConntrackHelper': {'1.0'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'LocalIPAssociation': {'1.0'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Log': {'1.0'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Network': {'1.1'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Port': {'1.7'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'PortForwarding': {'1.2'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'QosPolicy': {'1.10'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SecurityGroup': {'1.5'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SecurityGroupRule': {'1.2'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SubPort': {'1.0'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Subnet': {'1.1'}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Trunk': {'1.1'}} Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: consumer versions: Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: { DHCP agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: HyperV agent@hv-neutron-8214: {}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: L3 agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: Metadata agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: Metering agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: Open vSwitch agent@dv-neutron-821401-2-hyperv: { 'AddressGroup': '1.2', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'ConntrackHelper': '1.0', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'LocalIPAssociation': '1.0', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Log': '1.0', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Network': '1.1', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Port': '1.7', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'PortForwarding': '1.2', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'QosPolicy': '1.10', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SecurityGroup': '1.5', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SecurityGroupRule': '1.2', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'SubPort': '1.0', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Subnet': '1.1', Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: 'Trunk': '1.1'}} Dec 10 14:24:02.132055 dv-neutron-821401-2-hyperv neutron-server[103811]: {{(pid=103811) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 10 14:24:02.180850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.276147 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.277100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:02.277708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.346818 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] Pushing event updated for resources: {'Network': ['ID=1cc2d855-81bd-4d95-a565-455c7130be80,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:02.357280 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 1cc2d855-81bd-4d95-a565-455c7130be80 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:02.423460 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-250c2529-eac0-413e-885f-c887b91ac368 admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.8853896 Dec 10 14:24:02.425787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52072) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:02.430768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Request body: {'subnet': {'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-545692020-subnet', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:02.488777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52074) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:02.547346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Made reservation on behalf of 5f6602a0e1ae4bc9b52f0259e63b6e7a for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:02.551396 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.570954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52080) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:02.804407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.855985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ba6b9843-d43a-4c3e-9f30-2c077d7303ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:02.870070 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Pushing event updated for resources: {'Subnet': ['ID=630f1e53-2aa8-4b5b-8620-d9290269bc74,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:02.877885 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Checking segment: {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:02.878596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Network hostable DHCP agents. Network: 1cc2d855-81bd-4d95-a565-455c7130be80, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:24:02.933698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Request body: {'network': {'name': 'tempest-ServersTestManualDisk-1991717068-network', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:02.950415 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-1676129679-network', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:02.953752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Network 1cc2d855-81bd-4d95-a565-455c7130be80 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:24:03.003833 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Made reservation on behalf of af5207bd54c6403799a8cc223fa0ea80 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:03.006187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.014885 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.035079 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 1cc2d855-81bd-4d95-a565-455c7130be80) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:03.041384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:03.045273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.049050 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9dcc9d0b-775e-4a5b-92ad-a26672da1d63 None None] Network 1cc2d855-81bd-4d95-a565-455c7130be80 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:03.095812 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Made reservation on behalf of 8f11a2c4cb6b474d81f884b20c96a97b for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:03.098106 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.104371 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.112659 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.179692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-1cc2d855-81bd-4d95-a565-455c7130be80', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:24:03.181178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.198598 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f17e2a71-d693-4feb-80f8-6e401361cb32 admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7715657 Dec 10 14:24:03.204102 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52100) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:03.209321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:03.209794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.225062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.243832 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] vlan segment allocate from pool success with {'vlan_id': 371, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:03.269542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.269957 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Added segment 9f890aad-2e77-4afa-a708-065638c55845 of type vlan for network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 Dec 10 14:24:03.279469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9e21142-577f-4b62-9a60-709b4b2f57e7,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:03.290063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.317082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] vlan segment allocate from pool success with {'vlan_id': 353, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:03.325010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.349254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Allocated IP 172.20.0.2 (1cc2d855-81bd-4d95-a565-455c7130be80/630f1e53-2aa8-4b5b-8620-d9290269bc74/37236f76-568d-45f5-8305-f465552d6622) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:03.353210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.353896 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8745562671225', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.354466 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Unsubscribe: segment precommit_create {{(pid=103810) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 10 14:24:03.354584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.354978 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Added segment 6d1241a1-dea0-4f8f-8e5e-03b341b37387 of type vlan for network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 Dec 10 14:24:03.425045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.434237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.435778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:03.436364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.468020 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b210820b-78f8-47c3-816b-1b7cecf0d826,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:03.478907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.479264 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.479542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.479656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.479987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.480322 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.480649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.480973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.481299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.481837 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.482163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.482571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.483107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.483426 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Tracked resource versions report: Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: pushed versions: Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: { 'AddressGroup': {'1.2'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'ConntrackHelper': {'1.0'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'LocalIPAssociation': {'1.0'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Log': {'1.0'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Network': {'1.1'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Port': {'1.7'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'PortForwarding': {'1.2'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'QosPolicy': {'1.10'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SecurityGroup': {'1.5'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SecurityGroupRule': {'1.2'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SubPort': {'1.0'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Subnet': {'1.1'}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Trunk': {'1.1'}} Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: consumer versions: Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: { DHCP agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: HyperV agent@hv-neutron-8214: {}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: L3 agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: Metadata agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: Metering agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: Open vSwitch agent@dv-neutron-821401-2-hyperv: { 'AddressGroup': '1.2', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'ConntrackHelper': '1.0', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'LocalIPAssociation': '1.0', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Log': '1.0', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Network': '1.1', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Port': '1.7', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'PortForwarding': '1.2', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'QosPolicy': '1.10', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SecurityGroup': '1.5', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SecurityGroupRule': '1.2', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'SubPort': '1.0', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Subnet': '1.1', Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: 'Trunk': '1.1'}} Dec 10 14:24:03.484783 dv-neutron-821401-2-hyperv neutron-server[103810]: {{(pid=103810) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 10 14:24:03.530429 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.535301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] Pushing event updated for resources: {'Network': ['ID=8a88c7d6-baa3-4bff-a8db-78e7aa6fb066,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:03.544935 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:03.619136 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.620695 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:03.621342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.654204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.695839 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0a2597f6-53f6-42a7-92d1-0a20705f94fe admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.2058315 Dec 10 14:24:03.697727 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52112) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:03.719877 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Network 1cc2d855-81bd-4d95-a565-455c7130be80 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:03.724535 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] Pushing event updated for resources: {'Network': ['ID=90ab95ca-b6c7-4d4c-8815-86eb5dad26d0,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:03.732921 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:03.735675 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:03.739803 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Request body: {'subnet': {'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestManualDisk-1991717068-subnet', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:03.744256 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:03.754808 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Pushing event updated for resources: {'Port': ['ID=37236f76-568d-45f5-8305-f465552d6622,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:03.774240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.774607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.774954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.775287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.775614 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.775937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.776274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.776599 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.776930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.777280 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.777604 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.777918 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.778233 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Tracked resource versions report: Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: pushed versions: Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: { 'AddressGroup': {'1.2'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'ConntrackHelper': {'1.0'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'LocalIPAssociation': {'1.0'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Log': {'1.0'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Network': {'1.1'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Port': {'1.7'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'PortForwarding': {'1.2'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'QosPolicy': {'1.10'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SecurityGroup': {'1.5'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SecurityGroupRule': {'1.2'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SubPort': {'1.0'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Subnet': {'1.1'}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Trunk': {'1.1'}} Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: consumer versions: Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: { DHCP agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: HyperV agent@hv-neutron-8214: {}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: L3 agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: Metadata agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: Metering agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: Open vSwitch agent@dv-neutron-821401-2-hyperv: { 'AddressGroup': '1.2', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'ConntrackHelper': '1.0', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'LocalIPAssociation': '1.0', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Log': '1.0', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Network': '1.1', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Port': '1.7', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'PortForwarding': '1.2', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'QosPolicy': '1.10', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SecurityGroup': '1.5', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SecurityGroupRule': '1.2', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'SubPort': '1.0', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Subnet': '1.1', Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: 'Trunk': '1.1'}} Dec 10 14:24:03.779404 dv-neutron-821401-2-hyperv neutron-server[103812]: {{(pid=103812) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 10 14:24:03.784921 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.795681 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4825cd1c-7bac-45b0-a4c1-54435a6a11f2 admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 1.2233884 Dec 10 14:24:03.798674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52118) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:03.803591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Request body: {'subnet': {'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-1676129679-subnet', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:03.886155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Attempting to bind port 37236f76-568d-45f5-8305-f465552d6622 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:03.886537 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Attempting to bind port 37236f76-568d-45f5-8305-f465552d6622 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:03.887049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Attempting to bind port 37236f76-568d-45f5-8305-f465552d6622 on network 1cc2d855-81bd-4d95-a565-455c7130be80 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:03.894911 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 23, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:03.895284 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Checking segment: {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:03.895696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.896070 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Bound using segment: {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:03.896567 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Bound port: 37236f76-568d-45f5-8305-f465552d6622, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:03.896931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.907108 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Made reservation on behalf of af5207bd54c6403799a8cc223fa0ea80 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:03.909227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:03.963026 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] For port 37236f76-568d-45f5-8305-f465552d6622, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:03.966527 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] For port 37236f76-568d-45f5-8305-f465552d6622, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=37236f76-568d-45f5-8305-f465552d6622,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:04.008898 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Made reservation on behalf of 8f11a2c4cb6b474d81f884b20c96a97b for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:04.011981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.067762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.133506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a0fdb29-f2d1-4227-9381-9ba4ce5a72d0 None None] Pushing event updated for resources: {'Port': ['ID=37236f76-568d-45f5-8305-f465552d6622,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:04.212682 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.234663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.329818 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.334055 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.435989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Checking segment: {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:04.436355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Network hostable DHCP agents. Network: 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:24:04.445178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Allocated IP 172.26.2.185 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/f4d181cd-97c1-4460-a212-39807e75d9f6) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:04.466550 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Checking segment: {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:04.466941 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Network hostable DHCP agents. Network: 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:24:04.478392 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f3e2204d-7027-4309-a5db-3d266a3ff37e,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:04.482964 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f95bfcc0-b514-425e-a401-25563b482fae,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:04.552432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:24:04.638492 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:04.643273 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:04.643857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.646459 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a81923cb-b061-46b2-b658-f2700288789b None None] Network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:04.735015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.737907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:24:04.748611 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:04.760060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17e4c55b-8e3c-49b7-997b-30108b59a093 None None] Network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:04.768788 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:04.770437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.772974 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3100a5f0-0d71-4b21-b18e-d04fb843abb4 admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 0.9731791 Dec 10 14:24:04.777628 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52148) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:04.784635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Request body: {'router': {'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:04.866496 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-79ad9f9f-d0f7-425b-93fb-eac2bc7da774 admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.1607139 Dec 10 14:24:04.870691 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52152) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:04.875270 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Request body: {'router': {'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:04.878701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 37236f76-568d-45f5-8305-f465552d6622 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:04.884741 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.910548 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:24:04.911431 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:04.936669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Pushing event updated for resources: {'Port': ['ID=f4d181cd-97c1-4460-a212-39807e75d9f6,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:04.949924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:04.950928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:04.954648 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:04.999925 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.001317 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.040165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:24:05.040749 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.108043 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.175991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.177372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.267268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 37236f76-568d-45f5-8305-f465552d6622 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:05.267762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.327195 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e86828f2-c336-4ec5-b7fc-c4c6f53a0408 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.366004 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52168) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:05.382033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.431290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Allocated IP 172.20.0.2 (90ab95ca-b6c7-4d4c-8815-86eb5dad26d0/f95bfcc0-b514-425e-a401-25563b482fae/c5a831ab-ec1e-4be3-9f77-2b2a42921d13) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:05.511930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68d99d75-dbee-43e1-b11b-986ba64ce53e None None] Network 1cc2d855-81bd-4d95-a565-455c7130be80 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:05.518787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.617032 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.649896 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Allocated IP 172.20.0.2 (8a88c7d6-baa3-4bff-a8db-78e7aa6fb066/f3e2204d-7027-4309-a5db-3d266a3ff37e/39fe2430-2766-46a9-9af1-837b19f271bb) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:05.655159 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.681833 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.735814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-36b012b7-e77f-47ce-b9a5-7b9d3c226d65 None None] Provisioning complete for port 37236f76-568d-45f5-8305-f465552d6622 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:05.736197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-36b012b7-e77f-47ce-b9a5-7b9d3c226d65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.772744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52180) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:05.940298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'network': {'name': 'tempest-RoutersAdminTest-1376542775', 'router:external': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:05.959170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:05.995568 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.065195 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.081715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 37236f76-568d-45f5-8305-f465552d6622, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=37236f76-568d-45f5-8305-f465552d6622,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:06.095748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52186) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:06.100030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.138902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52194) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:06.147004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:06.153230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Made reservation on behalf of 605cf5d3d75a473d8c1129a632d22119 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:06.155649 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.166483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.230282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Request body: {'network': {'name': 'tempest-ExternalNetworksTestJSON-test-network-257042382'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:06.236738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.238799 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:06.245388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Pushing event updated for resources: {'Port': ['ID=39fe2430-2766-46a9-9af1-837b19f271bb,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:06.263445 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:06.269327 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.278986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.278986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.303256 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:06.321578 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:06.323266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:06.344658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2bec9ea7-5811-4c4e-9814-b643801caa7c tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-2095145995'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:06.344991 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2bec9ea7-5811-4c4e-9814-b643801caa7c tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Unknown quota resources ['metering_label']. {{(pid=103810) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 10 14:24:06.353863 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:06.371044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:24:06.401159 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.411831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Attempting to bind port 39fe2430-2766-46a9-9af1-837b19f271bb on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:06.412080 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Attempting to bind port 39fe2430-2766-46a9-9af1-837b19f271bb by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:06.412573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Attempting to bind port 39fe2430-2766-46a9-9af1-837b19f271bb on network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:06.426328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 23, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:06.426328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Checking segment: {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:06.426328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.426960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Bound using segment: {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:06.427540 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Bound port: 39fe2430-2766-46a9-9af1-837b19f271bb, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:06.428215 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.434356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.563524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Attempting to bind port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:06.564842 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Attempting to bind port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:06.565446 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Attempting to bind port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 on network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:06.575179 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=37236f76-568d-45f5-8305-f465552d6622,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:06.617388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52208) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:06.626732 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Made reservation on behalf of 5b3bda131ae2445f9e9839c1b2686612 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:06.631282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.650263 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Pushing event updated for resources: {'Port': ['ID=c5a831ab-ec1e-4be3-9f77-2b2a42921d13,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:06.657666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.658660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 23, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:06.659201 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Checking segment: {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:06.659595 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.660225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Bound using segment: {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:06.660693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Bound port: c5a831ab-ec1e-4be3-9f77-2b2a42921d13, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:06.661109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.682290 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.721230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b5e3b47c-33f4-46f8-ae7c-56771ab7198f None None] Provisioning complete for port 37236f76-568d-45f5-8305-f465552d6622 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:06.721655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b5e3b47c-33f4-46f8-ae7c-56771ab7198f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.785480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 37236f76-568d-45f5-8305-f465552d6622 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:06.797038 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:06.801325 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2bec9ea7-5811-4c4e-9814-b643801caa7c tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.804355 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2bec9ea7-5811-4c4e-9814-b643801caa7c tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 478 time: 0.6644185 Dec 10 14:24:06.806884 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Sync routers for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:06.816354 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52212) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:06.820984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-74f15eb0-db83-4a3e-913f-fbdaf223766b tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.0.0/24', 'direction': 'ingress', 'metering_label_id': '399bd7da-6593-43a4-90a7-acd99ae573a5'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:06.822058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-74f15eb0-db83-4a3e-913f-fbdaf223766b tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103810) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 10 14:24:06.824707 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:06.825498 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:06.841026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0ae2e2cd-5faa-4c67-bac2-33d007e60a41 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Request body: {'quota': {'network': 2}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:06.845942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.849455 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] For port 39fe2430-2766-46a9-9af1-837b19f271bb, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:06.849942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.887795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] For port 39fe2430-2766-46a9-9af1-837b19f271bb, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=39fe2430-2766-46a9-9af1-837b19f271bb,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:06.891031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Allocated IP 172.26.2.5 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/3e34a057-7219-452b-8317-f70e57f89f17) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:06.896550 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 37236f76-568d-45f5-8305-f465552d6622 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:06.897026 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.916619 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.936185 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] For port c5a831ab-ec1e-4be3-9f77-2b2a42921d13, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:06.940524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] vlan segment allocate from pool success with {'vlan_id': 390, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:06.956974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.961670 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a9661c95-eecd-4bac-9148-d19fb66f61ba admin admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 3.7526414 Dec 10 14:24:06.965103 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52218) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:06.977126 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:06.977819 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Added segment 11f51139-fc96-40a1-9112-dadafbd3efab of type vlan for network 1f39510d-3919-43a8-9043-42d45461ec86 Dec 10 14:24:06.985960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] For port c5a831ab-ec1e-4be3-9f77-2b2a42921d13, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a831ab-ec1e-4be3-9f77-2b2a42921d13,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:06.990328 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0ae2e2cd-5faa-4c67-bac2-33d007e60a41 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] 10.222.0.57 "PUT /v2.0/quotas/e29af2c6a4fb44089f1f51812b7b1586 HTTP/1.1" status: 200 len: 368 time: 0.3643034 Dec 10 14:24:06.990741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52220) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:07.004974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Request body: {'network': {'project_id': 'e29af2c6a4fb44089f1f51812b7b1586'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:07.048244 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:07.052380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96cb080d-670d-4cb5-8b6f-9ad992d588fe,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:07.055371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.078107 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.services.metering.metering_plugin [None req-74f15eb0-db83-4a3e-913f-fbdaf223766b tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 10 14:24:07.096304 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.126400 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.179881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.183466 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Made reservation on behalf of e29af2c6a4fb44089f1f51812b7b1586 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:07.185847 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.201928 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7101d387-857d-4e94-ae9c-4c8dbd4e679b None None] Pushing event updated for resources: {'Port': ['ID=39fe2430-2766-46a9-9af1-837b19f271bb,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:07.229995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.278735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295d352f-b243-4d45-995a-fdc060063c79 None None] Pushing event updated for resources: {'Port': ['ID=c5a831ab-ec1e-4be3-9f77-2b2a42921d13,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:07.374364 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74f15eb0-db83-4a3e-913f-fbdaf223766b tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.375600 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-74f15eb0-db83-4a3e-913f-fbdaf223766b tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.5579472 Dec 10 14:24:07.381279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.383199 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52222) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:07.393910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-25a83f4a-facc-4906-94e7-0058340aa167 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.1.0/24', 'direction': 'ingress', 'metering_label_id': '399bd7da-6593-43a4-90a7-acd99ae573a5'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:07.394397 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-25a83f4a-facc-4906-94e7-0058340aa167 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103810) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 10 14:24:07.433079 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.434375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:07.434942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.441006 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.520416 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:05Z', 'revision_number': 3, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:07.537432 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 871 time: 2.1671786 Dec 10 14:24:07.548942 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.556363 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52224) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:07.565383 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Checking router: 196472fe-b965-4c82-9c4d-82a1d2dbdf83 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:24:07.566005 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Updating router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 port f4d181cd-97c1-4460-a212-39807e75d9f6 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:24:07.570111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.589390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'subnet': {'network_id': '1f39510d-3919-43a8-9043-42d45461ec86', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:07.595762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d555075c-02e7-4935-b4f7-6db7bfe97656 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event updated for resources: {'Network': ['ID=1f39510d-3919-43a8-9043-42d45461ec86,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:07.855243 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 1f39510d-3919-43a8-9043-42d45461ec86 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:07.857130 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.857775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] vlan segment allocate from pool success with {'vlan_id': 367, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:07.857775 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.services.metering.metering_plugin [None req-25a83f4a-facc-4906-94e7-0058340aa167 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 10 14:24:07.857775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.857775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.857775 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Added segment 92c1d5bd-3f5b-4967-8006-37c2b6a38d15 of type vlan for network 7c4bf91d-9813-4b8c-a9df-c3d66c142fbc Dec 10 14:24:07.900337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.900337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-25a83f4a-facc-4906-94e7-0058340aa167 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.900337 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-25a83f4a-facc-4906-94e7-0058340aa167 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.4934916 Dec 10 14:24:07.900669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52230) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:07.900780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f599c883-ceec-4c77-b108-fc6b3f9685fb,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:07.908198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.916213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] vlan segment allocate from pool success with {'vlan_id': 391, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:07.935354 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0defcf76-513e-4d1f-ab40-15fba438f522 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-label-rules?id=df61a836-bf83-4018-8c8c-350e8a27ee08 HTTP/1.1" status: 200 len: 464 time: 0.0454791 Dec 10 14:24:07.939992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52232) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:07.944285 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.944621 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Added segment 5ed15a1c-dcdc-4774-9a21-227fd2a44570 of type vlan for network 743eb138-729a-4345-8b8c-db6cbb5cad16 Dec 10 14:24:07.945897 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=583b6939-b64f-4e8d-9072-572f5d93829a,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:07.948195 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Made reservation on behalf of 605cf5d3d75a473d8c1129a632d22119 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:07.950480 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:07.956196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:08.026867 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:08.102455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:08.117329 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:08.122859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:08.123445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:08.190425 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Allocated IP 172.26.2.188 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/a98b7c4e-6b43-4945-87ef-560059ea48ae) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:08.233528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ef38a746-52c4-4c09-8740-db6da5071803 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:08.235263 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ef38a746-52c4-4c09-8740-db6da5071803 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "DELETE /v2.0/metering/metering-label-rules/df61a836-bf83-4018-8c8c-350e8a27ee08 HTTP/1.1" status: 204 len: 168 time: 0.2943776 Dec 10 14:24:08.241983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52234) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:08.295876 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.resource_extend [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 10 14:24:08.300607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:08.318258 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0245ded0-87e0-4de5-ada7-68d3f33e25a2 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-label-rules?id=df61a836-bf83-4018-8c8c-350e8a27ee08 HTTP/1.1" status: 200 len: 221 time: 0.0733685 Dec 10 14:24:08.330740 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52236) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:08.341559 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1aa6ec27-4b4b-4f34-ab03-e4e205c29b63 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--439691304', 'description': 'label created by tempest'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:08.342059 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1aa6ec27-4b4b-4f34-ab03-e4e205c29b63 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Unknown quota resources ['metering_label']. {{(pid=103811) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 10 14:24:08.365298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:08.371303 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Pushing event updated for resources: {'Port': ['ID=3e34a057-7219-452b-8317-f70e57f89f17,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:08.386209 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:08.395597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Allocated IP 172.20.0.1 (1cc2d855-81bd-4d95-a565-455c7130be80/630f1e53-2aa8-4b5b-8620-d9290269bc74/452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:08.476893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Pushing event updated for resources: {'Network': ['ID=7c4bf91d-9813-4b8c-a9df-c3d66c142fbc,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:08.497749 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 7c4bf91d-9813-4b8c-a9df-c3d66c142fbc details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:08.586747 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ed670d0f-1c59-442a-b1e4-9498b04da8a3 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 2.7972624 Dec 10 14:24:08.591890 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52240) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:08.645046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fccbfdd-a755-47c1-900c-596bc87b07b4 None None] Network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:08.666794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:08.668642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:08.671866 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:08.777011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:08.802467 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 1.8053532 Dec 10 14:24:08.844375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52244) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:08.853450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Request body: {'network': {'name': 'tempest-network--839343506', 'router:external': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:08.871093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Request body: {'network': {'project_id': 'e29af2c6a4fb44089f1f51812b7b1586'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:08.924213 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a831ab-ec1e-4be3-9f77-2b2a42921d13 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:08.962931 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ad3e4e3-2eec-4c06-91f8-02e8ecbfca12 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Pushing event updated for resources: {'Network': ['ID=743eb138-729a-4345-8b8c-db6cbb5cad16,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:08.971086 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9e46272f-89ae-4766-99ea-311fd770bb32 None None] Provisioning complete for port 39fe2430-2766-46a9-9af1-837b19f271bb triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:08.971650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e46272f-89ae-4766-99ea-311fd770bb32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.003224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 743eb138-729a-4345-8b8c-db6cbb5cad16 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:09.064477 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.070468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1aa6ec27-4b4b-4f34-ab03-e4e205c29b63 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.071788 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1aa6ec27-4b4b-4f34-ab03-e4e205c29b63 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 469 time: 0.7362640 Dec 10 14:24:09.075279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52250) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:09.094034 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.165568 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Made reservation on behalf of 59a690f495a842c49cb3e713f48abcce for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:09.169549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.188729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.189146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fba38cf0-c0ff-41da-8a01-dc387821c283 None None] Network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:09.196263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.205469 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:09.207533 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.215656 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-448ea05e-e3bc-462d-9c4b-e418c6e494f3 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-labels?id=946a135c-178f-47e8-97fe-2be9535d5624 HTTP/1.1" status: 200 len: 467 time: 0.1390004 Dec 10 14:24:09.231524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52252) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:09.266752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.288632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Network 1cc2d855-81bd-4d95-a565-455c7130be80 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:09.295131 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e46272f-89ae-4766-99ea-311fd770bb32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.299778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.307117 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:09.310339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:09.310339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.327247 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Made reservation on behalf of e29af2c6a4fb44089f1f51812b7b1586 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:09.334347 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.391219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9e46272f-89ae-4766-99ea-311fd770bb32 None None] For port 39fe2430-2766-46a9-9af1-837b19f271bb, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=39fe2430-2766-46a9-9af1-837b19f271bb,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:09.410743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Pushing event updated for resources: {'Port': ['ID=452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:09.445861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.462490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e46272f-89ae-4766-99ea-311fd770bb32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.465153 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.objects.ports [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103810) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:24:09.465564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.503971 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:09.555302 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e46272f-89ae-4766-99ea-311fd770bb32 None None] Pushing event updated for resources: {'Port': ['ID=39fe2430-2766-46a9-9af1-837b19f271bb,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:09.560467 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:09.563489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:09.576595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event updated for resources: {'Subnet': ['ID=c533932d-616a-4e39-bbc4-1c22f04bd3bf,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:09.612063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Allocated IP 172.26.2.8 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/0ff7ee81-23aa-4446-a58e-fe8a058c5f8e) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:09.612821 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f395e8db-1a9d-4e11-a62a-f3a72cead000 None None] Provisioning complete for port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:09.613338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f395e8db-1a9d-4e11-a62a-f3a72cead000 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.664134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port c5a831ab-ec1e-4be3-9f77-2b2a42921d13, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a831ab-ec1e-4be3-9f77-2b2a42921d13,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:09.706880 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] vlan segment allocate from pool success with {'vlan_id': 360, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:09.748298 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f395e8db-1a9d-4e11-a62a-f3a72cead000 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.767773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.768706 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 39fe2430-2766-46a9-9af1-837b19f271bb up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:09.773796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Checking segment: {'id': '11f51139-fc96-40a1-9112-dadafbd3efab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '1f39510d-3919-43a8-9043-42d45461ec86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:09.774385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Network hostable DHCP agents. Network: 1f39510d-3919-43a8-9043-42d45461ec86, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:24:09.798126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.837713 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Pushing event updated for resources: {'Port': ['ID=a98b7c4e-6b43-4945-87ef-560059ea48ae,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:09.867304 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=c5a831ab-ec1e-4be3-9f77-2b2a42921d13,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:09.875454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:09.875805 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Added segment 06b2b71c-cce3-4fe8-a6b2-8b289152471d of type vlan for network 316613cc-e13c-479c-9e3f-b2527099dbd9 Dec 10 14:24:09.899408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Network 1f39510d-3919-43a8-9043-42d45461ec86 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:24:09.910365 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-f395e8db-1a9d-4e11-a62a-f3a72cead000 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:24:09.910365 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-f395e8db-1a9d-4e11-a62a-f3a72cead000 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:24:09.917632 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 39fe2430-2766-46a9-9af1-837b19f271bb triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:09.931037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.001807 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 1f39510d-3919-43a8-9043-42d45461ec86) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:10.012271 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:10.021650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.021795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9af9e010-441b-46a2-8f57-414549034e9f None None] Network 1f39510d-3919-43a8-9043-42d45461ec86 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:10.022410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.038361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Router 67c47c57-09e4-4303-97e1-a2215115ce2a is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:24:10.040114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.100480 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4239a8af-4262-4760-8a48-b12b004de1d0 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.104398 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4239a8af-4262-4760-8a48-b12b004de1d0 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "DELETE /v2.0/metering/metering-labels/946a135c-178f-47e8-97fe-2be9535d5624 HTTP/1.1" status: 204 len: 168 time: 0.8669021 Dec 10 14:24:10.105548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52256) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.110058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.118209 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4f9e104-b458-4da4-a187-1e45aa36374b None None] Network 1f39510d-3919-43a8-9043-42d45461ec86 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:10.122462 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c1ed995d-ea57-4818-8ea5-6c356cd3675f tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-labels?id=946a135c-178f-47e8-97fe-2be9535d5624 HTTP/1.1" status: 200 len: 216 time: 0.0156705 Dec 10 14:24:10.128101 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52258) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.150285 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.170411 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2d0fcca9-86d7-4bd4-a7a2-8e6fa75f7fc8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.6000187 Dec 10 14:24:10.176396 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cafaa45c-fec3-4940-9ae9-feaf16d4f148 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0446994 Dec 10 14:24:10.176994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52260) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.184730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminTest-1080372936', 'network_id': '1f39510d-3919-43a8-9043-42d45461ec86'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:10.198166 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52262) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.220397 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-269d5e34-607b-45c9-8983-63b01ee00b24 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0209830 Dec 10 14:24:10.223306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.223306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:10.223957 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.224662 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52264) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.236193 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:10.239257 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] vlan segment allocate from pool success with {'vlan_id': 370, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:10.246358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Sync routers for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:10.258846 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:10.259463 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:10.290700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.292715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.344763 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.345208 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Added segment e32c985b-e529-48d9-bc4f-c646797fd550 of type vlan for network 17c95ff3-9be1-4c46-9c66-aba0099f8a30 Dec 10 14:24:10.346939 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75d6de50-bfca-443d-8f7a-559c1c5b041f,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:10.392264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:10.399902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Made reservation on behalf of 605cf5d3d75a473d8c1129a632d22119 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:10.402292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.416709 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-62dcc6a4-b02e-4f6a-8ded-c7d5c2b25263 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-labels/399bd7da-6593-43a4-90a7-acd99ae573a5 HTTP/1.1" status: 200 len: 473 time: 0.1897871 Dec 10 14:24:10.421898 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52268) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.436751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] device_id is not set on port a1187c12-c399-4adc-8ffb-d1f42b0dfdfa yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:24:10.442732 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1f53cf28-de1e-4d89-a340-337653e7603f tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-label-rules/85deec49-a39a-4a15-9f4d-a3f591c3aec3 HTTP/1.1" status: 200 len: 461 time: 0.0197613 Dec 10 14:24:10.443570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Pushing event updated for resources: {'Port': ['ID=0ff7ee81-23aa-4446-a58e-fe8a058c5f8e,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:10.446808 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52270) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.480426 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 1.6347413 Dec 10 14:24:10.483935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:10.486585 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52272) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.497355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.501768 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-db152658-7f66-4222-9636-33f169fed1e8 admin admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 916 time: 5.7197883 Dec 10 14:24:10.503521 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52274) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.504063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ba333d5a-14c5-4a2c-b082-0c6d6cbb9523 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Request body: {'network': {'project_id': 'e29af2c6a4fb44089f1f51812b7b1586'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:10.509870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fd68f78-253c-41d9-a533-8dc2ce83a7f2 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Pushing event updated for resources: {'Network': ['ID=316613cc-e13c-479c-9e3f-b2527099dbd9,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:10.514034 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.529015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:10.529795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 316613cc-e13c-479c-9e3f-b2527099dbd9 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:10.547351 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-ba333d5a-14c5-4a2c-b082-0c6d6cbb9523 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Dec 10 14:24:10.547845 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ba333d5a-14c5-4a2c-b082-0c6d6cbb9523 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:24:10.552557 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ba333d5a-14c5-4a2c-b082-0c6d6cbb9523 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 409 len: 310 time: 0.0616176 Dec 10 14:24:10.552557 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52278) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.595977 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.603130 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.605171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.626502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:10.679909 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Pushing event updated for resources: {'Port': ['ID=f4d181cd-97c1-4460-a212-39807e75d9f6,revision_number=2']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:10.685987 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.686359 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.687971 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.688393 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.688723 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.689055 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.689591 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.690072 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.690568 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.691084 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.691579 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.692049 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.692532 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Tracked resource versions report: Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: pushed versions: Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: { 'AddressGroup': {'1.2'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'ConntrackHelper': {'1.0'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'LocalIPAssociation': {'1.0'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Log': {'1.0'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Network': {'1.1'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Port': {'1.7'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'PortForwarding': {'1.2'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'QosPolicy': {'1.10'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SecurityGroup': {'1.5'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SecurityGroupRule': {'1.2'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SubPort': {'1.0'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Subnet': {'1.1'}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Trunk': {'1.1'}} Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: consumer versions: Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: { DHCP agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: HyperV agent@hv-neutron-8214: {}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: L3 agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: Metadata agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: Metering agent@dv-neutron-821401-2-hyperv: {}, Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: Open vSwitch agent@dv-neutron-821401-2-hyperv: { 'AddressGroup': '1.2', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'ConntrackHelper': '1.0', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'LocalIPAssociation': '1.0', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Log': '1.0', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Network': '1.1', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Port': '1.7', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'PortForwarding': '1.2', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'QosPolicy': '1.10', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SecurityGroup': '1.5', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SecurityGroupRule': '1.2', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'SubPort': '1.0', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Subnet': '1.1', Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: 'Trunk': '1.1'}} Dec 10 14:24:10.694139 dv-neutron-821401-2-hyperv neutron-server[103813]: {{(pid=103813) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 10 14:24:10.704084 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Allocated IP 172.20.0.6 (1f39510d-3919-43a8-9043-42d45461ec86/c533932d-616a-4e39-bbc4-1c22f04bd3bf/a1187c12-c399-4adc-8ffb-d1f42b0dfdfa) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:10.715378 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Attempting to bind port f4d181cd-97c1-4460-a212-39807e75d9f6 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:10.715763 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Attempting to bind port f4d181cd-97c1-4460-a212-39807e75d9f6 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:10.716143 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Attempting to bind port f4d181cd-97c1-4460-a212-39807e75d9f6 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:10.726792 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fe3a2edc-50fd-4e70-a205-168c96bfe694 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=e29af2c6a4fb44089f1f51812b7b1586&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1734056 Dec 10 14:24:10.742281 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:10.746514 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:10.747140 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.747674 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:10.748746 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Bound port: f4d181cd-97c1-4460-a212-39807e75d9f6, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:10.750811 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.761825 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8a0a11bd-90e0-4d69-9fe2-711ca76788c1 None None] Provisioning complete for port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:10.762111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a0a11bd-90e0-4d69-9fe2-711ca76788c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.778489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52280) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.837451 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] For port f4d181cd-97c1-4460-a212-39807e75d9f6, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:10.837723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e34c5f59-b46a-40e4-9f17-4d4dcd972619 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.838837 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e34c5f59-b46a-40e4-9f17-4d4dcd972619 tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "DELETE /v2.0/metering/metering-label-rules/85deec49-a39a-4a15-9f4d-a3f591c3aec3 HTTP/1.1" status: 204 len: 168 time: 0.3908310 Dec 10 14:24:10.843583 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52282) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:10.844162 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] For port f4d181cd-97c1-4460-a212-39807e75d9f6, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4d181cd-97c1-4460-a212-39807e75d9f6,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:10.878887 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.resource_extend [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] It took 0.26 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 10 14:24:10.927999 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:10.952314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a831ab-ec1e-4be3-9f77-2b2a42921d13 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:11.012847 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b4cb003e-6ea2-4d4d-b3ad-8cc63a46c492 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.013433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:08Z', 'revision_number': 3, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:11.037741 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d537854c-012f-4abf-8832-d1b12c6d546e None None] Pushing event updated for resources: {'Port': ['ID=f4d181cd-97c1-4460-a212-39807e75d9f6,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:11.073505 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Checking router: 67c47c57-09e4-4303-97e1-a2215115ce2a for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:24:11.073857 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Updating router 67c47c57-09e4-4303-97e1-a2215115ce2a port 3e34a057-7219-452b-8317-f70e57f89f17 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:24:11.080536 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:11.081115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.082768 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:11.096801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:11.098500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.140985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.151021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.151981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:11.152670 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.160674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b4cb003e-6ea2-4d4d-b3ad-8cc63a46c492 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.167128 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8a0a11bd-90e0-4d69-9fe2-711ca76788c1 None None] Provisioning complete for port 39fe2430-2766-46a9-9af1-837b19f271bb triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:11.167128 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a0a11bd-90e0-4d69-9fe2-711ca76788c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.253213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b026b9a2-bfa0-4fc1-9937-06a8168147db tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.255443 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b026b9a2-bfa0-4fc1-9937-06a8168147db tempest-MeteringTestJSON-1299982479 tempest-MeteringTestJSON-1299982479-project-admin] 10.222.0.57 "DELETE /v2.0/metering/metering-labels/399bd7da-6593-43a4-90a7-acd99ae573a5 HTTP/1.1" status: 204 len: 168 time: 0.4074535 Dec 10 14:24:11.277279 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:11.286236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.334495 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 2.7365136 Dec 10 14:24:11.342295 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52286) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:11.342680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 39fe2430-2766-46a9-9af1-837b19f271bb up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:11.343306 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b4cb003e-6ea2-4d4d-b3ad-8cc63a46c492 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.348574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b4cb003e-6ea2-4d4d-b3ad-8cc63a46c492 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.350489 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b4cb003e-6ea2-4d4d-b3ad-8cc63a46c492 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] 10.222.0.57 "DELETE /v2.0/security-groups/583b6939-b64f-4e8d-9072-572f5d93829a HTTP/1.1" status: 204 len: 168 time: 0.5703096 Dec 10 14:24:11.387954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52288) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:11.409382 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff6da0be-0128-4743-8396-a533152ec33c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'Network': ['ID=17c95ff3-9be1-4c46-9c66-aba0099f8a30,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:11.432343 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.455368 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 17c95ff3-9be1-4c46-9c66-aba0099f8a30 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:11.470273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.545913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4cb003e-6ea2-4d4d-b3ad-8cc63a46c492 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=583b6939-b64f-4e8d-9072-572f5d93829a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:11.560446 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.566129 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.567111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.586707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.619653 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:08Z', 'revision_number': 1, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:11.678592 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8a0a11bd-90e0-4d69-9fe2-711ca76788c1 None None] Provisioning complete for port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:11.679205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a0a11bd-90e0-4d69-9fe2-711ca76788c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.684044 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0e5ebd7-79ab-4db8-bc19-9dff4b0257ac None None] The sync data for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv is: [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:08Z', 'revision_number': 1, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:11.715293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.737449 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 39fe2430-2766-46a9-9af1-837b19f271bb triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:11.737900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.746622 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Network 1f39510d-3919-43a8-9043-42d45461ec86 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:11.751173 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:11.753962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:11.755595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:11.755709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.798013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.807852 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.829787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Pushing event updated for resources: {'Port': ['ID=452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:11.838433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8a0a11bd-90e0-4d69-9fe2-711ca76788c1 None None] Port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:11.852227 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > segment before_delete 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.852227 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.853247 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.853708 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > port after_create 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.854267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > port after_delete 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.854470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > port after_update 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.854809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > segment after_delete 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.855132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.856308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.856308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > subnet after_update 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:11.872773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:11.951708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52292) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:11.963881 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.017241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Attempting to bind port 3e34a057-7219-452b-8317-f70e57f89f17 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:12.017647 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Attempting to bind port 3e34a057-7219-452b-8317-f70e57f89f17 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:12.018018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Attempting to bind port 3e34a057-7219-452b-8317-f70e57f89f17 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:12.053641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Network 1cc2d855-81bd-4d95-a565-455c7130be80 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:12.057389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:12.059289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65af3d56-ab23-42ef-85b4-d770d4c7096a None None] Pushing event updated for resources: {'Port': ['ID=3e34a057-7219-452b-8317-f70e57f89f17,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:12.071030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:12.071030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:12.071666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.071837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:12.072332 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Bound port: 3e34a057-7219-452b-8317-f70e57f89f17, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:12.072820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.097126 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.148782 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:12.149328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:12.157494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > subnet before_create 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:12.158014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Subscribe: > subnet before_update 55550000 {{(pid=103810) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:12.158404 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['316613cc-e13c-479c-9e3f-b2527099dbd9']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:12.192731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] For port 3e34a057-7219-452b-8317-f70e57f89f17, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:12.197628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] For port 3e34a057-7219-452b-8317-f70e57f89f17, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3e34a057-7219-452b-8317-f70e57f89f17,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:12.204622 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1023 time: 2.0212653 Dec 10 14:24:12.208100 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52296) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:12.209881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '06b2b71c-cce3-4fe8-a6b2-8b289152471d') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:12.214609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '06b2b71c-cce3-4fe8-a6b2-8b289152471d') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:12.214609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b2e9817-f9a3-4687-b9d7-a2b12d737926 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event updated for resources: {'Port': ['ID=a1187c12-c399-4adc-8ffb-d1f42b0dfdfa,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:12.221466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.255071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.270967 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.276328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a335942-c715-4113-9ca6-a77c28820224 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.306422 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.391601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Pushing event updated for resources: {'Port': ['ID=0ff7ee81-23aa-4446-a58e-fe8a058c5f8e,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:12.392168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:12.392911 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:12.437273 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.440604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:24:12.451804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.458164 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f58293ee-c37a-480b-80fe-53e93b3ead14 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 6.3592064 Dec 10 14:24:12.461089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52298) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:12.469313 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65af3d56-ab23-42ef-85b4-d770d4c7096a None None] Pushing event updated for resources: {'Port': ['ID=3e34a057-7219-452b-8317-f70e57f89f17,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:12.474490 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Request body: {'port': {'name': 'tempest-ExternalNetworksAdminNegativeTestJSON-1996685623', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'fixed_ips': [{'ip_address': '172.26.2.8'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:12.486907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Releasing vlan 360 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:12.487313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: from cryptography.utils import int_from_bytes Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: from cryptography.utils import int_from_bytes Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:12.492053 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:12.494388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.522950 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.537922 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-4dca2a46-5c5e-4019-a4a4-4fae049fd6bf None None] Provisioning complete for port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:12.538436 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4dca2a46-5c5e-4019-a4a4-4fae049fd6bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.561101 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['17c95ff3-9be1-4c46-9c66-aba0099f8a30']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:12.574895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e32c985b-e529-48d9-bc4f-c646797fd550') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:12.575251 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e32c985b-e529-48d9-bc4f-c646797fd550') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:12.588998 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.594832 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-4dca2a46-5c5e-4019-a4a4-4fae049fd6bf None None] Port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:12.598614 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:12.608380 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.616005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Releasing vlan 370 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:12.616423 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:12.697799 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:12.738538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Made reservation on behalf of 29b4009c6fc44735a7c182afd26ef65a for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:12.740959 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.767929 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:24:12.773123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.893482 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:08Z', 'revision_number': 3, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:12.894143 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-e393eb32-9557-471e-b008-c7791f644740 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Deleting port a1187c12-c399-4adc-8ffb-d1f42b0dfdfa {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:12.894500 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e393eb32-9557-471e-b008-c7791f644740 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.926957 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6f51582-8547-4a58-addd-e99f8b9f3edd None None] The sync data for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv is: [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:08Z', 'revision_number': 3, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:12.943996 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:12.981902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.010162 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 17c95ff3-9be1-4c46-9c66-aba0099f8a30 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 10 14:24:13.020613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:13.021996 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e393eb32-9557-471e-b008-c7791f644740 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.025224 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.033952 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] 10.222.0.57 "DELETE /v2.0/networks/316613cc-e13c-479c-9e3f-b2527099dbd9 HTTP/1.1" status: 204 len: 168 time: 1.6409926 Dec 10 14:24:13.035809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.040383 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "DELETE /v2.0/networks/17c95ff3-9be1-4c46-9c66-aba0099f8a30 HTTP/1.1" status: 204 len: 168 time: 1.6886716 Dec 10 14:24:13.041720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3b69a86-8b26-46bd-b887-ebe31315b826 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event deleted for resources: {'Network': ['ID=17c95ff3-9be1-4c46-9c66-aba0099f8a30,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:13.044052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52300) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:13.061540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-e393eb32-9557-471e-b008-c7791f644740 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Calling delete_port for a1187c12-c399-4adc-8ffb-d1f42b0dfdfa owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:13.078201 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52302) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:13.083002 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Request body: {'network': {'router:external': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:13.163288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:13.168730 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5efc8a0b-9ca4-42a3-b902-202c0c2a2831 admin admin] 10.222.0.57 "PUT /v2.0/routers/196472fe-b965-4c82-9c4d-82a1d2dbdf83/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2021210 Dec 10 14:24:13.171921 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.175724 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d05afdb7-c4f8-4c64-a6d6-4fc69c77dc0f admin admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 8.3039870 Dec 10 14:24:13.176289 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52304) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:13.183419 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bb2a9bf-4892-42cd-bfdf-f35e5702b919 tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Pushing event deleted for resources: {'Network': ['ID=316613cc-e13c-479c-9e3f-b2527099dbd9,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:13.259854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.274059 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a335942-c715-4113-9ca6-a77c28820224 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.293266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Allocated IP 172.20.0.1 (90ab95ca-b6c7-4d4c-8815-86eb5dad26d0/f95bfcc0-b514-425e-a401-25563b482fae/d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:13.368816 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.372718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2a335942-c715-4113-9ca6-a77c28820224 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.375127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Made reservation on behalf of 59a690f495a842c49cb3e713f48abcce for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:13.378034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.383154 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.412226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['743eb138-729a-4345-8b8c-db6cbb5cad16']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:13.429867 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5ed15a1c-dcdc-4774-9a21-227fd2a44570') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:13.430172 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5ed15a1c-dcdc-4774-9a21-227fd2a44570') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:13.441074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.460916 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.469879 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Releasing vlan 391 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:13.470654 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:13.473524 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:13.498463 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2a335942-c715-4113-9ca6-a77c28820224 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=522d671fa3864565a3fdc6d41da8a5d7&name=default HTTP/1.1" status: 200 len: 2996 time: 1.5416598 Dec 10 14:24:13.507108 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a335942-c715-4113-9ca6-a77c28820224 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97709a0d-9153-400f-85e8-2ce2d0b427ea,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:13.509285 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.511604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52318) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:13.523914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] device_id is not set on port 220b8948-8daa-44e2-a707-bc65d3b4d98a yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:24:13.575982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] vlan segment allocate from pool success with {'vlan_id': 352, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:13.579551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c860f303-fde6-452a-97df-d8e86eb74237 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.581724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e393eb32-9557-471e-b008-c7791f644740 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.602443 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Sync routers for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:13.618242 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:13.618875 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:13.632321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e393eb32-9557-471e-b008-c7791f644740 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event deleted for resources: {'Port': ['ID=a1187c12-c399-4adc-8ffb-d1f42b0dfdfa,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:13.681863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.694874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.695216 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Added segment 6a7ef721-2fff-4015-b438-d25603e0abf7 of type vlan for network 7d6930e9-40f9-4d93-bc61-7d626f841f69 Dec 10 14:24:13.722901 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.723089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9c2d701-79f6-4cec-b41a-342f8ef7707b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:13.747639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c860f303-fde6-452a-97df-d8e86eb74237 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.766314 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.770103 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] 10.222.0.57 "DELETE /v2.0/networks/743eb138-729a-4345-8b8c-db6cbb5cad16 HTTP/1.1" status: 204 len: 168 time: 0.6945436 Dec 10 14:24:13.775768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74a790e8-4a00-4ac5-85c6-ec3c08f09ddb tempest-QuotasNegativeTest-364040915 tempest-QuotasNegativeTest-364040915-project-admin] Pushing event deleted for resources: {'Network': ['ID=743eb138-729a-4345-8b8c-db6cbb5cad16,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:13.873712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e393eb32-9557-471e-b008-c7791f644740 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:13.873712 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e393eb32-9557-471e-b008-c7791f644740 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "DELETE /v2.0/ports/a1187c12-c399-4adc-8ffb-d1f42b0dfdfa HTTP/1.1" status: 204 len: 168 time: 1.6518905 Dec 10 14:24:13.874513 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:13.882567 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52322) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:13.893479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '1f39510d-3919-43a8-9043-42d45461ec86', 'external_fixed_ips': [{'subnet_id': 'c533932d-616a-4e39-bbc4-1c22f04bd3bf', 'ip_address': '172.20.0.6'}]}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:14.038891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.067113 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.068358 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.186385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.191292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:14.192062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.224420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.231988 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:09Z', 'revision_number': 3, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:14.236992 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.238593 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c860f303-fde6-452a-97df-d8e86eb74237 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.241532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c860f303-fde6-452a-97df-d8e86eb74237 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.242665 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c860f303-fde6-452a-97df-d8e86eb74237 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/97709a0d-9153-400f-85e8-2ce2d0b427ea HTTP/1.1" status: 204 len: 168 time: 0.7300620 Dec 10 14:24:14.254715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c860f303-fde6-452a-97df-d8e86eb74237 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97709a0d-9153-400f-85e8-2ce2d0b427ea,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:14.278007 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Checking router: 6b7d9a03-a75e-4f11-8074-0360686c8ab9 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:24:14.278359 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Updating router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 port a98b7c4e-6b43-4945-87ef-560059ea48ae binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:24:14.315701 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.504780 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52330) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:14.505492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'Network': ['ID=7d6930e9-40f9-4d93-bc61-7d626f841f69,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:14.516348 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 7d6930e9-40f9-4d93-bc61-7d626f841f69 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:14.531595 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3f0cd138-86a8-41b2-8024-97565d81e7ec tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Request body: {'security_group': {'name': 'tempest-securitygroup--622989828', 'description': 'tempest-description--2019423881'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:14.541855 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0fe8b9a5-c7a5-4c4c-b211-1ffee4924ed4 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 836 time: 1.4680624 Dec 10 14:24:14.543182 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Dec 10 14:24:14.543705 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:24:14.554030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52332) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:14.564800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:14.568346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Request body: {'subnet': {'network_id': '7d6930e9-40f9-4d93-bc61-7d626f841f69', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:14.585345 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Pushing event updated for resources: {'Port': ['ID=d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:14.588963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:14.591017 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:14.591532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.654984 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.api [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 10 14:24:14.654984 dv-neutron-821401-2-hyperv neutron-server[103811]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 10 14:24:14.654984 dv-neutron-821401-2-hyperv neutron-server[103811]: [parameters: {'project_id_1': '59a690f495a842c49cb3e713f48abcce', 'expiration_1': datetime.datetime(2021, 12, 10, 14, 23, 54, 597969)}] Dec 10 14:24:14.654984 dv-neutron-821401-2-hyperv neutron-server[103811]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103811) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:24:14.655391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG oslo_db.api [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:24:14.779122 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.822050 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f0cd138-86a8-41b2-8024-97565d81e7ec tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.935598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3e34a057-7219-452b-8317-f70e57f89f17 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:14.971130 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:14.998470 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8a77525c-b1e3-4bd1-8e0c-24f0a476e5ab tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 409 len: 370 time: 2.5324669 Dec 10 14:24:15.009057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52340) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:15.041339 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.074129 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2fc9cc1a-3e94-4375-b239-d5ca45643f17 None None] Provisioning complete for port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:15.074513 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2fc9cc1a-3e94-4375-b239-d5ca45643f17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.140613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3e34a057-7219-452b-8317-f70e57f89f17 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:15.141194 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.145555 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2fc9cc1a-3e94-4375-b239-d5ca45643f17 None None] Port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:15.163434 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Attempting to bind port a98b7c4e-6b43-4945-87ef-560059ea48ae on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:15.166269 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Attempting to bind port a98b7c4e-6b43-4945-87ef-560059ea48ae by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:15.166652 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Attempting to bind port a98b7c4e-6b43-4945-87ef-560059ea48ae on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:15.176939 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26ed4382-3066-4351-b905-87fa47aa8ea0 None None] Pushing event updated for resources: {'Port': ['ID=a98b7c4e-6b43-4945-87ef-560059ea48ae,revision_number=2']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:15.187267 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52342) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:15.187604 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:15.188299 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:15.188416 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.188867 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:15.189330 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Bound port: a98b7c4e-6b43-4945-87ef-560059ea48ae, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:15.189787 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.285898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Made reservation on behalf of 59a690f495a842c49cb3e713f48abcce for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:15.289159 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] For port a98b7c4e-6b43-4945-87ef-560059ea48ae, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:15.293130 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] For port a98b7c4e-6b43-4945-87ef-560059ea48ae, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a98b7c4e-6b43-4945-87ef-560059ea48ae,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:15.294432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.364672 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.374108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Deleting port 0ff7ee81-23aa-4446-a58e-fe8a058c5f8e {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:15.374684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.469544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.478167 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26ed4382-3066-4351-b905-87fa47aa8ea0 None None] Pushing event updated for resources: {'Port': ['ID=a98b7c4e-6b43-4945-87ef-560059ea48ae,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:15.496287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 3e34a057-7219-452b-8317-f70e57f89f17, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3e34a057-7219-452b-8317-f70e57f89f17,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:15.506871 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:15.507903 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:15.569341 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.570285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4d181cd-97c1-4460-a212-39807e75d9f6 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:15.597730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52348) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:15.599003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c406ac5-8f4c-48d1-9f67-43e439b22de2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.629648 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.647380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f0cd138-86a8-41b2-8024-97565d81e7ec tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.710264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.720514 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:15.732294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=3e34a057-7219-452b-8317-f70e57f89f17,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:15.738901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port f4d181cd-97c1-4460-a212-39807e75d9f6 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:15.740413 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.743450 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ebdfa7e-ff79-4e4a-b009-71b7e91de9a5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.755201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.755515 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.757921 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f0cd138-86a8-41b2-8024-97565d81e7ec tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.774366 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.797821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c406ac5-8f4c-48d1-9f67-43e439b22de2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.800683 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.811060 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Calling delete_port for 0ff7ee81-23aa-4446-a58e-fe8a058c5f8e owned by network:floatingip {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:15.845165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.884888 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port f4d181cd-97c1-4460-a212-39807e75d9f6, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4d181cd-97c1-4460-a212-39807e75d9f6,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:15.895516 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f0cd138-86a8-41b2-8024-97565d81e7ec tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.896774 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3f0cd138-86a8-41b2-8024-97565d81e7ec tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 1.3855231 Dec 10 14:24:15.897505 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f0cd138-86a8-41b2-8024-97565d81e7ec tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ad7787c2-a452-4578-90f6-78c6a9cab94a,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:15.906016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52350) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:15.927964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-dc978ddc-de5a-49c8-b0d7-90a1195d0314 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Request body: {'security_group_rule': {'security_group_id': 'ad7787c2-a452-4578-90f6-78c6a9cab94a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:15.950653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c406ac5-8f4c-48d1-9f67-43e439b22de2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:15.975474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.047306 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:09Z', 'revision_number': 3, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:16.059610 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c406ac5-8f4c-48d1-9f67-43e439b22de2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76c57709-1a93-420f-a0ba-b029cd7bc720,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:16.081411 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=f4d181cd-97c1-4460-a212-39807e75d9f6,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:16.094530 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363ef4c6-6209-41bd-bdef-386e3a95bdfb None None] The sync data for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv is: [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:09Z', 'revision_number': 3, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:16.105759 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ebdfa7e-ff79-4e4a-b009-71b7e91de9a5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.142307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Allocated IP 172.20.0.6 (1f39510d-3919-43a8-9043-42d45461ec86/c533932d-616a-4e39-bbc4-1c22f04bd3bf/f7311e2e-fc3f-4749-9512-8d4cf8ba0b58) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:16.181993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ebdfa7e-ff79-4e4a-b009-71b7e91de9a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.188338 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1c406ac5-8f4c-48d1-9f67-43e439b22de2 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=83392e9245ec4436940e7db83f913812&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9372535 Dec 10 14:24:16.195322 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52352) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:16.269436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc978ddc-de5a-49c8-b0d7-90a1195d0314 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.327441 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebdfa7e-ff79-4e4a-b009-71b7e91de9a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e81d9275-5e09-45bc-a17e-7d45ace4c797,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:16.334846 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0ebdfa7e-ff79-4e4a-b009-71b7e91de9a5 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=f98af080822b4b9d97cacd77fddf46b1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7308736 Dec 10 14:24:16.335025 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Allocated IP 172.20.0.1 (8a88c7d6-baa3-4bff-a8db-78e7aa6fb066/f3e2204d-7027-4309-a5db-3d266a3ff37e/a0de3123-62f5-41a9-921c-6e2250a89def) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:16.338355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52354) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:16.372168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02a34d86-9b03-4e3d-9fd7-1b1c623fd540 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.389781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.427125 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.434773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02a34d86-9b03-4e3d-9fd7-1b1c623fd540 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.475312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.480372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc978ddc-de5a-49c8-b0d7-90a1195d0314 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.507151 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.508064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.515223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Pushing event deleted for resources: {'Port': ['ID=0ff7ee81-23aa-4446-a58e-fe8a058c5f8e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:16.521774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42037bf3-2941-4466-baed-1f05ef7f0ab9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.590153 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc978ddc-de5a-49c8-b0d7-90a1195d0314 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.611021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42037bf3-2941-4466-baed-1f05ef7f0ab9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.671143 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.678108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.685562 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c93e76b2-0dc5-4f93-9a56-6ffd11b08707 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080 tempest-ExternalNetworksAdminNegativeTestJSON-2077551080-project-admin] 10.222.0.57 "DELETE /v2.0/floatingips/58eab5f4-ea4f-4274-8239-35a236713f35 HTTP/1.1" status: 204 len: 168 time: 1.6709971 Dec 10 14:24:16.708390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.723885 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc978ddc-de5a-49c8-b0d7-90a1195d0314 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6270a149-972e-45d2-a57b-76f75989f9d9,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:16.728001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02a34d86-9b03-4e3d-9fd7-1b1c623fd540 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.730155 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Pushing event updated for resources: {'Port': ['ID=d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:16.731320 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02a34d86-9b03-4e3d-9fd7-1b1c623fd540 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.735714 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-02a34d86-9b03-4e3d-9fd7-1b1c623fd540 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/76c57709-1a93-420f-a0ba-b029cd7bc720 HTTP/1.1" status: 204 len: 168 time: 0.5278592 Dec 10 14:24:16.754465 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02a34d86-9b03-4e3d-9fd7-1b1c623fd540 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76c57709-1a93-420f-a0ba-b029cd7bc720,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:16.764042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.815898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Sync routers for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:16.842354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc978ddc-de5a-49c8-b0d7-90a1195d0314 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.847075 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dc978ddc-de5a-49c8-b0d7-90a1195d0314 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.9389362 Dec 10 14:24:16.850804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52360) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:16.855397 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:16.856827 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:16.864676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-671de410-8a0d-4796-8288-b3384d6b2746 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Request body: {'security_group_rule': {'security_group_id': 'ad7787c2-a452-4578-90f6-78c6a9cab94a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:16.868653 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42037bf3-2941-4466-baed-1f05ef7f0ab9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.879911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42037bf3-2941-4466-baed-1f05ef7f0ab9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:16.885362 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-42037bf3-2941-4466-baed-1f05ef7f0ab9 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/e81d9275-5e09-45bc-a17e-7d45ace4c797 HTTP/1.1" status: 204 len: 168 time: 0.5434980 Dec 10 14:24:16.901645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Network 1f39510d-3919-43a8-9043-42d45461ec86 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:16.909977 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:16.917302 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:16.944561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:16.948511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:17.008337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42037bf3-2941-4466-baed-1f05ef7f0ab9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e81d9275-5e09-45bc-a17e-7d45ace4c797,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:17.042204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event updated for resources: {'Port': ['ID=f7311e2e-fc3f-4749-9512-8d4cf8ba0b58,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:17.044328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:17.063799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.101187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3e34a057-7219-452b-8317-f70e57f89f17 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:17.163957 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-671de410-8a0d-4796-8288-b3384d6b2746 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.182358 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:17.235124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:17.239966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Pushing event updated for resources: {'Port': ['ID=a0de3123-62f5-41a9-921c-6e2250a89def,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:17.258364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:17.258616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.318204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Router 67c47c57-09e4-4303-97e1-a2215115ce2a has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:24:17.353375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3e34a057-7219-452b-8317-f70e57f89f17 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:17.353375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.415083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:24:17.415553 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.422289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-79345222-e05e-4409-a854-f412fd32a160 None None] Provisioning complete for port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:17.424232 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-79345222-e05e-4409-a854-f412fd32a160 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.516970 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.530531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-79345222-e05e-4409-a854-f412fd32a160 None None] Port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:17.652096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-671de410-8a0d-4796-8288-b3384d6b2746 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.732556 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a98b7c4e-6b43-4945-87ef-560059ea48ae up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:17.735987 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-5fd6c6dc-f430-4bba-9614-e45cc3eeb193 None None] Provisioning complete for port a0de3123-62f5-41a9-921c-6e2250a89def triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:17.736911 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fd6c6dc-f430-4bba-9614-e45cc3eeb193 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.737683 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'Subnet': ['ID=92f44727-cbb1-443f-bd14-a235df73e588,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:17.745988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-671de410-8a0d-4796-8288-b3384d6b2746 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.778207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Checking segment: {'id': '6a7ef721-2fff-4015-b438-d25603e0abf7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '7d6930e9-40f9-4d93-bc61-7d626f841f69'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:17.778497 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Network hostable DHCP agents. Network: 7d6930e9-40f9-4d93-bc61-7d626f841f69, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:24:17.796927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-671de410-8a0d-4796-8288-b3384d6b2746 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2c28402f-88e8-4dde-b19c-42ca4642b977,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:17.807186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:17.817764 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Sync routers for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:17.819104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-5fd6c6dc-f430-4bba-9614-e45cc3eeb193 None None] Port a0de3123-62f5-41a9-921c-6e2250a89def cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:17.823745 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dc05d462-5d66-4d50-8f94-9e138d621365 admin admin] 10.222.0.57 "PUT /v2.0/routers/67c47c57-09e4-4303-97e1-a2215115ce2a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.3123991 Dec 10 14:24:17.838935 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:17.839385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 2, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:17.839609 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:17.841314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-671de410-8a0d-4796-8288-b3384d6b2746 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.842643 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-671de410-8a0d-4796-8288-b3384d6b2746 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9852192 Dec 10 14:24:17.846904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.850826 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52370) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:17.859431 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:17.895145 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Checking router: 196472fe-b965-4c82-9c4d-82a1d2dbdf83 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:24:17.896331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Updating router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:24:17.930030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a98b7c4e-6b43-4945-87ef-560059ea48ae triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:17.931692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.949457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Network 7d6930e9-40f9-4d93-bc61-7d626f841f69 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:24:17.974506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:17.999647 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.013468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52374) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:18.036707 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:18.082364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 7d6930e9-40f9-4d93-bc61-7d626f841f69) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:18.088622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7b128b3f-9ab4-4daf-9d44-234a9bf88cb7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.111778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:18.112382 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.120564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52376) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:18.141332 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99de2eea-e041-429c-8673-9214368e910e None None] Network 7d6930e9-40f9-4d93-bc61-7d626f841f69 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:18.154097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.177203 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Router e8738d6c-652a-4667-af80-8c05773ef93c is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:24:18.263277 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.322084 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7b128b3f-9ab4-4daf-9d44-234a9bf88cb7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.384573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port a98b7c4e-6b43-4945-87ef-560059ea48ae, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a98b7c4e-6b43-4945-87ef-560059ea48ae,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:18.487831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f5d1586-bddb-4111-abf5-23d4a2eb6b4e None None] Network 7d6930e9-40f9-4d93-bc61-7d626f841f69 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:18.556126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.558980 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4d181cd-97c1-4460-a212-39807e75d9f6 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:18.574792 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:14Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'd68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d', 'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'mac_address': 'fa:16:3e:92:7a:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:12Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 2, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'subnets': [{'id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:18.576580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7b128b3f-9ab4-4daf-9d44-234a9bf88cb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.587330 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8c95c91b-ef05-4fb7-87d0-7c93016101a3 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 4.0323079 Dec 10 14:24:18.618726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52396) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:18.624729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Request body: {'floatingip': {'floating_network_id': '7d6930e9-40f9-4d93-bc61-7d626f841f69'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:18.632234 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Checking router: 67c47c57-09e4-4303-97e1-a2215115ce2a for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:24:18.633046 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Updating router 67c47c57-09e4-4303-97e1-a2215115ce2a port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:24:18.734812 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.791889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-00516d73-88fc-43eb-9771-249cb57bc36a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.812229 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7b128b3f-9ab4-4daf-9d44-234a9bf88cb7 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=e7567be8a6a941a0a40d733576d63f3f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7952986 Dec 10 14:24:18.855177 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=a98b7c4e-6b43-4945-87ef-560059ea48ae,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:18.882527 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52400) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:18.885929 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b128b3f-9ab4-4daf-9d44-234a9bf88cb7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=21811099-8404-4636-a95d-e71392033fa4,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:18.890453 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port f4d181cd-97c1-4460-a212-39807e75d9f6 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:18.890453 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.898020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.958361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.967126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-00516d73-88fc-43eb-9771-249cb57bc36a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:18.980007 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:19.038313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-00516d73-88fc-43eb-9771-249cb57bc36a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.111048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Sync routers for ids ['e8738d6c-652a-4667-af80-8c05773ef93c'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:19.118085 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.118283 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.119370 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9a8daa03-a16d-49bf-b658-298263cea48f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 875 time: 5.2339430 Dec 10 14:24:19.129025 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-00516d73-88fc-43eb-9771-249cb57bc36a admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=d2507cb1a1f94b44aec21f8392b84021&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0074832 Dec 10 14:24:19.130692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52404) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:19.133186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52406) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:19.151222 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00516d73-88fc-43eb-9771-249cb57bc36a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe946757-dd78-4c7a-95e9-dad52bb46e10,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:19.181225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Routers {'e8738d6c-652a-4667-af80-8c05773ef93c'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:19.182966 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e8738d6c-652a-4667-af80-8c05773ef93c'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:19.280966 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e187adc-b526-4b32-91cb-8cc6a6857a91 None None] Pushing event updated for resources: {'Port': ['ID=452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:19.402981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.417952 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Attempting to bind port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:19.418318 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Attempting to bind port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:19.418672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Attempting to bind port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 on network 1cc2d855-81bd-4d95-a565-455c7130be80 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:19.429101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a98b7c4e-6b43-4945-87ef-560059ea48ae up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:19.458620 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.465305 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:19.465761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Checking segment: {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:19.466165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.466558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Bound using segment: {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:19.467046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Bound port: 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:19.467425 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.498425 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Set router e8738d6c-652a-4667-af80-8c05773ef93c gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:19.552021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dae2f80c-693d-4765-a63f-6780c6a24f48 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.554061 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52416) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:19.569270 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.601593 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.678228 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c2157ca9-58c2-4518-b531-b2666816661f None None] Provisioning complete for port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:19.678592 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c2157ca9-58c2-4518-b531-b2666816661f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.681301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.693757 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dae2f80c-693d-4765-a63f-6780c6a24f48 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.697606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.715178 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91170743-7c16-4b84-baa9-c6d1b2e2b054 None None] Pushing event updated for resources: {'Port': ['ID=d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:19.789195 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Attempting to bind port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:19.789595 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Attempting to bind port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:19.789965 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Attempting to bind port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d on network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:19.802056 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:19.806497 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Checking segment: {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:19.807094 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.807639 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Bound using segment: {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:19.808307 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Bound port: d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:19.808858 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.818299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] For port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:19.827029 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Deleting port f7311e2e-fc3f-4749-9512-8d4cf8ba0b58 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:19.829228 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] For port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:19.830112 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.836192 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Allocated IP 172.26.2.92 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/4cd3dc5b-2842-490d-b8c8-d5f38ff8da7a) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:19.838430 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a98b7c4e-6b43-4945-87ef-560059ea48ae triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:19.838801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.840287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c2157ca9-58c2-4518-b531-b2666816661f None None] Port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:19.925670 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] For port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:19.929710 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] For port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:19.934909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.970449 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.981801 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.982805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Calling delete_port for f7311e2e-fc3f-4749-9512-8d4cf8ba0b58 owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:19.983415 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:19.996757 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-80147b3e-e2ee-4f41-a878-998d6db95b9b tempest-AgentManagementNegativeTest-613006774 tempest-AgentManagementNegativeTest-613006774-project] 10.222.0.57 "GET /v2.0/agents HTTP/1.1" status: 200 len: 207 time: 0.4182880 Dec 10 14:24:20.051002 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e8c09681-c291-4ca1-940c-9bea1874b1dc None None] Provisioning complete for port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:20.051371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e8c09681-c291-4ca1-940c-9bea1874b1dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.054685 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e187adc-b526-4b32-91cb-8cc6a6857a91 None None] Pushing event updated for resources: {'Port': ['ID=452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:20.065658 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.102263 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:20.102904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:20.136637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cbd6be5f-7858-42d2-9803-0f0f427520d9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.168101 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:20.168995 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:20.195780 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cbd6be5f-7858-42d2-9803-0f0f427520d9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.247190 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8738d6c-652a-4667-af80-8c05773ef93c', 'name': '', 'tenant_id': '605cf5d3d75a473d8c1129a632d22119', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '1f39510d-3919-43a8-9043-42d45461ec86', 'external_fixed_ips': [{'subnet_id': 'c533932d-616a-4e39-bbc4-1c22f04bd3bf', 'ip_address': '172.20.0.6'}], 'enable_snat': True}, 'gw_port_id': 'f7311e2e-fc3f-4749-9512-8d4cf8ba0b58', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:14Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 3, 'project_id': '605cf5d3d75a473d8c1129a632d22119', 'gw_port': {'id': 'f7311e2e-fc3f-4749-9512-8d4cf8ba0b58', 'name': '', 'network_id': '1f39510d-3919-43a8-9043-42d45461ec86', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:81:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8738d6c-652a-4667-af80-8c05773ef93c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': 'c533932d-616a-4e39-bbc4-1c22f04bd3bf', 'ip_address': '172.20.0.6', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c533932d-616a-4e39-bbc4-1c22f04bd3bf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:20.262023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e8c09681-c291-4ca1-940c-9bea1874b1dc None None] Port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:20.289406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52422) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:20.324681 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Checking router: e8738d6c-652a-4667-af80-8c05773ef93c for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:24:20.325286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Updating router e8738d6c-652a-4667-af80-8c05773ef93c port f7311e2e-fc3f-4749-9512-8d4cf8ba0b58 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:24:20.332157 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:20.342329 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-848ee9b4-56d1-41f0-8596-2fa5e865a8f4 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1285681323', 'description': 'tempest-description--1255068337'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:20.381134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cbd6be5f-7858-42d2-9803-0f0f427520d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.388482 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cbd6be5f-7858-42d2-9803-0f0f427520d9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.390243 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cbd6be5f-7858-42d2-9803-0f0f427520d9 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/fe946757-dd78-4c7a-95e9-dad52bb46e10 HTTP/1.1" status: 204 len: 168 time: 1.2331872 Dec 10 14:24:20.446584 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.491035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.500119 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:20.533045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7b3719a9-558d-405f-8f28-9844e3bfff9e None None] Provisioning complete for port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:20.533982 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7b3719a9-558d-405f-8f28-9844e3bfff9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.573572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Pushing event updated for resources: {'Port': ['ID=a0de3123-62f5-41a9-921c-6e2250a89def,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:20.592951 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91170743-7c16-4b84-baa9-c6d1b2e2b054 None None] Pushing event updated for resources: {'Port': ['ID=d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:20.601387 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.631591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.651956 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event deleted for resources: {'Port': ['ID=f7311e2e-fc3f-4749-9512-8d4cf8ba0b58,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:20.704853 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:20.718221 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:20.725114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbd6be5f-7858-42d2-9803-0f0f427520d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe946757-dd78-4c7a-95e9-dad52bb46e10,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:20.757105 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dae2f80c-693d-4765-a63f-6780c6a24f48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.760992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dae2f80c-693d-4765-a63f-6780c6a24f48 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.762700 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dae2f80c-693d-4765-a63f-6780c6a24f48 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/21811099-8404-4636-a95d-e71392033fa4 HTTP/1.1" status: 204 len: 168 time: 1.8691990 Dec 10 14:24:20.776575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.781170 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:14Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'd68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d', 'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'mac_address': 'fa:16:3e:92:7a:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:12Z', 'updated_at': '2021-12-10T14:24:19Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'subnets': [{'id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:20.864239 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dee2935-6ab7-44ce-bb8e-31910e265587 None None] The sync data for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv is: [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:14Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'd68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d', 'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'mac_address': 'fa:16:3e:92:7a:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:12Z', 'updated_at': '2021-12-10T14:24:19Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'subnets': [{'id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:20.886600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.892835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae2f80c-693d-4765-a63f-6780c6a24f48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=21811099-8404-4636-a95d-e71392033fa4,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:20.898813 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:20.902810 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52432) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:20.918874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.005312 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-848ee9b4-56d1-41f0-8596-2fa5e865a8f4 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.051356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:21.100411 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:21.104456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7b3719a9-558d-405f-8f28-9844e3bfff9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.126687 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:21.163508 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.164040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Fanout notify agent at l3_agent the message router_deleted on router e8738d6c-652a-4667-af80-8c05773ef93c {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:24:21.168698 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.170047 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-38c79215-d1c0-4b3b-bd04-60867951cba6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "DELETE /v2.0/routers/e8738d6c-652a-4667-af80-8c05773ef93c HTTP/1.1" status: 204 len: 168 time: 2.0319917 Dec 10 14:24:21.173387 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52436) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:21.247052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Pushing event updated for resources: {'Port': ['ID=4cd3dc5b-2842-490d-b8c8-d5f38ff8da7a,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:21.258894 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-1dff454d-7bf8-402d-a311-2ec6872813e7 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Deleting subnet c533932d-616a-4e39-bbc4-1c22f04bd3bf {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:24:21.334994 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Allocated IP 172.20.0.10 (7d6930e9-40f9-4d93-bc61-7d626f841f69/92f44727-cbb1-443f-bd14-a235df73e588/10076e38-8a01-4d38-b4c5-c711f79d0db3) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:21.370862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:24:21.386992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.408906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7b3719a9-558d-405f-8f28-9844e3bfff9e None None] For port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:21.440642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52440) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:21.495247 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7b3719a9-558d-405f-8f28-9844e3bfff9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.523368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-848ee9b4-56d1-41f0-8596-2fa5e865a8f4 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.546980 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:19Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:21.571394 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-78926aaa-b1fd-424c-8b0e-210f6d3e854b admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=29b4009c6fc44735a7c182afd26ef65a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1266701 Dec 10 14:24:21.572196 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52442) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:21.620839 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-716c25a8-56fd-435f-9f97-6d7321367513 None None] The sync data for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv is: [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:19Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:21.648463 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-848ee9b4-56d1-41f0-8596-2fa5e865a8f4 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.652187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:21.703593 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-91e8a0eb-f31f-41c9-a44a-b67b6fee0a00 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.735508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.748155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b3719a9-558d-405f-8f28-9844e3bfff9e None None] Pushing event updated for resources: {'Port': ['ID=452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:21.759407 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:24:21.767847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:24:21.769563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1dff454d-7bf8-402d-a311-2ec6872813e7 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.771371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-84504b14-0261-446f-aadf-2846177b25db None None] Provisioning complete for port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:21.771882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-84504b14-0261-446f-aadf-2846177b25db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.792305 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-58d780dc-8f2e-419b-8351-9399cde99d0f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.801499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-848ee9b4-56d1-41f0-8596-2fa5e865a8f4 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f3a20060-d794-4212-9975-ddb1ce5af055,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:21.813625 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-91e8a0eb-f31f-41c9-a44a-b67b6fee0a00 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.877199 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:21.877996 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.890446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1dff454d-7bf8-402d-a311-2ec6872813e7 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.945809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-848ee9b4-56d1-41f0-8596-2fa5e865a8f4 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.948108 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-848ee9b4-56d1-41f0-8596-2fa5e865a8f4 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.6425021 Dec 10 14:24:21.955497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52450) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:21.956967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:21.964764 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9e4a5b56-d47b-417d-985f-e11d20b01f04 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Request body: {'security_group_rule': {'security_group_id': 'f3a20060-d794-4212-9975-ddb1ce5af055', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:21.969890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-84504b14-0261-446f-aadf-2846177b25db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.001485 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:22.001873 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1dff454d-7bf8-402d-a311-2ec6872813e7 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.023810 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c68bf051-ceee-4dcd-bc22-58e6a0cdc582 admin admin] 10.222.0.57 "PUT /v2.0/routers/6b7d9a03-a75e-4f11-8074-0360686c8ab9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.8330097 Dec 10 14:24:22.042783 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Sync routers for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:22.057043 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:22.062649 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:22.127727 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:22.148259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-84504b14-0261-446f-aadf-2846177b25db None None] For port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:22.158700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.175438 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-58d780dc-8f2e-419b-8351-9399cde99d0f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.204125 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1dff454d-7bf8-402d-a311-2ec6872813e7 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.234944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-84504b14-0261-446f-aadf-2846177b25db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.247490 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dff454d-7bf8-402d-a311-2ec6872813e7 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=c533932d-616a-4e39-bbc4-1c22f04bd3bf,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:22.257862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-91e8a0eb-f31f-41c9-a44a-b67b6fee0a00 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.262049 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-91e8a0eb-f31f-41c9-a44a-b67b6fee0a00 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.263859 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-91e8a0eb-f31f-41c9-a44a-b67b6fee0a00 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/c9c2d701-79f6-4cec-b41a-342f8ef7707b HTTP/1.1" status: 204 len: 168 time: 0.6905034 Dec 10 14:24:22.281905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e8a0eb-f31f-41c9-a44a-b67b6fee0a00 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9c2d701-79f6-4cec-b41a-342f8ef7707b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:22.285021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'Port': ['ID=10076e38-8a01-4d38-b4c5-c711f79d0db3,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:22.296566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Network 7d6930e9-40f9-4d93-bc61-7d626f841f69 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:22.302932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-58d780dc-8f2e-419b-8351-9399cde99d0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.304597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:22.310752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:22.328874 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:22.351631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1dff454d-7bf8-402d-a311-2ec6872813e7 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.359004 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1dff454d-7bf8-402d-a311-2ec6872813e7 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "DELETE /v2.0/subnets/c533932d-616a-4e39-bbc4-1c22f04bd3bf HTTP/1.1" status: 204 len: 168 time: 1.1806359 Dec 10 14:24:22.394281 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-58d780dc-8f2e-419b-8351-9399cde99d0f admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=0870dac85051451c946acbd5cb81f87d&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4888978 Dec 10 14:24:22.395326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52462) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:22.396522 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d780dc-8f2e-419b-8351-9399cde99d0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b8ae42c-c90a-49c1-abe1-adff6329957d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:22.409401 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Port f7311e2e-fc3f-4749-9512-8d4cf8ba0b58 not found while updating agent binding for router e8738d6c-652a-4667-af80-8c05773ef93c. {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:216}} Dec 10 14:24:22.427201 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-84504b14-0261-446f-aadf-2846177b25db None None] Provisioning complete for port a0de3123-62f5-41a9-921c-6e2250a89def triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:22.427201 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-84504b14-0261-446f-aadf-2846177b25db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.432737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52466) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:22.439390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e4a5b56-d47b-417d-985f-e11d20b01f04 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.542854 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:22.542854 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.546894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84504b14-0261-446f-aadf-2846177b25db None None] Pushing event updated for resources: {'Port': ['ID=d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:22.620079 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Routers set() bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:22.620986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Router IDs set() for agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 10 14:24:22.621686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_agentschedulers_db [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'e8738d6c-652a-4667-af80-8c05773ef93c'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent'). {{(pid=103812) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 10 14:24:22.624830 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5658e6af-3701-41b9-b5a7-d8bc06da2919 None None] The sync data for ids ['e8738d6c-652a-4667-af80-8c05773ef93c'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:22.653045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-84504b14-0261-446f-aadf-2846177b25db None None] Port a0de3123-62f5-41a9-921c-6e2250a89def cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:22.700597 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.753871 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e4a5b56-d47b-417d-985f-e11d20b01f04 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.769652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c413717e-16ad-444f-8ee3-07e2b79e1e30 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.773352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.840752 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c413717e-16ad-444f-8ee3-07e2b79e1e30 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.872192 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.887190 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e4a5b56-d47b-417d-985f-e11d20b01f04 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.891736 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a0de3123-62f5-41a9-921c-6e2250a89def', 'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'mac_address': 'fa:16:3e:e1:ab:1b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_interface', 'standard_attr_id': 125, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 2, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'subnets': [{'id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:22.933761 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52476) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:22.942600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e4a5b56-d47b-417d-985f-e11d20b01f04 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3289711a-1960-4882-9d47-0029393ff6bf,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:22.950408 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d0a16191-d066-45cb-b359-e1cb376dd3ce tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Request body: {'security_group': {'name': 'tempest-securitygroup--271162362', 'description': 'tempest-description--323399388'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:22.957640 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Checking router: 6b7d9a03-a75e-4f11-8074-0360686c8ab9 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:24:22.958212 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Updating router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 port a0de3123-62f5-41a9-921c-6e2250a89def binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:24:22.962250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.978135 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.992787 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e4a5b56-d47b-417d-985f-e11d20b01f04 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:22.996081 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9e4a5b56-d47b-417d-985f-e11d20b01f04 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.0377276 Dec 10 14:24:23.120354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52478) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:23.122635 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52484) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:23.200353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-dd3876ae-eda2-43c2-b63f-ec8bda5b9e7f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Request body: {'security_group_rule': {'security_group_id': 'f3a20060-d794-4212-9975-ddb1ce5af055', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:23.236450 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.237216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.243148 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d0a16191-d066-45cb-b359-e1cb376dd3ce tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.261941 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1f39510d-3919-43a8-9043-42d45461ec86']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:23.274526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '11f51139-fc96-40a1-9112-dadafbd3efab') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:23.275421 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '11f51139-fc96-40a1-9112-dadafbd3efab') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:23.288480 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.291261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c413717e-16ad-444f-8ee3-07e2b79e1e30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.295020 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c413717e-16ad-444f-8ee3-07e2b79e1e30 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.296659 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c413717e-16ad-444f-8ee3-07e2b79e1e30 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/2b8ae42c-c90a-49c1-abe1-adff6329957d HTTP/1.1" status: 204 len: 168 time: 0.8454003 Dec 10 14:24:23.313543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Pushing event updated for resources: {'Port': ['ID=4cd3dc5b-2842-490d-b8c8-d5f38ff8da7a,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:23.317971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c413717e-16ad-444f-8ee3-07e2b79e1e30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b8ae42c-c90a-49c1-abe1-adff6329957d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:23.320428 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.328095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Releasing vlan 390 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:23.328721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:23.331952 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:23.339207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd3876ae-eda2-43c2-b63f-ec8bda5b9e7f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.413781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:23.451339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.453306 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-913154a3-38df-42eb-9f9c-c4d12a14fbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.6011782 Dec 10 14:24:23.490744 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.511912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:23.512478 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.541457 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.550003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd3876ae-eda2-43c2-b63f-ec8bda5b9e7f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.550624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 1f39510d-3919-43a8-9043-42d45461ec86 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 10 14:24:23.559982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.563976 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.573389 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.577794 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "DELETE /v2.0/networks/1f39510d-3919-43a8-9043-42d45461ec86 HTTP/1.1" status: 204 len: 168 time: 1.1634746 Dec 10 14:24:23.578875 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c9511f-c35c-4faa-8b9d-8008b5bfea17 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event deleted for resources: {'Network': ['ID=1f39510d-3919-43a8-9043-42d45461ec86,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:23.590319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d0a16191-d066-45cb-b359-e1cb376dd3ce tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.620577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd3876ae-eda2-43c2-b63f-ec8bda5b9e7f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.643045 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3876ae-eda2-43c2-b63f-ec8bda5b9e7f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c11a82c2-767b-4aba-ace8-57b0e6249b20,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:23.651978 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:23.669511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Request body: {'network': {'name': 'tempest-FloatingIPNegativeTestJSON-test-network-1730852619'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:23.678402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.705099 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c1e77c-a8b6-49e9-8b61-e55e9bfa0899 None None] Pushing event updated for resources: {'Port': ['ID=a0de3123-62f5-41a9-921c-6e2250a89def,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:23.758701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:23.759324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.776541 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'Port': ['ID=10076e38-8a01-4d38-b4c5-c711f79d0db3,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:23.778653 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Attempting to bind port a0de3123-62f5-41a9-921c-6e2250a89def on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:23.783296 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Attempting to bind port a0de3123-62f5-41a9-921c-6e2250a89def by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:23.783296 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Attempting to bind port a0de3123-62f5-41a9-921c-6e2250a89def on network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:23.793006 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:23.795085 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Checking segment: {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:23.798851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d0a16191-d066-45cb-b359-e1cb376dd3ce tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.799282 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.800007 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Bound using segment: {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:23.801246 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Bound port: a0de3123-62f5-41a9-921c-6e2250a89def, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:23.802345 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.826257 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd3876ae-eda2-43c2-b63f-ec8bda5b9e7f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.834035 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dd3876ae-eda2-43c2-b63f-ec8bda5b9e7f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6488781 Dec 10 14:24:23.837355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52500) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:23.842781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:23.872369 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:24:23.876316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.895748 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] For port a0de3123-62f5-41a9-921c-6e2250a89def, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:23.903240 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] For port a0de3123-62f5-41a9-921c-6e2250a89def, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a0de3123-62f5-41a9-921c-6e2250a89def,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:23.924286 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a16191-d066-45cb-b359-e1cb376dd3ce tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Pushing event updated for resources: {'SecurityGroup': ['ID=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:23.982447 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Made reservation on behalf of e68e4d52db984b87ab42e0ca79c7de4c for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:23.983074 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:23.992240 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.016173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-42724cc2-861c-4d80-b944-8bee638ab761 None None] Provisioning complete for port a0de3123-62f5-41a9-921c-6e2250a89def triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:24.017786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-42724cc2-861c-4d80-b944-8bee638ab761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.019324 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.146423 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c1e77c-a8b6-49e9-8b61-e55e9bfa0899 None None] Pushing event updated for resources: {'Port': ['ID=a0de3123-62f5-41a9-921c-6e2250a89def,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:24.156098 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:24.156747 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:24.160414 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d0a16191-d066-45cb-b359-e1cb376dd3ce tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.164083 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d0a16191-d066-45cb-b359-e1cb376dd3ce tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 1.2287664 Dec 10 14:24:24.167069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52520) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:24.176887 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-6f24a008-53f2-490c-b6f7-a3063e1bbd62 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Request body: {'security_group_rule': {'security_group_id': '59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:24.232545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-42724cc2-861c-4d80-b944-8bee638ab761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.234123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.255972 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.272132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-42724cc2-861c-4d80-b944-8bee638ab761 None None] For port a0de3123-62f5-41a9-921c-6e2250a89def, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a0de3123-62f5-41a9-921c-6e2250a89def,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:24.346549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.370354 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:24.386679 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-42724cc2-861c-4d80-b944-8bee638ab761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.444967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.451410 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-661131af-2264-4f09-bc2f-cad13868be99 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.8312314 Dec 10 14:24:24.456857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52528) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:24.457365 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] vlan segment allocate from pool success with {'vlan_id': 376, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:24.476906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event updated for resources: {'SecurityGroup': ['ID=94564528-0c2c-477d-ac03-339269b049de,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:24.516339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.522557 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Added segment a6a42e1b-53b7-4681-a37c-f889e0fbbbfa of type vlan for network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 Dec 10 14:24:24.581156 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6f24a008-53f2-490c-b6f7-a3063e1bbd62 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.590451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-67602341-ff46-4a12-9d9b-e316d00b21b9 None None] Provisioning complete for port a0de3123-62f5-41a9-921c-6e2250a89def triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:24.590928 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-67602341-ff46-4a12-9d9b-e316d00b21b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.621748 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d3e9ddc0-54b4-4f1a-b792-5a417d2a9623 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "GET /v2.0/floatingips?floating_network_id=7d6930e9-40f9-4d93-bc61-7d626f841f69 HTTP/1.1" status: 200 len: 690 time: 0.1614697 Dec 10 14:24:24.621748 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52540) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:24.626294 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52542) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:24.649633 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6f24a008-53f2-490c-b6f7-a3063e1bbd62 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.663014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-25accca6-f293-482c-af62-d661449ec7a3 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'router': {'name': 'tempest-router--615977018', 'project_id': 'b02f4ff7a4904f3c8c6204ef01563625'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:24.672115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.689931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42724cc2-861c-4d80-b944-8bee638ab761 None None] Pushing event updated for resources: {'Port': ['ID=a0de3123-62f5-41a9-921c-6e2250a89def,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:24.703176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.749452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6f24a008-53f2-490c-b6f7-a3063e1bbd62 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.781294 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-25accca6-f293-482c-af62-d661449ec7a3 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.782521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-25accca6-f293-482c-af62-d661449ec7a3 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.794053 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f24a008-53f2-490c-b6f7-a3063e1bbd62 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=66aec628-371f-47af-8231-e6d92f6c1b71,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:24.822465 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a0de3123-62f5-41a9-921c-6e2250a89def', 'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'mac_address': 'fa:16:3e:e1:ab:1b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_interface', 'standard_attr_id': 125, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:23Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'subnets': [{'id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:24.860937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.883372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6f24a008-53f2-490c-b6f7-a3063e1bbd62 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.893042 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6f24a008-53f2-490c-b6f7-a3063e1bbd62 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7244148 Dec 10 14:24:24.894918 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52548) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:24.897490 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c967e5a5-5872-426a-8f4b-ef03fea77d75 None None] The sync data for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv is: [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a0de3123-62f5-41a9-921c-6e2250a89def', 'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'mac_address': 'fa:16:3e:e1:ab:1b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_interface', 'standard_attr_id': 125, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:23Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'subnets': [{'id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:24.923467 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.931134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:24.932160 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:24.938566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c173385d-e3eb-4698-820f-99453b4d8943 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Request body: {'security_group_rule': {'security_group_id': '59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:24.995603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-25accca6-f293-482c-af62-d661449ec7a3 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.010886 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Allocated IP 172.26.2.178 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/b49a1f0f-6a2c-4141-8c6d-206654b5efc9) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:25.112404 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-25accca6-f293-482c-af62-d661449ec7a3 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.147095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c173385d-e3eb-4698-820f-99453b4d8943 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.166333 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52558) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:25.188917 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 2.0023818 Dec 10 14:24:25.192105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52560) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:25.194520 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 10 14:24:25.200618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4b2e2f-7a73-49bf-bc7d-bd6cd3b5ce51 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event updated for resources: {'Network': ['ID=7a7d6fbc-4574-4686-8d7f-b0c28ab87c25,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:25.203908 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Request body: {'subnet': {'network_id': '7a7d6fbc-4574-4686-8d7f-b0c28ab87c25', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:25.213558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:25.234609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-25accca6-f293-482c-af62-d661449ec7a3 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.238373 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-25accca6-f293-482c-af62-d661449ec7a3 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.5838780 Dec 10 14:24:25.242409 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52562) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:25.283303 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.294847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Deleting port 10076e38-8a01-4d38-b4c5-c711f79d0db3 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:25.295180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.348131 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c173385d-e3eb-4698-820f-99453b4d8943 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.351296 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cc14257c-1600-4aa1-9794-a7246c9131ff tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-securitygroup--622989828&fields=id&tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a HTTP/1.1" status: 200 len: 267 time: 0.1611426 Dec 10 14:24:25.407024 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c173385d-e3eb-4698-820f-99453b4d8943 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.418785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-89565d96-16d5-47a4-9325-3fcdb3d91968 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.426811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c173385d-e3eb-4698-820f-99453b4d8943 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7caef5c3-6d89-4144-9492-5ca67008666a,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:25.432684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Made reservation on behalf of e68e4d52db984b87ab42e0ca79c7de4c for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:25.436620 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.493502 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.554606 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:25.560500 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c173385d-e3eb-4698-820f-99453b4d8943 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.562320 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c173385d-e3eb-4698-820f-99453b4d8943 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6471784 Dec 10 14:24:25.568546 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:25.570262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52572) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:25.571814 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:25.573733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Pushing event updated for resources: {'Port': ['ID=b49a1f0f-6a2c-4141-8c6d-206654b5efc9,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:25.587943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:25.735765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-89565d96-16d5-47a4-9325-3fcdb3d91968 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.751460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-89565d96-16d5-47a4-9325-3fcdb3d91968 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.768216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.768539 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.807462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:25.814253 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52582) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:25.898449 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.039211 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Calling delete_port for 10076e38-8a01-4d38-b4c5-c711f79d0db3 owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:26.054935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-afdae801-f07d-4e7d-ad5c-b1d7ec61324a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:26.056456 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-afdae801-f07d-4e7d-ad5c-b1d7ec61324a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 811 time: 0.7043850 Dec 10 14:24:26.057898 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.081907 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5023a788-9657-4feb-b68a-0a11dbeddfc9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/quotas/5f6602a0e1ae4bc9b52f0259e63b6e7a HTTP/1.1" status: 200 len: 375 time: 0.0152607 Dec 10 14:24:26.102286 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Checking segment: {'id': 'a6a42e1b-53b7-4681-a37c-f889e0fbbbfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 376, 'network_id': '7a7d6fbc-4574-4686-8d7f-b0c28ab87c25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:26.102650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Network hostable DHCP agents. Network: 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:24:26.118131 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event updated for resources: {'Subnet': ['ID=0289a702-c4d2-4f4f-a3d1-eeb68609f52b,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:26.172639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-test-network-1346403416'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:26.210844 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52590) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:26.225003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-89565d96-16d5-47a4-9325-3fcdb3d91968 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.225543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89565d96-16d5-47a4-9325-3fcdb3d91968 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Fanout notify agent at l3_agent the message router_deleted on router afbdcec5-81d7-4cd5-aee8-2f0c1d41fcdd {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:24:26.226903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.255307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-89565d96-16d5-47a4-9325-3fcdb3d91968 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.259415 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-89565d96-16d5-47a4-9325-3fcdb3d91968 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "DELETE /v2.0/routers/afbdcec5-81d7-4cd5-aee8-2f0c1d41fcdd HTTP/1.1" status: 204 len: 168 time: 1.0121665 Dec 10 14:24:26.271058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:24:26.312095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Made reservation on behalf of c2a7c581de164ccf910afaf96add3a69 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:26.318738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.325368 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-20ca2190-b134-40ab-81a7-e77d3d8d2b89 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2134571 Dec 10 14:24:26.366818 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.420835 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-cc40d153-2261-4a61-8600-9ea821eddab6 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-1793416532'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:26.421293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-cc40d153-2261-4a61-8600-9ea821eddab6 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Unknown quota resources ['metering_label']. {{(pid=103810) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 10 14:24:26.485936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:26.490945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.491802 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:26.492499 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.499742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d34c50b-e256-43e8-9031-8c324c8966f3 None None] Network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:26.552723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-211dd10b-92aa-444e-b849-21570ad32120 service neutron] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:24:26.554160 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-211dd10b-92aa-444e-b849-21570ad32120 service neutron] 10.222.0.57 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0749199 Dec 10 14:24:26.591489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.653742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-7a7d6fbc-4574-4686-8d7f-b0c28ab87c25', 'network_id': '7a7d6fbc-4574-4686-8d7f-b0c28ab87c25', 'project_id': 'e68e4d52db984b87ab42e0ca79c7de4c', 'fixed_ips': [{'subnet_id': '0289a702-c4d2-4f4f-a3d1-eeb68609f52b'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:24:26.655093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.716801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.773285 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52602) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:26.773468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event deleted for resources: {'Port': ['ID=10076e38-8a01-4d38-b4c5-c711f79d0db3,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:26.796626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Allocated IP 172.26.2.196 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/89bb69a3-59a1-4bb9-a0ba-5d64500adf8f) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:26.828313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc40d153-2261-4a61-8600-9ea821eddab6 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.829530 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cc40d153-2261-4a61-8600-9ea821eddab6 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 478 time: 0.6176839 Dec 10 14:24:26.839848 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-681c4db1-6ac3-452f-99b4-dcd56561289f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6418524 Dec 10 14:24:26.841676 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52606) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:26.842010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52608) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:26.848205 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5ef44e81-2803-47e5-b3b3-0c40d9897c35 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd02::/64', 'direction': 'ingress', 'metering_label_id': '59c45306-0f7c-42e2-8fe1-619005c3f860'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:26.848632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5ef44e81-2803-47e5-b3b3-0c40d9897c35 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103810) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 10 14:24:26.857932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4b3a7db7-9454-4370-bbf9-16d322f9073b tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Request body: {'router': {'name': 'tempest-FloatingIPNegativeTestJSON-router-1054138818', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:26.863330 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Allocated IP 172.20.0.2 (7a7d6fbc-4574-4686-8d7f-b0c28ab87c25/0289a702-c4d2-4f4f-a3d1-eeb68609f52b/7cf24920-e7c8-495b-b85d-44cbb7287549) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:26.865604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:26.946067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.045271 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-90eb3eeb-6415-4256-bc28-4822d435e8d5 service neutron] 10.222.0.57 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4655015 Dec 10 14:24:27.063715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.071888 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Pushing event updated for resources: {'Port': ['ID=b49a1f0f-6a2c-4141-8c6d-206654b5efc9,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:27.089105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1657553797', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:27.096216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.103938 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.services.metering.metering_plugin [None req-5ef44e81-2803-47e5-b3b3-0c40d9897c35 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 10 14:24:27.105776 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.134795 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.140968 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.162993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b3a7db7-9454-4370-bbf9-16d322f9073b tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.164021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b3a7db7-9454-4370-bbf9-16d322f9073b tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.176198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.188441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.189875 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:27.193504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:27.198202 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:27.207353 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Pushing event updated for resources: {'Port': ['ID=7cf24920-e7c8-495b-b85d-44cbb7287549,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:27.228039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ef44e81-2803-47e5-b3b3-0c40d9897c35 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.229282 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5ef44e81-2803-47e5-b3b3-0c40d9897c35 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.3862379 Dec 10 14:24:27.237133 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52612) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:27.237692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] vlan segment allocate from pool success with {'vlan_id': 397, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:27.244884 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-915be26a-8550-4820-935e-62510b66051c tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd03::/64', 'direction': 'ingress', 'metering_label_id': '59c45306-0f7c-42e2-8fe1-619005c3f860'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:27.245378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-915be26a-8550-4820-935e-62510b66051c tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103811) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 10 14:24:27.264087 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-ca19c683-d471-423c-a620-b6ee341d7b0c service neutron] 10.222.0.57 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2067919 Dec 10 14:24:27.295559 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Attempting to bind port 7cf24920-e7c8-495b-b85d-44cbb7287549 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:27.296925 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Attempting to bind port 7cf24920-e7c8-495b-b85d-44cbb7287549 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'a6a42e1b-53b7-4681-a37c-f889e0fbbbfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 376, 'network_id': '7a7d6fbc-4574-4686-8d7f-b0c28ab87c25'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:27.297376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Attempting to bind port 7cf24920-e7c8-495b-b85d-44cbb7287549 on network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:27.309951 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:27.313706 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Checking segment: {'id': 'a6a42e1b-53b7-4681-a37c-f889e0fbbbfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 376, 'network_id': '7a7d6fbc-4574-4686-8d7f-b0c28ab87c25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:27.314653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.316882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Bound using segment: {'id': 'a6a42e1b-53b7-4681-a37c-f889e0fbbbfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 376, 'network_id': '7a7d6fbc-4574-4686-8d7f-b0c28ab87c25'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:27.321995 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Bound port: 7cf24920-e7c8-495b-b85d-44cbb7287549, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a6a42e1b-53b7-4681-a37c-f889e0fbbbfa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 376, 'network_id': '7a7d6fbc-4574-4686-8d7f-b0c28ab87c25'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:27.321995 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.335174 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.335534 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Added segment cc4d61a3-bb09-4317-90f0-1e5bb5ebbe81 of type vlan for network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d Dec 10 14:24:27.337337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d901e9e8-16e3-4620-bd36-e8de3c079db8,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:27.341374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b3a7db7-9454-4370-bbf9-16d322f9073b tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.352672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.354626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.355770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.386623 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.395684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=92f44727-cbb1-443f-bd14-a235df73e588,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:27.407882 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.409411 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-57aaed38-b4ef-44e4-8735-c1601c4e43d2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.5706508 Dec 10 14:24:27.423141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.447893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] For port 7cf24920-e7c8-495b-b85d-44cbb7287549, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:27.454235 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] For port 7cf24920-e7c8-495b-b85d-44cbb7287549, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7cf24920-e7c8-495b-b85d-44cbb7287549,segment=NetworkSegment(a6a42e1b-53b7-4681-a37c-f889e0fbbbfa),segment_id=a6a42e1b-53b7-4681-a37c-f889e0fbbbfa)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:27.508884 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.510326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b3a7db7-9454-4370-bbf9-16d322f9073b tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.534354 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a0de3123-62f5-41a9-921c-6e2250a89def up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:27.537883 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.services.metering.metering_plugin [None req-915be26a-8550-4820-935e-62510b66051c tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 10 14:24:27.562237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:27.570620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.573502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:27.619595 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:27.645128 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Pushing event updated for resources: {'Port': ['ID=89bb69a3-59a1-4bb9-a0ba-5d64500adf8f,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:27.666629 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > segment before_delete 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.666979 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.667991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.668339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > port after_create 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.668684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > port after_delete 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.669006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > port after_update 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.669578 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > segment after_delete 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.676051 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.677899 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.678314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.678647 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > subnet after_update 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.690035 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.694043 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:27.694043 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.718427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b3a7db7-9454-4370-bbf9-16d322f9073b tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.726921 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4b3a7db7-9454-4370-bbf9-16d322f9073b tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 715 time: 0.8827131 Dec 10 14:24:27.807190 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52630) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:27.842904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47bb117-ccec-4f48-b8b8-2150f306a12d None None] Pushing event updated for resources: {'Port': ['ID=7cf24920-e7c8-495b-b85d-44cbb7287549,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:27.856862 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a0de3123-62f5-41a9-921c-6e2250a89def triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:27.857452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:27.988607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.989206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.989734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > subnet before_create 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.990207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Subscribe: > subnet before_update 55550000 {{(pid=103811) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 10 14:24:27.990726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7d6930e9-40f9-4d93-bc61-7d626f841f69']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:28.101356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-915be26a-8550-4820-935e-62510b66051c tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.105181 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-915be26a-8550-4820-935e-62510b66051c tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.8611906 Dec 10 14:24:28.105388 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 2.2878084 Dec 10 14:24:28.105910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52652) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:28.106255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52654) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:28.109186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6a7ef721-2fff-4015-b438-d25603e0abf7') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:28.109500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6a7ef721-2fff-4015-b438-d25603e0abf7') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:28.169291 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52658) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:28.175519 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.197547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'subnet': {'network_id': '826f4ffe-6ffa-44c2-a055-d6d8b94c119d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:28.208847 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ce9b96ba-0773-45a6-88aa-c3ab960f46f7 req-db30033c-9e7b-428a-a755-c3a34360258e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 210 time: 0.1531658 Dec 10 14:24:28.240594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.251026 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.263114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Releasing vlan 352 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:28.268349 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: from cryptography.utils import int_from_bytes Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: from cryptography.utils import int_from_bytes Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:28.273378 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:28.316936 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4fe5aef3-d3e8-4c9d-aaf7-f103a6807e55 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-label-rules?id=35c35d04-c61b-44f2-a164-aeb4f246978a HTTP/1.1" status: 200 len: 462 time: 0.2028871 Dec 10 14:24:28.341182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52664) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:28.381865 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cd8e2ad-c4a1-4634-8887-e924a51d10a5 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Network': ['ID=826f4ffe-6ffa-44c2-a055-d6d8b94c119d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:28.401147 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:28.424811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.536512 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-027b335e-cde2-435d-8771-56519c948af5 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-securitygroup--1285681323&fields=id&tenant_id=8f11a2c4cb6b474d81f884b20c96a97b HTTP/1.1" status: 200 len: 267 time: 0.3660743 Dec 10 14:24:28.544966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.693113 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.770751 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event deleted for resources: {'Network': ['ID=7d6930e9-40f9-4d93-bc61-7d626f841f69,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:28.779205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 7d6930e9-40f9-4d93-bc61-7d626f841f69 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 10 14:24:28.792746 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.796975 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1f3ff805-7a44-4fa6-960a-bb7f9aab31ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "DELETE /v2.0/networks/7d6930e9-40f9-4d93-bc61-7d626f841f69 HTTP/1.1" status: 204 len: 168 time: 4.1697717 Dec 10 14:24:28.799911 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52672) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:28.808902 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4c959f6f-7984-4ecf-82c3-38b8f78ec1f9 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:28.816568 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4c959f6f-7984-4ecf-82c3-38b8f78ec1f9 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/networks?id=90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 HTTP/1.1" status: 200 len: 806 time: 0.2689879 Dec 10 14:24:28.839858 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Made reservation on behalf of c2a7c581de164ccf910afaf96add3a69 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:28.844254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:28.904524 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-adf6ca9c-e824-402f-8f05-6d8bfde4c01f tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 1651 time: 0.1032014 Dec 10 14:24:28.916632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52674) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:28.954508 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-cc6f5297-f4ad-4e74-890b-10c9d6b25382 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/quotas/8f11a2c4cb6b474d81f884b20c96a97b HTTP/1.1" status: 200 len: 375 time: 0.1364112 Dec 10 14:24:29.029869 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.089211 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f4ab103d-83da-478f-a999-84e48a2309c4 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.093235 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f4ab103d-83da-478f-a999-84e48a2309c4 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "DELETE /v2.0/metering/metering-label-rules/35c35d04-c61b-44f2-a164-aeb4f246978a HTTP/1.1" status: 204 len: 168 time: 0.7510011 Dec 10 14:24:29.094047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52678) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:29.125645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-481ad3ea-ce04-4952-8f10-50ee83bd0b4c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:29.126210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-481ad3ea-ce04-4952-8f10-50ee83bd0b4c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:29.126660 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-481ad3ea-ce04-4952-8f10-50ee83bd0b4c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:29.127104 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-481ad3ea-ce04-4952-8f10-50ee83bd0b4c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:29.127538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-481ad3ea-ce04-4952-8f10-50ee83bd0b4c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:29.127990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-481ad3ea-ce04-4952-8f10-50ee83bd0b4c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:29.128412 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-481ad3ea-ce04-4952-8f10-50ee83bd0b4c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:29.133902 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-481ad3ea-ce04-4952-8f10-50ee83bd0b4c tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4607 time: 0.2091246 Dec 10 14:24:29.134905 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52680) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:29.144054 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e8ea8cff-ded2-43af-9a09-0e48fddbd342 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-label-rules?id=35c35d04-c61b-44f2-a164-aeb4f246978a HTTP/1.1" status: 200 len: 221 time: 0.0281911 Dec 10 14:24:29.149344 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52682) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:29.158491 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-e6a87571-77dc-414a-bd46-4d3f4a15730c tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=8f11a2c4cb6b474d81f884b20c96a97b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1932600 Dec 10 14:24:29.162611 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.164880 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a14631be-b8b5-4314-9728-29458a316a66 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--1881672273', 'description': 'label created by tempest'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:29.165909 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a14631be-b8b5-4314-9728-29458a316a66 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Unknown quota resources ['metering_label']. {{(pid=103810) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 10 14:24:29.246758 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-0aef7cc0-f1f7-4a2d-9e02-baf009500ec6 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] delete failed (client error): The resource could not be found. Dec 10 14:24:29.247877 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0aef7cc0-f1f7-4a2d-9e02-baf009500ec6 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "DELETE /v2.0/floatingips/a0d1650f-3eda-4373-aa82-23c081486324 HTTP/1.1" status: 404 len: 345 time: 0.0883965 Dec 10 14:24:29.248652 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.250982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52692) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:29.263939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4642a05-4065-451e-aa12-7dfb92eb5cbd None None] Network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:29.347415 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-7a568fab-0fa3-4e04-bebe-87dbb7855d8a tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] DELETE failed (client error): The resource could not be found. Dec 10 14:24:29.348136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7a568fab-0fa3-4e04-bebe-87dbb7855d8a tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:24:29.352471 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7a568fab-0fa3-4e04-bebe-87dbb7855d8a tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "DELETE /v2.0/networks/7d6930e9-40f9-4d93-bc61-7d626f841f69 HTTP/1.1" status: 404 len: 339 time: 0.0990932 Dec 10 14:24:29.358159 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52696) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:29.368683 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Request body: {'network': {'name': 'tempest-network--222275925', 'router:external': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:29.432752 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7cf24920-e7c8-495b-b85d-44cbb7287549 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:29.453276 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ed375585-3a3f-4b9a-8c74-18fc9da43dc1 req-77e4e114-6200-4e33-95ce-fdeff3bc02af tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 210 time: 0.0544944 Dec 10 14:24:29.464249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-9a6c076f-723d-482d-a58a-74c1782d3b36 service neutron] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:24:29.473558 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-9a6c076f-723d-482d-a58a-74c1782d3b36 service neutron] 10.222.0.57 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2328212 Dec 10 14:24:29.475532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Pushing event updated for resources: {'Port': ['ID=89bb69a3-59a1-4bb9-a0ba-5d64500adf8f,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:29.496822 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ecefb3aa-e696-4402-a6f2-ca9cd06e20ea None None] Provisioning complete for port 7cf24920-e7c8-495b-b85d-44cbb7287549 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:29.497192 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ecefb3aa-e696-4402-a6f2-ca9cd06e20ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.540816 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 7cf24920-e7c8-495b-b85d-44cbb7287549 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:29.541456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.549904 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.590508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Made reservation on behalf of 59a690f495a842c49cb3e713f48abcce for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:29.593887 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.634412 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-2e1b01c7-1e8a-4002-bb34-c326dd39157f service neutron] 10.222.0.57 "GET /v2.0/networks/90ab95ca-b6c7-4d4c-8815-86eb5dad26d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1602530 Dec 10 14:24:29.731489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.734200 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5e84c38d-0328-4afc-be5b-54ef3ac5b964 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.1611383 Dec 10 14:24:29.735429 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.748074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] vlan segment allocate from pool success with {'vlan_id': 387, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:29.774051 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-98860a20-147f-45ee-9b51-c41df11a7beb service neutron] 10.222.0.57 "GET /v2.0/networks/90ab95ca-b6c7-4d4c-8815-86eb5dad26d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1358817 Dec 10 14:24:29.775748 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ecefb3aa-e696-4402-a6f2-ca9cd06e20ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.787475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.787881 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Added segment 347cbfb1-8b5e-4307-8930-a37e5efb4c18 of type vlan for network 0402c905-24f5-4163-a28f-96b738646aae Dec 10 14:24:29.863407 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 7cf24920-e7c8-495b-b85d-44cbb7287549, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7cf24920-e7c8-495b-b85d-44cbb7287549,segment=NetworkSegment(a6a42e1b-53b7-4681-a37c-f889e0fbbbfa),segment_id=a6a42e1b-53b7-4681-a37c-f889e0fbbbfa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:29.868989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.937803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.980456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:29.981433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:29.982064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.039795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-ecefb3aa-e696-4402-a6f2-ca9cd06e20ea None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:24:30.041066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-ecefb3aa-e696-4402-a6f2-ca9cd06e20ea None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:24:30.045929 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.059066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=7cf24920-e7c8-495b-b85d-44cbb7287549,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:30.083104 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'Network': ['ID=0402c905-24f5-4163-a28f-96b738646aae,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:30.097935 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1ba76db6-abdc-441d-be56-6fb3a8b793ac tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 0.7343881 Dec 10 14:24:30.098100 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a14631be-b8b5-4314-9728-29458a316a66 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.098100 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a14631be-b8b5-4314-9728-29458a316a66 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 470 time: 0.9422412 Dec 10 14:24:30.098786 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52714) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:30.108608 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52716) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:30.110888 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 0402c905-24f5-4163-a28f-96b738646aae details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:30.120687 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Allocated IP 172.20.0.1 (7a7d6fbc-4574-4686-8d7f-b0c28ab87c25/0289a702-c4d2-4f4f-a3d1-eeb68609f52b/204051b2-60c8-4990-9900-9045b1b76d07) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:30.181976 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.246968 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-05c10973-bee5-457e-a0cd-3cccb96e2606 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-securitygroup--271162362&fields=id&tenant_id=af5207bd54c6403799a8cc223fa0ea80 HTTP/1.1" status: 200 len: 267 time: 0.1947110 Dec 10 14:24:30.259705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.265024 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-283e8fc3-a6d3-4a2b-81fc-e33b46ffa73b tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-labels?id=e78c8a7e-68cf-456e-a885-56b1b1037c18 HTTP/1.1" status: 200 len: 468 time: 0.1547611 Dec 10 14:24:30.281196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52728) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:30.295418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Subnet': ['ID=acea17da-7f1b-4834-9b60-5d797c3b126f,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:30.329826 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-dafe169c-29f0-4acd-b668-9c8f6702fa89 req-75f75f77-17a2-4873-8c55-28ebb57ec58e tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 210 time: 0.1166632 Dec 10 14:24:30.441993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Checking segment: {'id': 'cc4d61a3-bb09-4317-90f0-1e5bb5ebbe81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': '826f4ffe-6ffa-44c2-a055-d6d8b94c119d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:30.442516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network hostable DHCP agents. Network: 826f4ffe-6ffa-44c2-a055-d6d8b94c119d, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:24:30.545270 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.600819 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Allocated IP 172.26.2.6 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/3671be3b-527a-42b5-a9a7-731070cc6394) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:30.672476 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:24:30.716506 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.772978 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-fde294d6-fe79-4024-ac5a-007a4760263c None None] Provisioning complete for port 7cf24920-e7c8-495b-b85d-44cbb7287549 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:30.773665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fde294d6-fe79-4024-ac5a-007a4760263c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.795245 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 826f4ffe-6ffa-44c2-a055-d6d8b94c119d) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:30.813392 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6a90d937-911a-4e71-8bbc-84f4ef7be636 req-dab222f8-a773-430c-a32d-bcf8cfa280c3 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 210 time: 0.0814598 Dec 10 14:24:30.822189 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fff1b627-30cc-4214-b720-b3f08823a7c4 None None] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:30.825240 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4de6074-87ac-4334-b21b-ec173faa885b tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:30.826332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:30.827039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.831704 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4de6074-87ac-4334-b21b-ec173faa885b tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:30.837777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4de6074-87ac-4334-b21b-ec173faa885b tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:30.848134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4de6074-87ac-4334-b21b-ec173faa885b tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:30.848134 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f4de6074-87ac-4334-b21b-ec173faa885b tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2452 time: 0.7466516 Dec 10 14:24:30.855355 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52746) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:30.857065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.869155 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:30.885879 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:30.892465 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:30.917649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event updated for resources: {'Port': ['ID=204051b2-60c8-4990-9900-9045b1b76d07,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:30.954534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:30.971960 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-30d37ae0-b065-4a31-bfb9-9e21310f8204 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:30.977199 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-30d37ae0-b065-4a31-bfb9-9e21310f8204 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/networks?id=8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 HTTP/1.1" status: 200 len: 812 time: 0.7091916 Dec 10 14:24:31.005725 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-94d9cd2c-fa7f-4a51-a923-c8c9497bb2f8 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.8905041 Dec 10 14:24:31.006705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52748) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:31.031357 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-1371131329', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:31.033411 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.037619 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6243b4dd-7d87-4cbc-91f3-ce5d8e1d8fd4 None None] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:31.070673 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bd7de778-bce2-4c47-8e41-57a8f8a5f9c9 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.077805 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bd7de778-bce2-4c47-8e41-57a8f8a5f9c9 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "DELETE /v2.0/metering/metering-labels/e78c8a7e-68cf-456e-a885-56b1b1037c18 HTTP/1.1" status: 204 len: 168 time: 0.7781599 Dec 10 14:24:31.098671 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52750) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:31.151240 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-90673240-a00b-42b0-86c5-aacef52a36f4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/quotas/af5207bd54c6403799a8cc223fa0ea80 HTTP/1.1" status: 200 len: 375 time: 0.1577132 Dec 10 14:24:31.194189 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-607bfa47-d82a-4267-bf3a-33f1bbd42a68 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-labels?id=e78c8a7e-68cf-456e-a885-56b1b1037c18 HTTP/1.1" status: 200 len: 216 time: 0.0893545 Dec 10 14:24:31.202179 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52754) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:31.213280 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.223843 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9e1c3229-65a2-4d87-b781-96645ba82c31 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0184522 Dec 10 14:24:31.237871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-96500674-7ff5-4a55-8fc7-f98aa4e481a5 None None] Provisioning complete for port 204051b2-60c8-4990-9900-9045b1b76d07 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:31.240523 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-96500674-7ff5-4a55-8fc7-f98aa4e481a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.240641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52758) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:31.256187 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-5826e00e-5129-4331-8d0b-850c260f6653 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=af5207bd54c6403799a8cc223fa0ea80&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1040649 Dec 10 14:24:31.297293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.308259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-96500674-7ff5-4a55-8fc7-f98aa4e481a5 None None] Port 204051b2-60c8-4990-9900-9045b1b76d07 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:31.310697 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fce36c76-b8fe-4072-a260-9d50a1611f1c tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0695639 Dec 10 14:24:31.322743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52762) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:31.365087 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:31.375142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:31.386983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:31.392829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.393871 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.405056 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7cf24920-e7c8-495b-b85d-44cbb7287549 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:31.455059 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a369318d-8cd5-4d4a-9ac0-25fd18a37b03 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-labels/59c45306-0f7c-42e2-8fe1-619005c3f860 HTTP/1.1" status: 200 len: 473 time: 0.1332536 Dec 10 14:24:31.459324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52766) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:31.473716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 7cf24920-e7c8-495b-b85d-44cbb7287549 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:31.474083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.493825 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ab1c16c6-f982-4945-a4d0-1dbb0e49feb9 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "GET /v2.0/metering/metering-label-rules/1e21f00a-68da-4c67-a7ae-416fcf64bdc8 HTTP/1.1" status: 200 len: 459 time: 0.0319088 Dec 10 14:24:31.500296 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-511e9c43-8fff-49fa-b94c-c40c71d43f74 req-bfad9d4a-dba8-4f66-a896-7ac403731c4f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 210 time: 0.0822325 Dec 10 14:24:31.500859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52768) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:31.524699 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.528088 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event updated for resources: {'Port': ['ID=3671be3b-527a-42b5-a9a7-731070cc6394,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:31.563544 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0402c905-24f5-4163-a28f-96b738646aae']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:31.579804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '347cbfb1-8b5e-4307-8930-a37e5efb4c18') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:31.580851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '347cbfb1-8b5e-4307-8930-a37e5efb4c18') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:31.582246 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.588200 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-d40edb4c-15f0-489f-9a64-615c19f9c501 service neutron] 10.222.0.57 "GET /v2.0/networks/8a88c7d6-baa3-4bff-a8db-78e7aa6fb066?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3116913 Dec 10 14:24:31.591735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.621146 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.642994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.659140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Releasing vlan 387 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:31.659545 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:31.663045 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:31.804168 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5b6305f-20fd-47a5-b76d-08a7400c9b92 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.809071 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c5b6305f-20fd-47a5-b76d-08a7400c9b92 tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "DELETE /v2.0/metering/metering-label-rules/1e21f00a-68da-4c67-a7ae-416fcf64bdc8 HTTP/1.1" status: 204 len: 168 time: 0.3004768 Dec 10 14:24:31.809220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52774) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:31.824700 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-bcabb1d8-73bb-42c4-84fe-9f4102d8278f service neutron] 10.222.0.57 "GET /v2.0/networks/8a88c7d6-baa3-4bff-a8db-78e7aa6fb066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2258813 Dec 10 14:24:31.878270 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.889567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 0402c905-24f5-4163-a28f-96b738646aae {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 10 14:24:31.894436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:31.906629 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "DELETE /v2.0/networks/0402c905-24f5-4163-a28f-96b738646aae HTTP/1.1" status: 204 len: 168 time: 1.0502281 Dec 10 14:24:31.908519 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52778) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:31.923700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Request body: {'network': {'name': 'tempest-network--1859949111', 'router:external': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:31.976260 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f5f6b94-25cc-4f3c-8948-7364eb191216 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event deleted for resources: {'Network': ['ID=0402c905-24f5-4163-a28f-96b738646aae,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:31.977969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.39', 49892) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:32.022711 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-96280e15-6f9a-4aa7-8e47-8a7412197b5c req-b78e25bf-327e-4f91-86fa-a430ae7b2935 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 210 time: 0.0716810 Dec 10 14:24:32.098517 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Made reservation on behalf of 59a690f495a842c49cb3e713f48abcce for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:32.101141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:32.112696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-57b6b895-f3b1-46b6-911c-99a63c151b3e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:32.114565 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-57b6b895-f3b1-46b6-911c-99a63c151b3e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.39 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 811 time: 0.1316040 Dec 10 14:24:32.136528 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:32.155384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] vlan segment allocate from pool success with {'vlan_id': 350, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:32.207721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:32.208121 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Added segment d73f78a5-98c4-4578-9879-670feea40507 of type vlan for network 8d61b6e2-db86-4dcd-b8ca-6f7478b61036 Dec 10 14:24:32.296210 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-71150b45-deb7-4135-9f93-d9034735cae5 req-95d99146-dfab-4c9d-ae3d-ecaef80e4f29 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 210 time: 0.0984945 Dec 10 14:24:32.372317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:32.386210 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-ca79ec03-58a5-4990-b1b4-8b384af49c07 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a HTTP/1.1" status: 200 len: 379 time: 0.2183485 Dec 10 14:24:32.405862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Request body: {'port': {'device_id': '861150e5-b254-4a49-9e82-64b522c2d27d', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'admin_state_up': True, 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'security_groups': ['ad7787c2-a452-4578-90f6-78c6a9cab94a']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:32.506899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2484ce05-3748-4dcd-b52f-767b248c937e tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:32.510755 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2484ce05-3748-4dcd-b52f-767b248c937e tempest-MeteringIpV6TestJSON-1015136015 tempest-MeteringIpV6TestJSON-1015136015-project-admin] 10.222.0.57 "DELETE /v2.0/metering/metering-labels/59c45306-0f7c-42e2-8fe1-619005c3f860 HTTP/1.1" status: 204 len: 168 time: 0.6932039 Dec 10 14:24:32.660728 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:32.661874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:32.662816 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:32.731288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Made reservation on behalf of 5f6602a0e1ae4bc9b52f0259e63b6e7a for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:32.735642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:32.794178 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9f590c40-c086-43c9-90f0-34018d035fc9 req-e0f9b987-1266-470a-b156-cf43803c1db7 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 210 time: 0.0671597 Dec 10 14:24:32.799814 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'Network': ['ID=8d61b6e2-db86-4dcd-b8ca-6f7478b61036,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:32.813064 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 8d61b6e2-db86-4dcd-b8ca-6f7478b61036 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:32.882997 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-66956ef8-c07a-4e7b-9fda-9ca51381186b tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.9662793 Dec 10 14:24:32.903264 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:32.915596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52806) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:32.917198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-62c0153a-2d39-412b-9f46-eb4edd053898 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.143684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b91bee0a-10ce-4eea-86f2-b1b0e6fd0845 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:33.147626 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b91bee0a-10ce-4eea-86f2-b1b0e6fd0845 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] 10.222.0.57 "GET /v2.0/networks/8d61b6e2-db86-4dcd-b8ca-6f7478b61036 HTTP/1.1" status: 200 len: 757 time: 0.2273998 Dec 10 14:24:33.147868 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Allocated IP 172.20.0.8 (1cc2d855-81bd-4d95-a565-455c7130be80/630f1e53-2aa8-4b5b-8620-d9290269bc74/43abbe6e-ce29-43e5-89c8-32eadeb4aa8d) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:33.155681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52822) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:33.161111 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.174510 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c202961e-a01a-4ddb-8090-b83b62691c3d req-62fdd938-b94e-4041-9676-fafcb8168436 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 210 time: 0.0561612 Dec 10 14:24:33.248525 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52826) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:33.422162 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8445fd5c-99af-4d21-bffa-140a0d95cc45 req-1268281c-ea8e-4cc8-a544-d2e78f9c5927 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 210 time: 0.0553794 Dec 10 14:24:33.432262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.448054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-89da0f77-ba0b-4d0b-b7a0-bcd111b8e3d1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.453348 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.502834 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.557288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.572283 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1e641d1-41cf-42ea-a826-a59f8621eddc tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:33.573806 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d1e641d1-41cf-42ea-a826-a59f8621eddc tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] 10.222.0.57 "GET /v2.0/networks/7c4bf91d-9813-4b8c-a9df-c3d66c142fbc HTTP/1.1" status: 200 len: 767 time: 0.4174047 Dec 10 14:24:33.577151 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52836) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:33.636807 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.641973 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-89da0f77-ba0b-4d0b-b7a0-bcd111b8e3d1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.662770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.665200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event updated for resources: {'Port': ['ID=204051b2-60c8-4990-9900-9045b1b76d07,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:33.674264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.682875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.746326 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-89da0f77-ba0b-4d0b-b7a0-bcd111b8e3d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:33.795028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Network 1cc2d855-81bd-4d95-a565-455c7130be80 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:33.846730 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:33.855617 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:33.860422 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Pushing event updated for resources: {'Port': ['ID=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:33.864832 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89da0f77-ba0b-4d0b-b7a0-bcd111b8e3d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=035433dc-4393-409c-969a-b9d4b888920d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:33.932446 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-89da0f77-ba0b-4d0b-b7a0-bcd111b8e3d1 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=30fa66ce6d834c548cdf459d6b99be21&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6821289 Dec 10 14:24:33.940089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.26.2.53 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/be184c7a-d36c-4620-8632-abcb07e7c70e) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:33.942497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52840) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:33.969463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:33.987681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:34.145711 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7bf90949-7340-4388-b28f-c2189582c66d req-28c427bc-b853-4364-8fb4-e0f9e9b9abc3 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 210 time: 0.1801059 Dec 10 14:24:34.151567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:34.223553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Router e99cb024-b988-493b-b48c-026fe50ece49 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:24:34.368159 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.39', 49901) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:34.371761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e4be97c5-4118-4f62-9db3-a4db3e7c032e None None] Provisioning complete for port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:34.372732 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4be97c5-4118-4f62-9db3-a4db3e7c032e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:34.441400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e4be97c5-4118-4f62-9db3-a4db3e7c032e None None] Port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:34.589219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-343ba90e-e89f-4746-a377-dd82ff7411c7 None None] Provisioning complete for port 204051b2-60c8-4990-9900-9045b1b76d07 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:34.589692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-343ba90e-e89f-4746-a377-dd82ff7411c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:34.655010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:34.656861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:34.675141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-343ba90e-e89f-4746-a377-dd82ff7411c7 None None] Port 204051b2-60c8-4990-9900-9045b1b76d07 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:34.683723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8d61b6e2-db86-4dcd-b8ca-6f7478b61036']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:34.691078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecb203b3-dc83-4c7a-adef-081108365327 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:34.723372 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a0feade3-77a7-48a7-bbf7-60e37b24964d req-959c79dd-9fd2-4214-81ab-9332e4bc9d0b tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 210 time: 0.0888319 Dec 10 14:24:34.725655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd73f78a5-98c4-4578-9879-670feea40507') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:34.726166 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd73f78a5-98c4-4578-9879-670feea40507') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:34.776613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:34.802665 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b51c0fa3-542e-4e39-9b54-dbb098cb18a6 req-3c742225-8a1e-4ae5-8972-7094a39c8951 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:34.804211 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b51c0fa3-542e-4e39-9b54-dbb098cb18a6 req-3c742225-8a1e-4ae5-8972-7094a39c8951 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 931 time: 0.1837690 Dec 10 14:24:34.813872 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-5439197a-ddb8-4030-b3fb-7054f5029e09 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4180846 Dec 10 14:24:35.051514 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.052524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.053019 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecb203b3-dc83-4c7a-adef-081108365327 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-4ed80c09-690c-4938-bb5b-d5f35f5355d7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-4ed80c09-690c-4938-bb5b-d5f35f5355d7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0133462 Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Releasing vlan 350 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b51c0fa3-542e-4e39-9b54-dbb098cb18a6 req-b0c1ddc7-a546-4c15-afba-307980e48970 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1153941 Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Request body: {'port': {'device_id': '861150e5-b254-4a49-9e82-64b522c2d27d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:35.053114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.161977 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-34dbbbc9-da68-47ac-99fe-196670f1e152 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:35.163502 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-34dbbbc9-da68-47ac-99fe-196670f1e152 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.39 "GET /v2.0/networks?id=90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 HTTP/1.1" status: 200 len: 806 time: 0.7706664 Dec 10 14:24:35.183090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:35.219966 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d605a856-6e04-4ba2-bc18-0a5e65522c3c None None] Sync routers for ids ['e99cb024-b988-493b-b48c-026fe50ece49'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:35.281890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d605a856-6e04-4ba2-bc18-0a5e65522c3c None None] Routers {'e99cb024-b988-493b-b48c-026fe50ece49'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:35.283587 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-d605a856-6e04-4ba2-bc18-0a5e65522c3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99cb024-b988-493b-b48c-026fe50ece49'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:35.315960 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-d6a7363b-8b46-4c1a-9a52-0548108a737e tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8f11a2c4cb6b474d81f884b20c96a97b HTTP/1.1" status: 200 len: 380 time: 0.0800502 Dec 10 14:24:35.344763 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-d605a856-6e04-4ba2-bc18-0a5e65522c3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:35.375198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d605a856-6e04-4ba2-bc18-0a5e65522c3c None None] Routers {'e99cb024-b988-493b-b48c-026fe50ece49'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:35.375912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-d605a856-6e04-4ba2-bc18-0a5e65522c3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99cb024-b988-493b-b48c-026fe50ece49'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:35.377806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Request body: {'port': {'device_id': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'admin_state_up': True, 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'security_groups': ['f3a20060-d794-4212-9975-ddb1ce5af055']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:35.448881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.452214 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-49576d5a-044a-40ca-a157-a2887b7da352 req-fb2f205c-2094-4730-af02-464561d7191f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 210 time: 0.1437502 Dec 10 14:24:35.459624 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.461639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.469821 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9f7516aa-111b-40d6-a5b5-dd3f07c7e2d3 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 883 time: 8.6995623 Dec 10 14:24:35.471145 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0d4d4622-8a48-4c95-b74e-e2d0d4ca9053 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.472025 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecb203b3-dc83-4c7a-adef-081108365327 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.475777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52852) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:35.478762 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecb203b3-dc83-4c7a-adef-081108365327 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.485245 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ecb203b3-dc83-4c7a-adef-081108365327 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/035433dc-4393-409c-969a-b9d4b888920d HTTP/1.1" status: 204 len: 168 time: 1.5393767 Dec 10 14:24:35.487280 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-d605a856-6e04-4ba2-bc18-0a5e65522c3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:35.488722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d605a856-6e04-4ba2-bc18-0a5e65522c3c None None] The sync data for ids ['e99cb024-b988-493b-b48c-026fe50ece49'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:35.579504 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=be184c7a-d36c-4620-8632-abcb07e7c70e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:35.582130 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 8d61b6e2-db86-4dcd-b8ca-6f7478b61036 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 10 14:24:35.583401 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecb203b3-dc83-4c7a-adef-081108365327 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=035433dc-4393-409c-969a-b9d4b888920d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:35.606571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.617678 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Router c7159e6e-b751-4d6c-932d-576c5c2b09dc is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:24:35.635253 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "DELETE /v2.0/networks/8d61b6e2-db86-4dcd-b8ca-6f7478b61036 HTTP/1.1" status: 204 len: 168 time: 2.0565741 Dec 10 14:24:35.649147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52856) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:35.661155 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Request body: {'network': {'name': 'tempest-network--1004306298'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:35.787486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d {{(pid=103811) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:24:35.802116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.853800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3778c195-512c-401a-91a3-7d3e5da759d9 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event deleted for resources: {'Network': ['ID=8d61b6e2-db86-4dcd-b8ca-6f7478b61036,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:35.907624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:35.911259 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Made reservation on behalf of 59a690f495a842c49cb3e713f48abcce for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:35.913565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:35.934745 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.provisioning_blocks [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Transition to ACTIVE for port object 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d will not be triggered until provisioned by entity L2. {{(pid=103811) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:24:35.965518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:35.967524 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:35.977444 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1dd60dc6-07b2-4de4-85d1-e1a8ce04a766 req-c19635f4-74e2-4a17-a020-e919556e120a tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 210 time: 0.0911107 Dec 10 14:24:35.980086 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:36.012883 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a442df7a-5094-4db6-8e76-779b47762fcb tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "PUT /v2.0/routers/c7159e6e-b751-4d6c-932d-576c5c2b09dc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.1969385 Dec 10 14:24:36.022547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52866) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:36.029038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] vlan segment allocate from pool success with {'vlan_id': 383, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:36.035151 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Request body: {'port': {'network_id': '7a7d6fbc-4574-4686-8d7f-b0c28ab87c25', 'name': 'tempest-FloatingIPNegativeTestJSON-1582259762'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:36.039969 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:36.040630 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Added segment 039d9fab-b683-422a-b8fe-a61e7209a683 of type vlan for network aa64d7f4-a5d7-41db-9736-ec84ed444315 Dec 10 14:24:36.078644 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:36.088540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:36.089784 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.39', 49905) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:36.157772 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:36.225523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:36.236712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:36.237437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:36.240781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Made reservation on behalf of 8f11a2c4cb6b474d81f884b20c96a97b for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:36.247632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:36.536170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-a53cc9dc-007f-4b0c-a0b5-96aa9ba34f6c tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:36.537918 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-a53cc9dc-007f-4b0c-a0b5-96aa9ba34f6c tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.39 "GET /v2.0/networks?id=8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 HTTP/1.1" status: 200 len: 812 time: 0.4270022 Dec 10 14:24:36.594860 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-715f9d65-396a-4367-9a4d-c74772298566 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/routers/e99cb024-b988-493b-b48c-026fe50ece49 HTTP/1.1" status: 200 len: 919 time: 1.1163001 Dec 10 14:24:36.595590 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Pushing event updated for resources: {'Port': ['ID=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:36.608037 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 864 time: 0.9555490 Dec 10 14:24:36.610368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52872) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:36.610861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52874) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:36.617581 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc7b0c6-d8d8-41ee-859d-443fa8dc55d7 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'Network': ['ID=aa64d7f4-a5d7-41db-9736-ec84ed444315,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:36.642926 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network aa64d7f4-a5d7-41db-9736-ec84ed444315 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:36.713333 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0cccb85b-1024-4222-b923-8a9cace99f73 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Request body: {'network': {'router:external': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:36.786579 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-eff19854-9c88-4445-b867-37660b5afb76 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=e99cb024-b988-493b-b48c-026fe50ece49 HTTP/1.1" status: 200 len: 205 time: 0.1703598 Dec 10 14:24:36.787002 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52876) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:36.799209 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52878) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:36.852127 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd6e1291-c1a8-4e5a-b771-d4f6108d62f2 None None] Sync routers for ids ['c7159e6e-b751-4d6c-932d-576c5c2b09dc'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:36.867759 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-612b8967-c611-4765-b9e2-7101870fb466 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=af5207bd54c6403799a8cc223fa0ea80 HTTP/1.1" status: 200 len: 379 time: 0.2558722 Dec 10 14:24:36.870185 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd6e1291-c1a8-4e5a-b771-d4f6108d62f2 None None] Routers {'c7159e6e-b751-4d6c-932d-576c5c2b09dc'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:36.872243 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-bd6e1291-c1a8-4e5a-b771-d4f6108d62f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['c7159e6e-b751-4d6c-932d-576c5c2b09dc'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:36.936564 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-bd6e1291-c1a8-4e5a-b771-d4f6108d62f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:36.954879 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd6e1291-c1a8-4e5a-b771-d4f6108d62f2 None None] Routers {'c7159e6e-b751-4d6c-932d-576c5c2b09dc'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:36.955569 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-bd6e1291-c1a8-4e5a-b771-d4f6108d62f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['c7159e6e-b751-4d6c-932d-576c5c2b09dc'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:36.972637 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6d180cd6-dfef-49f7-92fa-2c9d826cce3c req-adc0f511-41fb-4813-aef6-0b8b2fa252dd tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 210 time: 0.1891150 Dec 10 14:24:36.981351 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Request body: {'port': {'device_id': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'admin_state_up': True, 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'security_groups': ['59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:37.007204 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-bd6e1291-c1a8-4e5a-b771-d4f6108d62f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:37.008297 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd6e1291-c1a8-4e5a-b771-d4f6108d62f2 None None] The sync data for ids ['c7159e6e-b751-4d6c-932d-576c5c2b09dc'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:37.070908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1f8943c-7104-49c8-af36-fea6ac3033b0 req-26cf840a-36ae-4337-9b50-a889c9143c52 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:37.079794 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b1f8943c-7104-49c8-af36-fea6ac3033b0 req-26cf840a-36ae-4337-9b50-a889c9143c52 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 943 time: 0.8854578 Dec 10 14:24:37.204505 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Allocated IP 172.20.0.13 (90ab95ca-b6c7-4d4c-8815-86eb5dad26d0/f95bfcc0-b514-425e-a401-25563b482fae/353a2f0c-9bc6-4935-a721-c19b3e0bc0da) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:37.223089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a78c19c-f2a0-4f27-b2fd-2f863b7333be admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.224563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.234083 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.308221 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Attempting to bind port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:37.309091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Attempting to bind port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:37.309091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Attempting to bind port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d on network 1cc2d855-81bd-4d95-a565-455c7130be80 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:37.385101 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6e763237-ee1a-47c4-8556-47d029afb71c req-9a45863f-ce15-42e9-a6de-3e29826ab7ce tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 210 time: 0.1894526 Dec 10 14:24:37.408469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d on network 1cc2d855-81bd-4d95-a565-455c7130be80 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:24:37.423250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Attempting to bind port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d on network 1cc2d855-81bd-4d95-a565-455c7130be80 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:37.423571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a78c19c-f2a0-4f27-b2fd-2f863b7333be admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.462114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:37.463453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Checking segment: {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:37.463453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Bound using segment: {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'} {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:37.463762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Bound port: 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1af6b7ee-efdc-44ed-822a-b8fd8a223e56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80'}}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:37.464620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.481798 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Made reservation on behalf of e68e4d52db984b87ab42e0ca79c7de4c for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:37.485349 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.544519 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b1f8943c-7104-49c8-af36-fea6ac3033b0 req-084d064a-3ef6-4185-a5ce-27d86f9d0ef4 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4546812 Dec 10 14:24:37.548269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0cccb85b-1024-4222-b923-8a9cace99f73 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.566092 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.592782 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a78c19c-f2a0-4f27-b2fd-2f863b7333be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.605481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] device_id is not set on port ca5a68a7-bc8b-4143-83e1-3d56159dcf3b yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:24:37.688555 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0cccb85b-1024-4222-b923-8a9cace99f73 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.703080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] For port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d, host hv-neutron-8214, cleared binding levels {{(pid=103811) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:37.712634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] For port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103811) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:37.725787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-0cccb85b-1024-4222-b923-8a9cace99f73 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Network aa64d7f4-a5d7-41db-9736-ec84ed444315 is not hosted by any dhcp agent {{(pid=103811) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 10 14:24:37.726077 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cccb85b-1024-4222-b923-8a9cace99f73 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:37.726665 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0cccb85b-1024-4222-b923-8a9cace99f73 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.729544 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0cccb85b-1024-4222-b923-8a9cace99f73 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "PUT /v2.0/networks/aa64d7f4-a5d7-41db-9736-ec84ed444315 HTTP/1.1" status: 200 len: 858 time: 1.0762758 Dec 10 14:24:37.739339 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1a78c19c-f2a0-4f27-b2fd-2f863b7333be admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=6c43e45945724c36a5d6c892251b708e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9509912 Dec 10 14:24:37.739882 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52886) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:37.749310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52888) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:37.792895 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Made reservation on behalf of af5207bd54c6403799a8cc223fa0ea80 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:37.796667 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.802700 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a78c19c-f2a0-4f27-b2fd-2f863b7333be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f56fbcae-3f6f-4af7-8fcc-2af2d016143b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:37.814805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.883030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cccb85b-1024-4222-b923-8a9cace99f73 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event updated for resources: {'Network': ['ID=aa64d7f4-a5d7-41db-9736-ec84ed444315,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:37.972867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Allocated IP 172.20.0.3 (7a7d6fbc-4574-4686-8d7f-b0c28ab87c25/0289a702-c4d2-4f4f-a3d1-eeb68609f52b/ca5a68a7-bc8b-4143-83e1-3d56159dcf3b) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:37.972867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:37.972867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:37.974821 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] 10.222.0.39 "PUT /v2.0/ports/43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 1093 time: 3.0658183 Dec 10 14:24:37.979096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '861150e5-b254-4a49-9e82-64b522c2d27d', 'tag': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:24:38.038136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd570880-0a40-47ed-83e7-7fc37e1107c7 service neutron] Pushing event updated for resources: {'Port': ['ID=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:38.292581 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:38.313789 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8807a2e3-72ee-4e21-b43a-259445192fbb" -d '{"events": [{"name": "network-changed", "server_uuid": "861150e5-b254-4a49-9e82-64b522c2d27d", "tag": "43abbe6e-ce29-43e5-89c8-32eadeb4aa8d"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:24:38.325075 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c4c91912-83a9-4686-9cae-373841b7b5e3 req-1b90b89e-2afa-4fd2-94d9-aa68cf134a2f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 210 time: 0.1312861 Dec 10 14:24:38.443558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:38.456350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:38.520257 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:38.615517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:38.622313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:38.680202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:24:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0faa29e2-2904-41bf-9ca3-a461824e9659 x-openstack-request-id: req-0faa29e2-2904-41bf-9ca3-a461824e9659 {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:24:38.680492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "861150e5-b254-4a49-9e82-64b522c2d27d", "tag": "43abbe6e-ce29-43e5-89c8-32eadeb4aa8d", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:24:38.680889 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-0faa29e2-2904-41bf-9ca3-a461824e9659 {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:24:38.681198 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '861150e5-b254-4a49-9e82-64b522c2d27d', 'tag': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d', 'status': 'completed', 'code': 200} Dec 10 14:24:38.713005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:38.716531 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e3c795b8-a03f-4bdf-a957-868cf3b246c5 req-68dfbb59-c7a0-4216-b9da-44c38ddf85c6 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 210 time: 0.0760624 Dec 10 14:24:38.720369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:38.727990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Allocated IP 172.20.0.12 (8a88c7d6-baa3-4bff-a8db-78e7aa6fb066/f3e2204d-7027-4309-a5db-3d266a3ff37e/1a32ff1b-25aa-44f4-9af3-1128013f508d) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:38.761181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cf420ef9-8ea1-4e5c-93bd-12a178c234b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:38.762710 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-cf420ef9-8ea1-4e5c-93bd-12a178c234b6 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1096 time: 0.6514754 Dec 10 14:24:38.800633 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:38.827761 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:38.851671 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aa64d7f4-a5d7-41db-9736-ec84ed444315']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:38.863361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '039d9fab-b683-422a-b8fe-a61e7209a683') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:38.863889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '039d9fab-b683-422a-b8fe-a61e7209a683') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:38.996228 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Pushing event updated for resources: {'Port': ['ID=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:39.017923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e38baf48-e017-492f-884f-89a8ac435de4 req-48ef3aa0-7acf-461f-ae70-7c137969832d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:39.027112 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e38baf48-e017-492f-884f-89a8ac435de4 req-48ef3aa0-7acf-461f-ae70-7c137969832d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 943 time: 0.3092937 Dec 10 14:24:39.033847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2877d997-7838-49ec-974d-861aa56ec0ab None None] Provisioning complete for port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:39.034227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2877d997-7838-49ec-974d-861aa56ec0ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.036507 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.044162 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44134482-a3e9-4ae6-a059-402c1ef2783b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.045761 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-6b183688-218b-45a3-ada1-bf2bb711ef82 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 217 time: 0.1281464 Dec 10 14:24:39.091696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.113784 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2877d997-7838-49ec-974d-861aa56ec0ab None None] Port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:39.118791 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.135670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:39.136324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.171770 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e38baf48-e017-492f-884f-89a8ac435de4 req-b676e5fc-7698-431a-a87d-0b5c17931543 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1436930 Dec 10 14:24:39.174741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Releasing vlan 383 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:39.175113 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:39.179460 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:39.181575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.181676 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44134482-a3e9-4ae6-a059-402c1ef2783b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.268941 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Deleting port 3671be3b-527a-42b5-a9a7-731070cc6394 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:39.269178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.305023 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.344705 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-4249a39d-53a6-4703-897d-1feb54266089 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.9717450 Dec 10 14:24:39.377731 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.389404 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:39.398005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:39.405043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:39.428390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.440326 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event updated for resources: {'Port': ['ID=ca5a68a7-bc8b-4143-83e1-3d56159dcf3b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:39.440627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network aa64d7f4-a5d7-41db-9736-ec84ed444315 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 10 14:24:39.443110 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.450776 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] 10.222.0.57 "DELETE /v2.0/networks/aa64d7f4-a5d7-41db-9736-ec84ed444315 HTTP/1.1" status: 204 len: 168 time: 1.7013645 Dec 10 14:24:39.455895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52910) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:39.467349 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:39.500988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:39.530005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:39.571231 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:39.571894 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.598233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.603884 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd8783a-08aa-4dbc-8c2b-6b7c8c05c375 tempest-ExternalNetworksTestJSON-251542301 tempest-ExternalNetworksTestJSON-251542301-project-admin] Pushing event deleted for resources: {'Network': ['ID=aa64d7f4-a5d7-41db-9736-ec84ed444315,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:39.614598 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-ca284e5d-36fb-4a6b-96b8-c2d1ba72a4aa tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] DELETE failed (client error): The resource could not be found. Dec 10 14:24:39.615213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ca284e5d-36fb-4a6b-96b8-c2d1ba72a4aa tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:24:39.621487 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ca284e5d-36fb-4a6b-96b8-c2d1ba72a4aa tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] 10.222.0.57 "DELETE /v2.0/subnets/92f44727-cbb1-443f-bd14-a235df73e588 HTTP/1.1" status: 404 len: 337 time: 0.1614466 Dec 10 14:24:39.621487 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:24:39.622948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44134482-a3e9-4ae6-a059-402c1ef2783b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.625822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44134482-a3e9-4ae6-a059-402c1ef2783b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.630021 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-44134482-a3e9-4ae6-a059-402c1ef2783b admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/f56fbcae-3f6f-4af7-8fcc-2af2d016143b HTTP/1.1" status: 204 len: 168 time: 1.8283231 Dec 10 14:24:39.633299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52912) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:39.679301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Pushing event updated for resources: {'Port': ['ID=1a32ff1b-25aa-44f4-9af3-1128013f508d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:39.682195 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Calling delete_port for 3671be3b-527a-42b5-a9a7-731070cc6394 owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:39.700194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44134482-a3e9-4ae6-a059-402c1ef2783b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f56fbcae-3f6f-4af7-8fcc-2af2d016143b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:39.706122 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:39.706795 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.740314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6769a09-6d23-4464-9b52-fad2fb32c355 req-45058fbd-118e-412b-a860-ecd4025735e0 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:39.741959 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c6769a09-6d23-4464-9b52-fad2fb32c355 req-45058fbd-118e-412b-a860-ecd4025735e0 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 932 time: 0.2851195 Dec 10 14:24:39.798817 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cd01a65a-19e3-4838-bdb1-9beb38f5d587 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 3.7731278 Dec 10 14:24:39.803834 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52918) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:39.834081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:39.887314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d66682f8-fa7a-4e1e-8a7c-4b0fb6dfb6c9 None None] Provisioning complete for port ca5a68a7-bc8b-4143-83e1-3d56159dcf3b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:39.889392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d66682f8-fa7a-4e1e-8a7c-4b0fb6dfb6c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:39.948883 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Request body: {'port': {'device_id': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:39.975350 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d66682f8-fa7a-4e1e-8a7c-4b0fb6dfb6c9 None None] Port ca5a68a7-bc8b-4143-83e1-3d56159dcf3b cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:40.008319 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.053904 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-8ea15769-c891-4c2a-9cc2-6a4ea77ff33e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:40.055565 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-8ea15769-c891-4c2a-9cc2-6a4ea77ff33e service neutron] 10.222.0.39 "GET /v2.0/subnets?id=630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 200 len: 850 time: 0.1800835 Dec 10 14:24:40.091274 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c6769a09-6d23-4464-9b52-fad2fb32c355 req-80cfecae-0fcd-4474-876f-068628019b30 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3378222 Dec 10 14:24:40.106417 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-4dbf891c-2d65-4088-a69f-36e83fad0d91 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.1416543 Dec 10 14:24:40.110946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-1025dec6-ea63-4123-b0d4-a08127272587 None None] Provisioning complete for port 1a32ff1b-25aa-44f4-9af3-1128013f508d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:40.116444 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1025dec6-ea63-4123-b0d4-a08127272587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.155001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:40.179457 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.220797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1025dec6-ea63-4123-b0d4-a08127272587 None None] Port 1a32ff1b-25aa-44f4-9af3-1128013f508d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:24:40.316584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Request body: {'port': {'device_id': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:40.329005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.488379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7c4bf91d-9813-4b8c-a9df-c3d66c142fbc']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:40.505754 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.509944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79be68ea-8212-49f9-9585-f8a7f6a6b17b None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:40.520646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79be68ea-8212-49f9-9585-f8a7f6a6b17b None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:40.526062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-79be68ea-8212-49f9-9585-f8a7f6a6b17b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:40.584669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60849a8f-d531-4840-b39e-989554871e4c req-d9f28dfb-0685-4e5c-8817-6b877a9e9ab8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:40.585945 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-60849a8f-d531-4840-b39e-989554871e4c req-d9f28dfb-0685-4e5c-8817-6b877a9e9ab8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 932 time: 0.6860747 Dec 10 14:24:40.606559 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.607023 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-fb27a404-ee99-4356-8518-c17a514ef814 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:40.608512 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-257a3c00-da1e-44be-a89f-7d2b7c0811e7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 9.5857639 Dec 10 14:24:40.613691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '92c1d5bd-3f5b-4967-8006-37c2b6a38d15') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:40.614056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '92c1d5bd-3f5b-4967-8006-37c2b6a38d15') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:40.618688 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-fb27a404-ee99-4356-8518-c17a514ef814 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=1cc2d855-81bd-4d95-a565-455c7130be80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.5063438 Dec 10 14:24:40.622667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52928) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:40.652204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.653863 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-79be68ea-8212-49f9-9585-f8a7f6a6b17b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:40.677682 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79be68ea-8212-49f9-9585-f8a7f6a6b17b None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:40.678314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-79be68ea-8212-49f9-9585-f8a7f6a6b17b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:40.690848 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.733806 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-79be68ea-8212-49f9-9585-f8a7f6a6b17b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:40.734476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79be68ea-8212-49f9-9585-f8a7f6a6b17b None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:40.761082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.771129 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Releasing vlan 367 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:40.771690 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:40.778995 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:40.864737 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-2e8d7a67-a871-47f0-8382-e57cfd66caf9 service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1709437 Dec 10 14:24:40.873584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3847a66-f76a-464f-940b-fd96d14d3412 req-0be70f1a-26b2-4873-b7cf-710d3ed8fc9d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:40.875404 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a3847a66-f76a-464f-940b-fd96d14d3412 req-0be70f1a-26b2-4873-b7cf-710d3ed8fc9d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 943 time: 0.4945273 Dec 10 14:24:40.966242 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-60849a8f-d531-4840-b39e-989554871e4c req-88092b1d-38c7-4876-b06e-7511ca55b360 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3622527 Dec 10 14:24:41.061259 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a3847a66-f76a-464f-940b-fd96d14d3412 req-108d892a-5e33-457b-8e7f-e4b0973ab067 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1764379 Dec 10 14:24:41.064498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.192694 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event deleted for resources: {'Port': ['ID=3671be3b-527a-42b5-a9a7-731070cc6394,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:41.348677 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.368352 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.371742 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] 10.222.0.57 "DELETE /v2.0/networks/7c4bf91d-9813-4b8c-a9df-c3d66c142fbc HTTP/1.1" status: 204 len: 168 time: 1.7261467 Dec 10 14:24:41.391932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.397810 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2a02cf4-3f3b-487a-ade2-903d1c4f2984 tempest-ExternalNetworksTestJSON-196822189 tempest-ExternalNetworksTestJSON-196822189-project] Pushing event deleted for resources: {'Network': ['ID=7c4bf91d-9813-4b8c-a9df-c3d66c142fbc,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:41.531184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.593953 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.601446 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8371b9-8d7a-4c7c-8db8-3c070eaab644 req-d2795733-17a7-4c54-be90-def0c78da3dd tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:41.616253 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0e8371b9-8d7a-4c7c-8db8-3c070eaab644 req-d2795733-17a7-4c54-be90-def0c78da3dd tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 932 time: 0.3399897 Dec 10 14:24:41.616500 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.692334 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01aba7b0-9e34-4775-aeff-16421b8adf9e req-1bad54ea-544b-4bc2-aecf-64b02641601b service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5341775 Dec 10 14:24:41.707909 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 353a2f0c-9bc6-4935-a721-c19b3e0bc0da {{(pid=103810) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:24:41.718483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.750472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.provisioning_blocks [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Transition to ACTIVE for port object 353a2f0c-9bc6-4935-a721-c19b3e0bc0da will not be triggered until provisioned by entity L2. {{(pid=103810) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:24:41.799754 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.801069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Fanout notify agent at l3_agent the message router_deleted on router e99cb024-b988-493b-b48c-026fe50ece49 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:24:41.810367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.811657 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-78799fd8-9a7d-45c3-92d3-0525da989daa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/e99cb024-b988-493b-b48c-026fe50ece49 HTTP/1.1" status: 204 len: 168 time: 5.0113916 Dec 10 14:24:41.818443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52950) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:41.824922 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1786543523', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': False}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:41.833664 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:41.848173 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0e8371b9-8d7a-4c7c-8db8-3c070eaab644 req-cb90c88e-4560-46fe-81f7-f85bcc840e3f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2298405 Dec 10 14:24:41.957792 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Allocated IP 172.26.2.171 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/e50de9d6-4ce4-47fe-97b0-40f36dd79a2b) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:41.967894 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1a32ff1b-25aa-44f4-9af3-1128013f508d {{(pid=103811) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:24:41.999568 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:42.031195 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Pushing event updated for resources: {'Port': ['ID=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:42.035245 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.provisioning_blocks [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Transition to ACTIVE for port object 1a32ff1b-25aa-44f4-9af3-1128013f508d will not be triggered until provisioned by entity L2. {{(pid=103811) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:24:42.035715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:42.037577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:42.128836 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:42.184975 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:42.304919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52962) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:42.399286 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Attempting to bind port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:42.399645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Attempting to bind port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:42.399973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Attempting to bind port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da on network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:42.519418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da on network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:24:42.519948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Attempting to bind port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da on network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:42.634337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:42.635259 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Checking segment: {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:42.635501 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Bound using segment: {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:42.636722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Bound port: 353a2f0c-9bc6-4935-a721-c19b3e0bc0da, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d1241a1-dea0-4f8f-8e5e-03b341b37387', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0'}}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:42.637771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:42.768292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Pushing event updated for resources: {'Port': ['ID=1a32ff1b-25aa-44f4-9af3-1128013f508d,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:42.789945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-cec489d2-20a6-4131-8f26-0770a62257ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:42.791463 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-cec489d2-20a6-4131-8f26-0770a62257ca service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1096 time: 0.7261784 Dec 10 14:24:42.835992 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:42.840463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:42.870256 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c837b6d-fec1-4a35-995b-60fa38011598 req-8207b4b1-1f5b-4943-ad56-dfdddb7e4c2d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:42.872061 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8c837b6d-fec1-4a35-995b-60fa38011598 req-8207b4b1-1f5b-4943-ad56-dfdddb7e4c2d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 944 time: 0.6735597 Dec 10 14:24:42.888493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] For port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:42.919332 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7b8519-d128-46db-b8db-321dbabbfd52 req-2b124df3-a255-4d3b-bffe-6a488f150803 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:42.921083 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9e7b8519-d128-46db-b8db-321dbabbfd52 req-2b124df3-a255-4d3b-bffe-6a488f150803 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 943 time: 0.6926568 Dec 10 14:24:42.929094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:42.962606 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] For port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:43.013732 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d4abb7f9-832f-46c4-8bc6-234d33c0e2b0 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=5b3bda131ae2445f9e9839c1b2686612&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6982095 Dec 10 14:24:43.016715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52974) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:43.017582 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 52976) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:43.159854 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Attempting to bind port 1a32ff1b-25aa-44f4-9af3-1128013f508d on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:43.160366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Attempting to bind port 1a32ff1b-25aa-44f4-9af3-1128013f508d by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:43.160697 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Attempting to bind port 1a32ff1b-25aa-44f4-9af3-1128013f508d on network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:43.174930 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9e7b8519-d128-46db-b8db-321dbabbfd52 req-d982d2e6-b04e-4686-a9b7-0ed0006b518d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2419965 Dec 10 14:24:43.178734 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8c837b6d-fec1-4a35-995b-60fa38011598 req-a8162ba1-42c2-4a6e-98df-d14d3cf5c096 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2729833 Dec 10 14:24:43.186857 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Port 1a32ff1b-25aa-44f4-9af3-1128013f508d on network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:24:43.187445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Attempting to bind port 1a32ff1b-25aa-44f4-9af3-1128013f508d on network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:43.196457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:43.196799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Checking segment: {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:43.197185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Bound using segment: {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'} {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:43.197717 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Bound port: 1a32ff1b-25aa-44f4-9af3-1128013f508d, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9f890aad-2e77-4afa-a708-065638c55845', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066'}}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:43.198150 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:43.217621 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeTest-982542277', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:43.241386 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53fa7cdc-6a1f-4e11-92c8-4b5fbbc0772c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:43.269861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:43.341537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:43.513520 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:43.514157 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:43.515687 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] 10.222.0.39 "PUT /v2.0/ports/353a2f0c-9bc6-4935-a721-c19b3e0bc0da HTTP/1.1" status: 200 len: 1094 time: 3.5718589 Dec 10 14:24:43.518322 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'tag': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:24:43.571696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30482d13-c529-47e8-93ef-67722e832e60 service neutron] Pushing event updated for resources: {'Port': ['ID=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:43.606505 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53fa7cdc-6a1f-4e11-92c8-4b5fbbc0772c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:43.609798 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Made reservation on behalf of 696ab4b9acca421cb63bfeb0f3bc81c0 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:43.615461 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:43.628011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:43.676073 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:43.678375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event updated for resources: {'Port': ['ID=e50de9d6-4ce4-47fe-97b0-40f36dd79a2b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:43.716017 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:43.730322 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:43.791107 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] For port 1a32ff1b-25aa-44f4-9af3-1128013f508d, host hv-neutron-8214, cleared binding levels {{(pid=103811) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:43.851530 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01909b49-50a0-428e-852b-0266852952e8" -d '{"events": [{"name": "network-changed", "server_uuid": "4a2c4f5f-1771-428d-b1b5-298cd362bc0e", "tag": "353a2f0c-9bc6-4935-a721-c19b3e0bc0da"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:24:43.872706 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] For port 1a32ff1b-25aa-44f4-9af3-1128013f508d, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=1a32ff1b-25aa-44f4-9af3-1128013f508d,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103811) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:43.905723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-818ee0a4-6168-4a72-8782-af13c101b198 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:43.908219 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-818ee0a4-6168-4a72-8782-af13c101b198 service neutron] 10.222.0.39 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 912 time: 0.6679218 Dec 10 14:24:43.956577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41601961-a8bc-4ae6-9c06-59519fad54f1 req-82f122df-30ee-459b-a19e-1f8b0cb89bdd tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:43.960277 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-41601961-a8bc-4ae6-9c06-59519fad54f1 req-82f122df-30ee-459b-a19e-1f8b0cb89bdd tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 944 time: 0.5655782 Dec 10 14:24:43.971808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:43.977016 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.20.0.1 (826f4ffe-6ffa-44c2-a055-d6d8b94c119d/acea17da-7f1b-4834-9b60-5d797c3b126f/75de2cec-62f6-4af4-b128-88ca88f2ae1b) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:43.979840 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.006388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:24:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5441e628-0f8f-47ba-b40a-2aa1d1072da8 x-openstack-request-id: req-5441e628-0f8f-47ba-b40a-2aa1d1072da8 {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:24:44.006719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4a2c4f5f-1771-428d-b1b5-298cd362bc0e", "tag": "353a2f0c-9bc6-4935-a721-c19b3e0bc0da", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:24:44.006936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-5441e628-0f8f-47ba-b40a-2aa1d1072da8 {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:24:44.007406 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'tag': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da', 'status': 'completed', 'code': 200} Dec 10 14:24:44.009607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.073056 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:44.073716 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.075120 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] 10.222.0.39 "PUT /v2.0/ports/1a32ff1b-25aa-44f4-9af3-1128013f508d HTTP/1.1" status: 200 len: 1094 time: 3.8958538 Dec 10 14:24:44.080955 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'tag': '1a32ff1b-25aa-44f4-9af3-1128013f508d'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:24:44.083637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5cedb9a8-ce5a-4270-8172-de8f129b4b81" -d '{"events": [{"name": "network-changed", "server_uuid": "0eac01e5-2ef7-425a-8991-9164b917a3b5", "tag": "1a32ff1b-25aa-44f4-9af3-1128013f508d"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:24:44.164912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:24:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-712492f3-2e15-4d64-a016-957e4160f8fc x-openstack-request-id: req-712492f3-2e15-4d64-a016-957e4160f8fc {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:24:44.165275 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0eac01e5-2ef7-425a-8991-9164b917a3b5", "tag": "1a32ff1b-25aa-44f4-9af3-1128013f508d", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:24:44.165563 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-712492f3-2e15-4d64-a016-957e4160f8fc {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:24:44.168266 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'tag': '1a32ff1b-25aa-44f4-9af3-1128013f508d', 'status': 'completed', 'code': 200} Dec 10 14:24:44.176848 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53fa7cdc-6a1f-4e11-92c8-4b5fbbc0772c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.179615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53fa7cdc-6a1f-4e11-92c8-4b5fbbc0772c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.183217 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-53fa7cdc-6a1f-4e11-92c8-4b5fbbc0772c admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/f599c883-ceec-4c77-b108-fc6b3f9685fb HTTP/1.1" status: 204 len: 168 time: 1.1587155 Dec 10 14:24:44.192554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75bcb487-9232-49a1-ae93-2f122fd33a01 service neutron] Pushing event updated for resources: {'Port': ['ID=1a32ff1b-25aa-44f4-9af3-1128013f508d,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:44.222931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.239603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53fa7cdc-6a1f-4e11-92c8-4b5fbbc0772c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f599c883-ceec-4c77-b108-fc6b3f9685fb,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:44.243927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.266560 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-41601961-a8bc-4ae6-9c06-59519fad54f1 req-05e4a92e-f108-4c2e-8347-b77ad6b63800 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2607741 Dec 10 14:24:44.300236 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.309906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] device_id is not set on port 4808ad69-6a9f-468e-87d6-cc9cff3ea4b4 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:24:44.360180 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.411760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Allocated IP 172.26.2.54 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/b2afcf6e-a941-4f84-bd8a-dc7c43dcff25) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:44.486794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.554114 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:44.561168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:44.565198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:44.567742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=75de2cec-62f6-4af4-b128-88ca88f2ae1b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:44.569822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.571628 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcf57119-d484-4cb1-9f01-f8e276983da4,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:44.646688 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9988363-6fd1-4232-8697-b13512bb960d req-0745d06e-bb01-41be-99a2-a01b53cc66e3 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:44.648607 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a9988363-6fd1-4232-8697-b13512bb960d req-0745d06e-bb01-41be-99a2-a01b53cc66e3 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 944 time: 0.2038143 Dec 10 14:24:44.649630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.655338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.693534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-123cef34-ae68-4d45-9b3e-8ff65200484c req-c1084952-c973-4390-bc42-3f18f51b539d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:44.695473 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-123cef34-ae68-4d45-9b3e-8ff65200484c req-c1084952-c973-4390-bc42-3f18f51b539d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 943 time: 0.2518523 Dec 10 14:24:44.794328 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a9988363-6fd1-4232-8697-b13512bb960d req-e55b57d1-0bc0-4052-984c-d282ff83515c tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1363440 Dec 10 14:24:44.914670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:44.934510 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-1e598c2a-95bb-4993-907e-74c7002015ea service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 217 time: 0.1471293 Dec 10 14:24:44.978935 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-123cef34-ae68-4d45-9b3e-8ff65200484c req-ae9abed2-d020-473c-8bde-3ec3a57b5477 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2710130 Dec 10 14:24:45.008285 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:45.014115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.014790 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:45.034975 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:45.036700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Allocated IP 172.26.2.131 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/4808ad69-6a9f-468e-87d6-cc9cff3ea4b4) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:45.038395 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event updated for resources: {'Port': ['ID=b2afcf6e-a941-4f84-bd8a-dc7c43dcff25,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:45.069226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.165016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.251931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event updated for resources: {'Port': ['ID=e50de9d6-4ce4-47fe-97b0-40f36dd79a2b,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:45.295437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 52998) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:45.387653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.416257 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7659791c-7b88-4aa3-abcd-b6b17ef38abc admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=59a690f495a842c49cb3e713f48abcce&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1194868 Dec 10 14:24:45.418502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.429708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53002) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:45.527165 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c2a528-fe45-4b29-a5e8-04bd375ec6f0 req-248509ad-0fca-4c49-874a-d738fd872b7d tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:45.533853 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b7c2a528-fe45-4b29-a5e8-04bd375ec6f0 req-248509ad-0fca-4c49-874a-d738fd872b7d tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 944 time: 0.1295350 Dec 10 14:24:45.573276 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbb4782a-64a9-4e5d-8180-dfeeab60c6ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.609567 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b7c2a528-fe45-4b29-a5e8-04bd375ec6f0 req-d1786f63-fbaa-4d55-875c-d0f4953a8ac9 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0726542 Dec 10 14:24:45.614527 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbb4782a-64a9-4e5d-8180-dfeeab60c6ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.621169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.680471 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.688131 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b1ba9760-4cbe-48f1-b920-f8b75bb51d1f tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 5.8560181 Dec 10 14:24:45.688131 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53006) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:45.689185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0ac7a146-7a68-4f34-b20e-fef4b92acea4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Request body: {'floatingip': {'port_id': 'ca5a68a7-bc8b-4143-83e1-3d56159dcf3b', 'fixed_ip_address': '172.20.0.3'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:45.705824 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.717537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.792423 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0ac7a146-7a68-4f34-b20e-fef4b92acea4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for floatingip, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.830718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbb4782a-64a9-4e5d-8180-dfeeab60c6ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.833283 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbb4782a-64a9-4e5d-8180-dfeeab60c6ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.836748 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dbb4782a-64a9-4e5d-8180-dfeeab60c6ec admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/75d6de50-bfca-443d-8f7a-559c1c5b041f HTTP/1.1" status: 204 len: 168 time: 0.4034929 Dec 10 14:24:45.852255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:45.861130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.867571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=75de2cec-62f6-4af4-b128-88ca88f2ae1b,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:45.900014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:45.902638 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:45.914072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbb4782a-64a9-4e5d-8180-dfeeab60c6ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75d6de50-bfca-443d-8f7a-559c1c5b041f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:45.928692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:45.959847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Pushing event updated for resources: {'Port': ['ID=4808ad69-6a9f-468e-87d6-cc9cff3ea4b4,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:46.050120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:46.053215 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:46.381990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:46.382726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:46.399099 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-0ac7a146-7a68-4f34-b20e-fef4b92acea4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] update failed (client error): The resource could not be found. Dec 10 14:24:46.400182 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0ac7a146-7a68-4f34-b20e-fef4b92acea4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "PUT /v2.0/floatingips/f8ef39b5-96ad-4c9f-b101-3393040d1520 HTTP/1.1" status: 404 len: 507 time: 0.7145040 Dec 10 14:24:46.406230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53022) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:46.418784 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bfa4ff4-8a1c-4ff2-885c-39305ba08b5f req-eb7d657a-f312-4c00-a568-ae709ec5803b tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:46.421954 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1bfa4ff4-8a1c-4ff2-885c-39305ba08b5f req-eb7d657a-f312-4c00-a568-ae709ec5803b tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 944 time: 0.5432005 Dec 10 14:24:46.423761 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-21327930-9764-4d7f-aec2-0cf5ac917e7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:46.426156 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-21327930-9764-4d7f-aec2-0cf5ac917e7c service neutron] 10.222.0.39 "GET /v2.0/subnets?id=630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 200 len: 850 time: 0.1908596 Dec 10 14:24:46.500181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-379dacd4-b6ed-4f0a-9359-22904c862094 req-68547fa6-ba0a-4c76-b99c-d71f2d0de88c tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:46.501677 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-379dacd4-b6ed-4f0a-9359-22904c862094 req-68547fa6-ba0a-4c76-b99c-d71f2d0de88c tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 943 time: 0.2672720 Dec 10 14:24:46.526051 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cedb9a8-ce5a-4270-8172-de8f129b4b81 req-23293963-46c5-44ad-a6ab-0182a27d3d64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:46.527503 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5cedb9a8-ce5a-4270-8172-de8f129b4b81 req-23293963-46c5-44ad-a6ab-0182a27d3d64 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=af5207bd54c6403799a8cc223fa0ea80&device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 1097 time: 0.2942829 Dec 10 14:24:46.543851 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:24:46.545632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:46.552580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01909b49-50a0-428e-852b-0266852952e8 req-13441547-5c90-4ef7-835d-d553c751fa57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:46.554111 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-01909b49-50a0-428e-852b-0266852952e8 req-13441547-5c90-4ef7-835d-d553c751fa57 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=8f11a2c4cb6b474d81f884b20c96a97b&device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 1097 time: 0.3559101 Dec 10 14:24:46.583390 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9d94ce38-9071-49df-9888-28220a585885 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 3.5602713 Dec 10 14:24:46.598857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53028) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:46.608258 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.131'}]}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:46.761771 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1bfa4ff4-8a1c-4ff2-885c-39305ba08b5f req-39e11f01-f542-4126-80e3-659349ae269f tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3271658 Dec 10 14:24:46.763506 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-dda9c0e6-a219-46e4-881f-d578490ce4d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:46.765494 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-dda9c0e6-a219-46e4-881f-d578490ce4d9 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=1cc2d855-81bd-4d95-a565-455c7130be80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3286016 Dec 10 14:24:46.804261 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-379dacd4-b6ed-4f0a-9359-22904c862094 req-c2928b3f-bdec-48fa-9369-cef878a35db7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2734089 Dec 10 14:24:46.867582 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:46.869931 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:46.920857 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cedb9a8-ce5a-4270-8172-de8f129b4b81 req-0cca18f3-6abc-4bf7-b6f1-7e383c363cda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:46.922534 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5cedb9a8-ce5a-4270-8172-de8f129b4b81 req-0cca18f3-6abc-4bf7-b6f1-7e383c363cda service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=af5207bd54c6403799a8cc223fa0ea80&shared=False HTTP/1.1" status: 200 len: 913 time: 0.3503063 Dec 10 14:24:46.945350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01909b49-50a0-428e-852b-0266852952e8 req-f25f950e-e53a-4ca8-a830-e1b8346fc088 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:46.946875 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-01909b49-50a0-428e-852b-0266852952e8 req-f25f950e-e53a-4ca8-a830-e1b8346fc088 service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=8f11a2c4cb6b474d81f884b20c96a97b&shared=False HTTP/1.1" status: 200 len: 907 time: 0.3515527 Dec 10 14:24:46.970398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Deleting port e50de9d6-4ce4-47fe-97b0-40f36dd79a2b {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:46.970736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:47.056288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:47.067044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:47.069674 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2644419e-9812-492e-a254-563963da15f4 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:47.073558 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-229261a6-45d5-4b8c-93ee-84a7a6ebc9a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/routers/e99fc658-fff4-4ea9-a04c-33ee04a756ca/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4373934 Dec 10 14:24:47.082893 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2644419e-9812-492e-a254-563963da15f4 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:47.083521 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-2644419e-9812-492e-a254-563963da15f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:47.084063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53040) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:47.093619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'port': {'network_id': '826f4ffe-6ffa-44c2-a055-d6d8b94c119d', 'name': 'tempest-FloatingIPTestJSON-824335393'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:47.116416 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-af9b9267-be2e-4c34-a4d5-84a5ae9074f0 service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3385026 Dec 10 14:24:47.135681 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-2644419e-9812-492e-a254-563963da15f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:47.147378 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2644419e-9812-492e-a254-563963da15f4 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:47.148231 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-2644419e-9812-492e-a254-563963da15f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:47.154373 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e9db44f-9d02-4bbb-bc36-cd832ec59201 req-8a5b3b4f-e9f9-4986-9cdc-6f252069a872 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:47.155918 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2e9db44f-9d02-4bbb-bc36-cd832ec59201 req-8a5b3b4f-e9f9-4986-9cdc-6f252069a872 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 944 time: 0.2564921 Dec 10 14:24:47.190693 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-2644419e-9812-492e-a254-563963da15f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:47.192029 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2644419e-9812-492e-a254-563963da15f4 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:47.285289 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:47.285641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:47.327606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Calling delete_port for e50de9d6-4ce4-47fe-97b0-40f36dd79a2b owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:47.327915 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01909b49-50a0-428e-852b-0266852952e8 req-c7897a51-513e-42fe-ba56-f7b891c7f4e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:47.329397 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-01909b49-50a0-428e-852b-0266852952e8 req-c7897a51-513e-42fe-ba56-f7b891c7f4e4 service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3706546 Dec 10 14:24:47.340022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Router 884fb027-f010-4f97-977b-e996c3355469 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:24:47.371533 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8807a2e3-72ee-4e21-b43a-259445192fbb req-56415356-e349-4997-9658-1c7d178d5a7a service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2440257 Dec 10 14:24:47.373738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:47.375679 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2e9db44f-9d02-4bbb-bc36-cd832ec59201 req-600c1134-1fad-429c-81ee-ddfbfd6da0c4 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1984081 Dec 10 14:24:47.377594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cedb9a8-ce5a-4270-8172-de8f129b4b81 req-c042aca3-b434-477b-abf5-1154a395223b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:47.380494 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5cedb9a8-ce5a-4270-8172-de8f129b4b81 req-c042aca3-b434-477b-abf5-1154a395223b service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4345634 Dec 10 14:24:47.495189 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-e80457b1-9964-4d57-b2e3-d5759fe68ce9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:47.497449 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-e80457b1-9964-4d57-b2e3-d5759fe68ce9 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=af5207bd54c6403799a8cc223fa0ea80&device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 1097 time: 0.0580494 Dec 10 14:24:47.530354 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-e2c511c1-6861-46db-ae51-da05104f289b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:47.540985 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-e2c511c1-6861-46db-ae51-da05104f289b service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=8f11a2c4cb6b474d81f884b20c96a97b&device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 1097 time: 0.1448064 Dec 10 14:24:47.550472 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-aaa47cb5-f956-4d69-ac13-bc7834aff859 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=1a32ff1b-25aa-44f4-9af3-1128013f508d HTTP/1.1" status: 200 len: 217 time: 0.0427415 Dec 10 14:24:47.632982 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-13fd15c6-d2f1-4616-966b-bc71a717a05d service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=353a2f0c-9bc6-4935-a721-c19b3e0bc0da HTTP/1.1" status: 200 len: 217 time: 0.0849605 Dec 10 14:24:47.635217 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-2abf97fa-c963-4f46-ac0e-bdae567de455 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:47.636612 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Made reservation on behalf of c2a7c581de164ccf910afaf96add3a69 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:47.636744 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-2abf97fa-c963-4f46-ac0e-bdae567de455 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=f3e2204d-7027-4309-a5db-3d266a3ff37e HTTP/1.1" status: 200 len: 851 time: 0.0596652 Dec 10 14:24:47.640587 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:47.654800 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:47.664293 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Sync routers for ids ['884fb027-f010-4f97-977b-e996c3355469'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:47.679722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Routers {'884fb027-f010-4f97-977b-e996c3355469'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:47.686290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['884fb027-f010-4f97-977b-e996c3355469'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:47.692191 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-ee3582c7-933a-4628-81c9-2a7183c47f70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:47.693932 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-ee3582c7-933a-4628-81c9-2a7183c47f70 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=8a88c7d6-baa3-4bff-a8db-78e7aa6fb066&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0479429 Dec 10 14:24:47.731098 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:47.884700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event deleted for resources: {'Port': ['ID=e50de9d6-4ce4-47fe-97b0-40f36dd79a2b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:47.948635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] device_id is not set on port a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:24:47.979910 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Set router 884fb027-f010-4f97-977b-e996c3355469 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:48.005476 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-69963c7c-b4fd-4ee0-aea2-f5bb9acbac7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:48.006950 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-69963c7c-b4fd-4ee0-aea2-f5bb9acbac7e service neutron] 10.222.0.39 "GET /v2.0/subnets?id=f95bfcc0-b514-425e-a401-25563b482fae HTTP/1.1" status: 200 len: 845 time: 0.3550875 Dec 10 14:24:48.041246 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.044110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.045310 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dbda5810-556d-4006-a8a5-862af0bace93 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "DELETE /v2.0/floatingips/f8ef39b5-96ad-4c9f-b101-3393040d1520 HTTP/1.1" status: 204 len: 168 time: 1.6348019 Dec 10 14:24:48.051261 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-fd038b00-cd80-4686-a2f1-4ba6fb411c1a service neutron] 10.222.0.39 "GET /v2.0/networks/8a88c7d6-baa3-4bff-a8db-78e7aa6fb066?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3494668 Dec 10 14:24:48.052808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53058) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:48.062649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.063869 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4146a025-58bb-49c2-9804-41c02c999632 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 6.2443833 Dec 10 14:24:48.067356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2b97ca38-95d5-48b7-8e38-72d8e9d1dbf0 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Request body: {'floatingip': {'floating_network_id': '7a7d6fbc-4574-4686-8d7f-b0c28ab87c25', 'port_id': 'ca5a68a7-bc8b-4143-83e1-3d56159dcf3b', 'fixed_ip_address': '172.20.0.3'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:48.079136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24f64a0-3fd9-4816-a678-c90c6a59ae19 req-f5d47462-2eb2-47b6-92ed-c385fa31dd4c tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:48.082479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53060) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:48.086485 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a24f64a0-3fd9-4816-a678-c90c6a59ae19 req-f5d47462-2eb2-47b6-92ed-c385fa31dd4c tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 944 time: 0.1459167 Dec 10 14:24:48.128227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97edcd7-0136-4a7d-9798-4cd191378c49 req-8b0b8270-dfe7-4b0a-b890-74c132962dad tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:48.129780 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c97edcd7-0136-4a7d-9798-4cd191378c49 req-8b0b8270-dfe7-4b0a-b890-74c132962dad tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 943 time: 0.1853163 Dec 10 14:24:48.218230 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-a8d438b2-d21f-4df2-90f5-37ddf7109049 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:48.219761 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-a8d438b2-d21f-4df2-90f5-37ddf7109049 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=90ab95ca-b6c7-4d4c-8815-86eb5dad26d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2018151 Dec 10 14:24:48.240877 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '884fb027-f010-4f97-977b-e996c3355469', 'name': 'tempest-snat-router-1786543523', 'tenant_id': '605cf5d3d75a473d8c1129a632d22119', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.54'}], 'enable_snat': False}, 'gw_port_id': 'b2afcf6e-a941-4f84-bd8a-dc7c43dcff25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:42Z', 'updated_at': '2021-12-10T14:24:45Z', 'revision_number': 3, 'project_id': '605cf5d3d75a473d8c1129a632d22119', 'gw_port': {'id': 'b2afcf6e-a941-4f84-bd8a-dc7c43dcff25', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:1c:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '884fb027-f010-4f97-977b-e996c3355469', 'device_owner': 'network:router_gateway', 'standard_attr_id': 216, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:44Z', 'updated_at': '2021-12-10T14:24:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:48.258586 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.20.0.3 (826f4ffe-6ffa-44c2-a055-d6d8b94c119d/acea17da-7f1b-4834-9b60-5d797c3b126f/a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:48.260832 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a24f64a0-3fd9-4816-a678-c90c6a59ae19 req-be7694e7-5f14-4249-9bdd-088b49c564fc tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1711752 Dec 10 14:24:48.281747 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Checking router: 884fb027-f010-4f97-977b-e996c3355469 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:24:48.282466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Updating router 884fb027-f010-4f97-977b-e996c3355469 port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:24:48.283977 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b97ca38-95d5-48b7-8e38-72d8e9d1dbf0 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.316890 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-837a65b3-5865-4715-82e6-8d0fa0f80506 req-686feaab-07cf-4ffd-81ea-bac1e189fd3f service neutron] 10.222.0.39 "GET /v2.0/networks/8a88c7d6-baa3-4bff-a8db-78e7aa6fb066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2554820 Dec 10 14:24:48.317471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.325140 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c97edcd7-0136-4a7d-9798-4cd191378c49 req-b6f4fc23-ef63-411d-a9ed-a6d5ddbe7af6 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1552582 Dec 10 14:24:48.493554 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-726f0b97-31f3-4794-86e4-684630047db0 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/routers/884fb027-f010-4f97-977b-e996c3355469 HTTP/1.1" status: 200 len: 908 time: 0.4047565 Dec 10 14:24:48.500302 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53068) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:48.513953 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1786543523', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': True}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:48.545758 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1699508f-358f-42ec-8fd2-e3a4aff62f17 req-f3f6e328-c5fd-43c5-b782-5debf532996d tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:48.547996 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1699508f-358f-42ec-8fd2-e3a4aff62f17 req-f3f6e328-c5fd-43c5-b782-5debf532996d tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 944 time: 0.0720792 Dec 10 14:24:48.577057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.598833 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1699508f-358f-42ec-8fd2-e3a4aff62f17 req-2bf37324-cfb8-4f60-90c6-2790cd4a0b05 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431163 Dec 10 14:24:48.605890 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-2b97ca38-95d5-48b7-8e38-72d8e9d1dbf0 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:24:48.609070 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2b97ca38-95d5-48b7-8e38-72d8e9d1dbf0 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 400 len: 373 time: 0.5485339 Dec 10 14:24:48.618071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53070) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:48.624166 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': 'ca5a68a7-bc8b-4143-83e1-3d56159dcf3b', 'fixed_ip_address': '172.20.0.3'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:48.629163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.638766 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-bc9d3735-6283-46a6-bfbd-c60a540c75f2 service neutron] 10.222.0.39 "GET /v2.0/networks/90ab95ca-b6c7-4d4c-8815-86eb5dad26d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3770945 Dec 10 14:24:48.640189 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.api [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 10 14:24:48.640189 dv-neutron-821401-2-hyperv neutron-server[103811]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 10 14:24:48.640189 dv-neutron-821401-2-hyperv neutron-server[103811]: [parameters: {'project_id_1': 'e68e4d52db984b87ab42e0ca79c7de4c', 'expiration_1': datetime.datetime(2021, 12, 10, 14, 24, 28, 630583)}] Dec 10 14:24:48.640189 dv-neutron-821401-2-hyperv neutron-server[103811]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103811) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:24:48.642156 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG oslo_db.api [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:24:48.657684 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.816613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.852645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.871614 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Attempting to bind port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:48.872013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Attempting to bind port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:48.876101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Attempting to bind port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:48.876101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6498bab1-f5f2-4455-878e-cb7a63b74075 None None] Pushing event updated for resources: {'Port': ['ID=b2afcf6e-a941-4f84-bd8a-dc7c43dcff25,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:48.881015 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:48.881494 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:48.881863 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.882252 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:48.883360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Bound port: b2afcf6e-a941-4f84-bd8a-dc7c43dcff25, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:48.883360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.889615 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.890657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.907032 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-fcdceb90-f143-4538-a51d-0938ad1d90a2 req-61831650-92a4-4877-9fad-37c41ec8e2a4 service neutron] 10.222.0.39 "GET /v2.0/networks/90ab95ca-b6c7-4d4c-8815-86eb5dad26d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2574599 Dec 10 14:24:48.944792 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] For port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:48.948578 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] For port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b2afcf6e-a941-4f84-bd8a-dc7c43dcff25,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:48.979368 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:48.988481 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.043734 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.060563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.106790 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Routers {'884fb027-f010-4f97-977b-e996c3355469'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:49.107874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['884fb027-f010-4f97-977b-e996c3355469'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:49.142779 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6498bab1-f5f2-4455-878e-cb7a63b74075 None None] Pushing event updated for resources: {'Port': ['ID=b2afcf6e-a941-4f84-bd8a-dc7c43dcff25,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:49.156745 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53082) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:49.223507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] Set router 884fb027-f010-4f97-977b-e996c3355469 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:49.244768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:49.252496 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.284243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:49.318231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.320551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:49.323256 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:49.327142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.472912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '884fb027-f010-4f97-977b-e996c3355469', 'name': 'tempest-snat-router-1786543523', 'tenant_id': '605cf5d3d75a473d8c1129a632d22119', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.54'}], 'enable_snat': False}, 'gw_port_id': 'b2afcf6e-a941-4f84-bd8a-dc7c43dcff25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:42Z', 'updated_at': '2021-12-10T14:24:45Z', 'revision_number': 3, 'project_id': '605cf5d3d75a473d8c1129a632d22119', 'gw_port': {'id': 'b2afcf6e-a941-4f84-bd8a-dc7c43dcff25', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:1c:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '884fb027-f010-4f97-977b-e996c3355469', 'device_owner': 'network:router_gateway', 'standard_attr_id': 216, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:44Z', 'updated_at': '2021-12-10T14:24:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:49.507490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45763ce-6373-4c6a-861a-4b0cceccabc7 None None] The sync data for ids ['884fb027-f010-4f97-977b-e996c3355469'] in dv-neutron-821401-2-hyperv is: [{'id': '884fb027-f010-4f97-977b-e996c3355469', 'name': 'tempest-snat-router-1786543523', 'tenant_id': '605cf5d3d75a473d8c1129a632d22119', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.54'}], 'enable_snat': False}, 'gw_port_id': 'b2afcf6e-a941-4f84-bd8a-dc7c43dcff25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:42Z', 'updated_at': '2021-12-10T14:24:45Z', 'revision_number': 3, 'project_id': '605cf5d3d75a473d8c1129a632d22119', 'gw_port': {'id': 'b2afcf6e-a941-4f84-bd8a-dc7c43dcff25', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:1c:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '884fb027-f010-4f97-977b-e996c3355469', 'device_owner': 'network:router_gateway', 'standard_attr_id': 216, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:44Z', 'updated_at': '2021-12-10T14:24:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:49.564604 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:24:49.614114 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.648792 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:49.674433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:49.675103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.718573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:49.729561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'port_id': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d', 'mac_address': 'fa:16:3e:05:8c:ad', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:24:49.733515 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33cf40b-876b-438b-8046-4b0522c65957 req-f3bf9b2e-438f-4bfc-becc-84f03d7e872a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:49.740843 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a33cf40b-876b-438b-8046-4b0522c65957 req-f3bf9b2e-438f-4bfc-becc-84f03d7e872a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 943 time: 0.1182451 Dec 10 14:24:49.752487 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9f820ca-4478-4a15-82b5-a1b5ddbcf8ef req-aa0be8ac-56d0-4eb9-a104-298bcb00a91c tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:49.760420 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d9f820ca-4478-4a15-82b5-a1b5ddbcf8ef req-aa0be8ac-56d0-4eb9-a104-298bcb00a91c tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 944 time: 0.1280284 Dec 10 14:24:49.783264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.801169 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:24:49.816212 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-27acfbd7-790d-43ba-be38-7ff710a84daf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 2.7310700 Dec 10 14:24:49.817038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.817610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 4f5b7518-7e59-44cf-a119-2f3b54ca635a {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:24:49.819455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53092) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:49.825565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'port': {'network_id': '826f4ffe-6ffa-44c2-a055-d6d8b94c119d', 'name': 'tempest-FloatingIPTestJSON-1651974048'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:49.830236 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:49.881022 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a33cf40b-876b-438b-8046-4b0522c65957 req-347079df-8eb1-4deb-aa90-bacdf7bfb7e3 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1391923 Dec 10 14:24:49.923741 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d9f820ca-4478-4a15-82b5-a1b5ddbcf8ef req-1a20968e-0846-4481-9207-6b2d6bf4394a tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1624012 Dec 10 14:24:49.931742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.937341 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:49.986429 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.042650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:50.082203 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] create failed (client error): There was a conflict when trying to complete your request. Dec 10 14:24:50.086023 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-97868b6d-1ae7-45d5-9327-e5c7c8f36363 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 3.4887538 Dec 10 14:24:50.090457 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53094) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:50.139737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.180349 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Made reservation on behalf of c2a7c581de164ccf910afaf96add3a69 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:50.183844 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.186810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-211b7f44-6e85-4220-bf7f-e8c0c2515536 req-07965020-f3e2-46e8-847d-8c28babf9339 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:50.186939 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.188609 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-211b7f44-6e85-4220-bf7f-e8c0c2515536 req-07965020-f3e2-46e8-847d-8c28babf9339 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 944 time: 0.1281164 Dec 10 14:24:50.199900 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Allocated IP 172.26.2.162 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/da9351fc-1879-4541-8805-229b414116be) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:50.234078 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['43abbe6e-ce29-43e5-89c8-32eadeb4aa8d'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:24:50.246168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] device_id is not set on port 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:24:50.332603 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-211b7f44-6e85-4220-bf7f-e8c0c2515536 req-2ee6f367-050d-4100-9951-c592100e53c8 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1308067 Dec 10 14:24:50.343207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.352447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-56d1b394-a404-4164-832d-e2c846570a48 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Deleting port 4808ad69-6a9f-468e-87d6-cc9cff3ea4b4 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:50.352784 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-56d1b394-a404-4164-832d-e2c846570a48 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.433791 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.479017 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.20.0.13 (826f4ffe-6ffa-44c2-a055-d6d8b94c119d/acea17da-7f1b-4834-9b60-5d797c3b126f/8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:50.513778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-56d1b394-a404-4164-832d-e2c846570a48 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.536919 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-56d1b394-a404-4164-832d-e2c846570a48 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Calling delete_port for 4808ad69-6a9f-468e-87d6-cc9cff3ea4b4 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:50.543448 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.588415 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:50.593568 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:50.595771 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event updated for resources: {'Port': ['ID=da9351fc-1879-4541-8805-229b414116be,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:50.597943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:50.695801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Allocated IP 172.26.2.8 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/bc2d76eb-dc35-4abd-9be8-f001554deec7) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:50.766943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Deleting port da9351fc-1879-4541-8805-229b414116be {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:50.767535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.846051 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.847622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.847954 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:50.860437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Calling delete_port for da9351fc-1879-4541-8805-229b414116be owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:50.922893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:51.067586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83fa34eb-abfb-4a5c-83a3-725197feb2a3 req-b63cadf4-1d2c-491d-b27d-6c2e66bc730a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:51.069208 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-83fa34eb-abfb-4a5c-83a3-725197feb2a3 req-b63cadf4-1d2c-491d-b27d-6c2e66bc730a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 944 time: 0.1019135 Dec 10 14:24:51.076635 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c39b83-038e-4801-ae86-c9bb12b070d0 req-51ea3785-3ba5-4474-a42c-55bf6be2a22f tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:51.078116 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-45c39b83-038e-4801-ae86-c9bb12b070d0 req-51ea3785-3ba5-4474-a42c-55bf6be2a22f tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 944 time: 0.0730844 Dec 10 14:24:51.167115 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-83fa34eb-abfb-4a5c-83a3-725197feb2a3 req-5cd2b86b-3544-414e-961d-6b6d7fe17e5b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0718997 Dec 10 14:24:51.167115 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-45c39b83-038e-4801-ae86-c9bb12b070d0 req-e54f9ee2-4f04-4979-bbe1-805d42cc89e6 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0741134 Dec 10 14:24:51.414584 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:51.470474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:51.470855 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:51.477389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6140ab14-23e7-4b8b-8f47-5d69093b06a5 req-3ff464a1-6dc5-499c-a51c-4a54812d42dc tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:51.478915 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6140ab14-23e7-4b8b-8f47-5d69093b06a5 req-3ff464a1-6dc5-499c-a51c-4a54812d42dc tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 944 time: 0.0500658 Dec 10 14:24:51.532687 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6140ab14-23e7-4b8b-8f47-5d69093b06a5 req-206f7c4f-585b-43fd-95f5-e653b9ece32a tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475073 Dec 10 14:24:51.551633 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:51.563558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 353a2f0c-9bc6-4935-a721-c19b3e0bc0da details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:24:51.581398 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b2afcf6e-a941-4f84-bd8a-dc7c43dcff25,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:51.590740 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:51.815418 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:51.828826 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'port_id': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da', 'mac_address': 'fa:16:3e:bc:67:94', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:24:51.854255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-56d1b394-a404-4164-832d-e2c846570a48 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:51.867770 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:51.880311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 353a2f0c-9bc6-4935-a721-c19b3e0bc0da {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:24:51.887872 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d1b394-a404-4164-832d-e2c846570a48 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Pushing event deleted for resources: {'Port': ['ID=4808ad69-6a9f-468e-87d6-cc9cff3ea4b4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:51.900406 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:51.922954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:51.925015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:51.929456 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:51.931121 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:51.980877 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=b2afcf6e-a941-4f84-bd8a-dc7c43dcff25,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:51.984518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event deleted for resources: {'Port': ['ID=da9351fc-1879-4541-8805-229b414116be,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:51.992216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:52.002268 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:52.003619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:52.009385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:24:52.012109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:52.013819 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-56d1b394-a404-4164-832d-e2c846570a48 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.016662 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:52.017045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.017949 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-56d1b394-a404-4164-832d-e2c846570a48 tempest-RoutersAdminNegativeTest-1304651975 tempest-RoutersAdminNegativeTest-1304651975-project-admin] 10.222.0.57 "DELETE /v2.0/ports/4808ad69-6a9f-468e-87d6-cc9cff3ea4b4 HTTP/1.1" status: 204 len: 168 time: 1.9271595 Dec 10 14:24:52.023497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:52.046407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:52.049590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.050208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Allocated IP 172.26.2.33 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/e3f2dcc9-5f5e-4b71-be81-94e249ea20e2) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:52.059619 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 1a32ff1b-25aa-44f4-9af3-1128013f508d details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:24:52.060513 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event updated for resources: {'Port': ['ID=bc2d76eb-dc35-4abd-9be8-f001554deec7,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:52.118339 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:52.210587 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] create failed (client error): The resource could not be found. Dec 10 14:24:52.211669 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-55b344e8-e556-4fac-bd28-80782877d1bc tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 404 len: 507 time: 3.5920966 Dec 10 14:24:52.215530 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53108) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:52.239220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.240310 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.244392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:52.248842 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.273894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '861150e5-b254-4a49-9e82-64b522c2d27d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:24:52.288194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:52.381029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:52.400769 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 1a32ff1b-25aa-44f4-9af3-1128013f508d, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=1a32ff1b-25aa-44f4-9af3-1128013f508d,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:52.407689 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e4c71299-b04d-4873-9629-73543deda370 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.5854952 Dec 10 14:24:52.407689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53114) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:52.414731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '1a32ff1b-25aa-44f4-9af3-1128013f508d', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'port_id': '1a32ff1b-25aa-44f4-9af3-1128013f508d', 'mac_address': 'fa:16:3e:b8:b8:a7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 371, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:24:52.415260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': '8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb', 'fixed_ip_address': '172.20.0.13'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:52.467687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.476007 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc69b17d-4112-46e2-bdd6-774413507bb6 req-c6ffe280-bca8-4401-b5c2-f3a6ee58b510 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:52.483346 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1a32ff1b-25aa-44f4-9af3-1128013f508d {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:24:52.485736 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cc69b17d-4112-46e2-bdd6-774413507bb6 req-c6ffe280-bca8-4401-b5c2-f3a6ee58b510 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 944 time: 0.2190733 Dec 10 14:24:52.494703 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-507210d2-ed94-478d-9139-66b8aeb4505c req-2be1975b-f91e-4005-91ce-b3ae7716bf35 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:52.496319 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-507210d2-ed94-478d-9139-66b8aeb4505c req-2be1975b-f91e-4005-91ce-b3ae7716bf35 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 944 time: 0.2439551 Dec 10 14:24:52.499060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.516989 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 1a32ff1b-25aa-44f4-9af3-1128013f508d, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=1a32ff1b-25aa-44f4-9af3-1128013f508d,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:52.529900 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.543305 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.561741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea48b9f6-8c92-49e0-b273-7c762c9abcff" -d '{"events": [{"server_uuid": "861150e5-b254-4a49-9e82-64b522c2d27d", "name": "network-vif-plugged", "status": "completed", "tag": "43abbe6e-ce29-43e5-89c8-32eadeb4aa8d"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:24:52.586538 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.599229 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.602522 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:52.605186 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:52.660299 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:52.662892 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:52.667928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53122) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:52.674809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=1a32ff1b-25aa-44f4-9af3-1128013f508d,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:52.683564 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-7e300577-4fb9-492f-89fe-5ea8987e7410 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Deleting port ca5a68a7-bc8b-4143-83e1-3d56159dcf3b {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:52.683999 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e300577-4fb9-492f-89fe-5ea8987e7410 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.689616 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-507210d2-ed94-478d-9139-66b8aeb4505c req-bb60f6c4-3826-48f5-9205-edcd07dd643f tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1810777 Dec 10 14:24:52.746328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event updated for resources: {'Port': ['ID=e3f2dcc9-5f5e-4b71-be81-94e249ea20e2,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:52.774307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.787729 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cc69b17d-4112-46e2-bdd6-774413507bb6 req-5e4a7317-1059-47e5-b4d5-97c6f60f70e9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3010230 Dec 10 14:24:52.854866 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['353a2f0c-9bc6-4935-a721-c19b3e0bc0da'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:24:52.910508 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['1a32ff1b-25aa-44f4-9af3-1128013f508d'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:24:52.933726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e300577-4fb9-492f-89fe-5ea8987e7410 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:52.972433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ff27630-f2e3-471d-ae30-efc0d21e2f01 req-3c2b1b0f-f873-4779-806b-03b677068392 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:52.975071 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6ff27630-f2e3-471d-ae30-efc0d21e2f01 req-3c2b1b0f-f873-4779-806b-03b677068392 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 945 time: 0.1842430 Dec 10 14:24:52.983190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-7e300577-4fb9-492f-89fe-5ea8987e7410 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Calling delete_port for ca5a68a7-bc8b-4143-83e1-3d56159dcf3b owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:52.994139 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6cc56c0a-7cdd-4d6e-b1ca-1ad140707c91 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.027386 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.045926 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:24:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43fdccdd-242d-47ec-89df-baa5df1978f7 x-openstack-request-id: req-43fdccdd-242d-47ec-89df-baa5df1978f7 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:24:53.046382 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "861150e5-b254-4a49-9e82-64b522c2d27d", "name": "network-vif-plugged", "status": "completed", "tag": "43abbe6e-ce29-43e5-89c8-32eadeb4aa8d", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:24:53.046902 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-43fdccdd-242d-47ec-89df-baa5df1978f7 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:24:53.047480 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '861150e5-b254-4a49-9e82-64b522c2d27d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d', 'code': 200} Dec 10 14:24:53.106574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.134986 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6ff27630-f2e3-471d-ae30-efc0d21e2f01 req-c7beffce-2e0b-4e22-9ade-d119e3f105e2 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1473234 Dec 10 14:24:53.228699 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.26.2.46 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/086400c3-84c7-4e62-b5d8-0bd40028d734) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:53.239741 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.295691 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6cc56c0a-7cdd-4d6e-b1ca-1ad140707c91 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.387079 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:53.399970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6cc56c0a-7cdd-4d6e-b1ca-1ad140707c91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.427552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e300577-4fb9-492f-89fe-5ea8987e7410 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.429972 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.440305 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:53.440872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.481648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Router a003c4a5-8f51-4a26-b8ef-6e572d26b46d is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:24:53.489328 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6cc56c0a-7cdd-4d6e-b1ca-1ad140707c91 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=c15f9c6f313e49ca9e1000fb82c78ba6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8178315 Dec 10 14:24:53.492383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53128) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:53.507503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c9e2e5-7c3a-440f-a353-009b49cdfaef req-0a8a02b1-1b19-4c84-8372-4fc16a433ef8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:53.509169 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-e2c9e2e5-7c3a-440f-a353-009b49cdfaef req-0a8a02b1-1b19-4c84-8372-4fc16a433ef8 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1098 time: 0.1145606 Dec 10 14:24:53.521449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e300577-4fb9-492f-89fe-5ea8987e7410 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event deleted for resources: {'Port': ['ID=ca5a68a7-bc8b-4143-83e1-3d56159dcf3b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:53.548583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc56c0a-7cdd-4d6e-b1ca-1ad140707c91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a02cc38-bc06-4d13-835d-9550715b3df3,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:53.558193 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-e2c9e2e5-7c3a-440f-a353-009b49cdfaef req-c4bf3392-f648-49fd-b329-f0ec80af07fb service neutron] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.598205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.614694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e300577-4fb9-492f-89fe-5ea8987e7410 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.618545 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7e300577-4fb9-492f-89fe-5ea8987e7410 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "DELETE /v2.0/ports/ca5a68a7-bc8b-4143-83e1-3d56159dcf3b HTTP/1.1" status: 204 len: 168 time: 1.4017069 Dec 10 14:24:53.621016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53130) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:53.632167 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.676766 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72bc5912-36d9-4357-8c40-052ad88f3cef tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:53.681397 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-72bc5912-36d9-4357-8c40-052ad88f3cef tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "GET /v2.0/ports?device_id=c7159e6e-b751-4d6c-932d-576c5c2b09dc HTTP/1.1" status: 200 len: 913 time: 0.0564518 Dec 10 14:24:53.681855 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53132) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:53.688702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.722342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4334a574-590f-4ef3-872d-6ff2fd72f84d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.745849 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:53.768276 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:53.781508 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:53.789676 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=086400c3-84c7-4e62-b5d8-0bd40028d734,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:53.794523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4334a574-590f-4ef3-872d-6ff2fd72f84d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.831470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:53.846081 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Sync routers for ids ['a003c4a5-8f51-4a26-b8ef-6e572d26b46d'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:53.870042 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Routers {'a003c4a5-8f51-4a26-b8ef-6e572d26b46d'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:53.871227 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a003c4a5-8f51-4a26-b8ef-6e572d26b46d'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:53.939914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-e2c9e2e5-7c3a-440f-a353-009b49cdfaef req-c4bf3392-f648-49fd-b329-f0ec80af07fb service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.963742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:53.968846 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2d33d0cd-66b9-43cf-872e-a55b93fc67a4 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 905 time: 5.4589500 Dec 10 14:24:53.971761 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53138) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:53.989178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event updated for resources: {'Port': ['ID=e3f2dcc9-5f5e-4b71-be81-94e249ea20e2,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:54.012084 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.018911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-e2c9e2e5-7c3a-440f-a353-009b49cdfaef req-c4bf3392-f648-49fd-b329-f0ec80af07fb service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.057696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4334a574-590f-4ef3-872d-6ff2fd72f84d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.060796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4334a574-590f-4ef3-872d-6ff2fd72f84d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.064436 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4334a574-590f-4ef3-872d-6ff2fd72f84d admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/2a02cc38-bc06-4d13-835d-9550715b3df3 HTTP/1.1" status: 204 len: 168 time: 0.5670044 Dec 10 14:24:54.067726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d916e68-6f55-4180-83e8-432076ee372a req-39ac0917-8cf9-4a2a-9074-83b260144970 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:54.068834 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6d916e68-6f55-4180-83e8-432076ee372a req-39ac0917-8cf9-4a2a-9074-83b260144970 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 945 time: 0.3076768 Dec 10 14:24:54.107488 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Set router a003c4a5-8f51-4a26-b8ef-6e572d26b46d gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:54.165456 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-e2c9e2e5-7c3a-440f-a353-009b49cdfaef req-c4bf3392-f648-49fd-b329-f0ec80af07fb service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.6436718 Dec 10 14:24:54.166057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4bf3392-f648-49fd-b329-f0ec80af07fb service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=3589321f-e6c4-48a3-87c4-5ee80fa71781,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:54.192396 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4334a574-590f-4ef3-872d-6ff2fd72f84d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a02cc38-bc06-4d13-835d-9550715b3df3,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:54.262911 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-777f3aba-9fd6-488a-9904-05d37e8ebf8e tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/routers/a003c4a5-8f51-4a26-b8ef-6e572d26b46d HTTP/1.1" status: 200 len: 906 time: 0.2836142 Dec 10 14:24:54.262911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53144) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:54.337059 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a003c4a5-8f51-4a26-b8ef-6e572d26b46d', 'name': 'tempest-snat-router-1786543523', 'tenant_id': '605cf5d3d75a473d8c1129a632d22119', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.8'}], 'enable_snat': True}, 'gw_port_id': 'bc2d76eb-dc35-4abd-9be8-f001554deec7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:48Z', 'updated_at': '2021-12-10T14:24:52Z', 'revision_number': 3, 'project_id': '605cf5d3d75a473d8c1129a632d22119', 'gw_port': {'id': 'bc2d76eb-dc35-4abd-9be8-f001554deec7', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:ca:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a003c4a5-8f51-4a26-b8ef-6e572d26b46d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 225, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:50Z', 'updated_at': '2021-12-10T14:24:50Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:54.379843 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7394a2b6-39b7-493b-a527-6ce346aa5e72 req-6ba4ef78-975f-4f25-98bb-75eaa8915413 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:54.381079 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Checking router: a003c4a5-8f51-4a26-b8ef-6e572d26b46d for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:24:54.381455 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Updating router a003c4a5-8f51-4a26-b8ef-6e572d26b46d port bc2d76eb-dc35-4abd-9be8-f001554deec7 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:24:54.387157 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7394a2b6-39b7-493b-a527-6ce346aa5e72 req-6ba4ef78-975f-4f25-98bb-75eaa8915413 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.4842379 Dec 10 14:24:54.421033 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.449279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.450606 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8368d4af-b744-40e8-abf6-b3c5d9fff8f4 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.2928755 Dec 10 14:24:54.454655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53148) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:54.464511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Request body: {'network': {'name': 'tempest-FloatingIPAdminTestJSON-test-network-110090231'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:54.496154 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6d916e68-6f55-4180-83e8-432076ee372a req-c08b177d-cd9f-462b-a2f7-32d562d49e00 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1311269 Dec 10 14:24:54.526140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.529766 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7394a2b6-39b7-493b-a527-6ce346aa5e72 req-3177e08d-3ac3-4edb-ac5a-7f0de3902cb2 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1380358 Dec 10 14:24:54.628964 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Made reservation on behalf of a7e7e6d5ec1249eab11dc6b13a869de7 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:54.632455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.662936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.718495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a6d6801-968e-46b7-9814-491365fca406 req-d2d6410c-d91f-4963-9b21-84a3cb72d304 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:54.720063 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5a6d6801-968e-46b7-9814-491365fca406 req-d2d6410c-d91f-4963-9b21-84a3cb72d304 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 945 time: 0.1151919 Dec 10 14:24:54.755297 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.807602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.813760 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5a6d6801-968e-46b7-9814-491365fca406 req-da152738-a3a1-4a60-b6c8-29e4d01dd9e5 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0848436 Dec 10 14:24:54.845548 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.893086 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb27a956-6db3-4505-95eb-c008765e87fb None None] Pushing event updated for resources: {'Port': ['ID=bc2d76eb-dc35-4abd-9be8-f001554deec7,revision_number=2']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:54.920930 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Attempting to bind port bc2d76eb-dc35-4abd-9be8-f001554deec7 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:54.921205 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Attempting to bind port bc2d76eb-dc35-4abd-9be8-f001554deec7 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:54.921580 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Attempting to bind port bc2d76eb-dc35-4abd-9be8-f001554deec7 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:54.927810 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:54.928188 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:54.929816 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.929816 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:54.929816 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Bound port: bc2d76eb-dc35-4abd-9be8-f001554deec7, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:54.941288 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.952299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53150) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:54.967496 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:54.984699 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] For port bc2d76eb-dc35-4abd-9be8-f001554deec7, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:54.987993 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] For port bc2d76eb-dc35-4abd-9be8-f001554deec7, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=bc2d76eb-dc35-4abd-9be8-f001554deec7,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:55.060459 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.099394 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6974f3e1-f370-45e0-b3ff-9dd4ae0dc5f1 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=696ab4b9acca421cb63bfeb0f3bc81c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1431251 Dec 10 14:24:55.102087 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53152) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:55.109959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.111992 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Routers {'a003c4a5-8f51-4a26-b8ef-6e572d26b46d'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:55.112787 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a003c4a5-8f51-4a26-b8ef-6e572d26b46d'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:55.153178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.154176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Deleting port 204051b2-60c8-4990-9900-9045b1b76d07 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:55.154529 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.168978 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb27a956-6db3-4505-95eb-c008765e87fb None None] Pushing event updated for resources: {'Port': ['ID=bc2d76eb-dc35-4abd-9be8-f001554deec7,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:55.206743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.217010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83297669-f652-457c-ba38-ce4e3663cb0a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.240277 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] Set router a003c4a5-8f51-4a26-b8ef-6e572d26b46d gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:24:55.255750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83297669-f652-457c-ba38-ce4e3663cb0a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.256944 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.275648 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.299701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] vlan segment allocate from pool success with {'vlan_id': 398, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:55.302230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Calling delete_port for 204051b2-60c8-4990-9900-9045b1b76d07 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:55.322331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.322637 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Added segment bab6f12a-9611-429f-a6c5-65d7001e80de of type vlan for network cddc1f75-fded-4d66-be87-4ea9449263df Dec 10 14:24:55.323804 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7be49409-0100-44b7-9389-297ed321d57e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:55.413390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Deleting port bc2d76eb-dc35-4abd-9be8-f001554deec7 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:55.413751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.416563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.464391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83297669-f652-457c-ba38-ce4e3663cb0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.466893 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a003c4a5-8f51-4a26-b8ef-6e572d26b46d', 'name': 'tempest-snat-router-1786543523', 'tenant_id': '605cf5d3d75a473d8c1129a632d22119', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.8'}], 'enable_snat': True}, 'gw_port_id': 'bc2d76eb-dc35-4abd-9be8-f001554deec7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:48Z', 'updated_at': '2021-12-10T14:24:52Z', 'revision_number': 3, 'project_id': '605cf5d3d75a473d8c1129a632d22119', 'gw_port': {'id': 'bc2d76eb-dc35-4abd-9be8-f001554deec7', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:ca:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a003c4a5-8f51-4a26-b8ef-6e572d26b46d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 225, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:50Z', 'updated_at': '2021-12-10T14:24:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:55.468439 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83297669-f652-457c-ba38-ce4e3663cb0a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.469811 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-83297669-f652-457c-ba38-ce4e3663cb0a admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/dcf57119-d484-4cb1-9f01-f8e276983da4 HTTP/1.1" status: 204 len: 168 time: 0.3660946 Dec 10 14:24:55.486277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83297669-f652-457c-ba38-ce4e3663cb0a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcf57119-d484-4cb1-9f01-f8e276983da4,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:55.496012 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ad012f-c51d-4394-ae79-a12e97c3943b None None] The sync data for ids ['a003c4a5-8f51-4a26-b8ef-6e572d26b46d'] in dv-neutron-821401-2-hyperv is: [{'id': 'a003c4a5-8f51-4a26-b8ef-6e572d26b46d', 'name': 'tempest-snat-router-1786543523', 'tenant_id': '605cf5d3d75a473d8c1129a632d22119', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.8'}], 'enable_snat': True}, 'gw_port_id': 'bc2d76eb-dc35-4abd-9be8-f001554deec7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:48Z', 'updated_at': '2021-12-10T14:24:52Z', 'revision_number': 3, 'project_id': '605cf5d3d75a473d8c1129a632d22119', 'gw_port': {'id': 'bc2d76eb-dc35-4abd-9be8-f001554deec7', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:ca:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a003c4a5-8f51-4a26-b8ef-6e572d26b46d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 225, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:50Z', 'updated_at': '2021-12-10T14:24:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:55.582653 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.600643 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:55.601474 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.602023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 353a2f0c-9bc6-4935-a721-c19b3e0bc0da up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:55.611347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.614576 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] For port bc2d76eb-dc35-4abd-9be8-f001554deec7, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=bc2d76eb-dc35-4abd-9be8-f001554deec7,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:55.614973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.654778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.661534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Calling delete_port for bc2d76eb-dc35-4abd-9be8-f001554deec7 owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:55.700123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.746080 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:24:55.751044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:55.751620 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.782981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=086400c3-84c7-4e62-b5d8-0bd40028d734,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:55.788220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event deleted for resources: {'Port': ['ID=204051b2-60c8-4990-9900-9045b1b76d07,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:55.806378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b01f0a-916c-42e4-be34-16a930b8c6c1 req-1ad45aa1-19af-4ccb-a3c9-a137c10e4133 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:55.807538 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d1b01f0a-916c-42e4-be34-16a930b8c6c1 req-1ad45aa1-19af-4ccb-a3c9-a137c10e4133 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 945 time: 0.2162511 Dec 10 14:24:55.842914 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.3855660 Dec 10 14:24:55.843603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53162) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:55.939870 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Request body: {'subnet': {'network_id': 'cddc1f75-fded-4d66-be87-4ea9449263df', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:55.942687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:55.993988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:55.995272 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:24:55.999024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5538edc-e5c4-44b5-8182-dcba54ebd838" -d '{"events": [{"server_uuid": "4a2c4f5f-1771-428d-b1b5-298cd362bc0e", "name": "network-vif-plugged", "status": "completed", "tag": "353a2f0c-9bc6-4935-a721-c19b3e0bc0da"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:24:56.015030 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524cbfad-b811-42bd-b7a6-439227de7b5a tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event updated for resources: {'Network': ['ID=cddc1f75-fded-4d66-be87-4ea9449263df,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:56.025994 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network cddc1f75-fded-4d66-be87-4ea9449263df details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:56.042723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d40c31ba-b4ca-4427-a94a-c6eb10742898 req-317e56cb-c62e-4f58-a4d5-15fb0dfb29f3 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:56.052596 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d40c31ba-b4ca-4427-a94a-c6eb10742898 req-317e56cb-c62e-4f58-a4d5-15fb0dfb29f3 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.4027846 Dec 10 14:24:56.118593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.126837 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.127022 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 1a32ff1b-25aa-44f4-9af3-1128013f508d up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:24:56.176748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.205483 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d1b01f0a-916c-42e4-be34-16a930b8c6c1 req-a5011cfa-8cf7-4a10-8a5f-f67c8310dfeb tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3898022 Dec 10 14:24:56.280564 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d40c31ba-b4ca-4427-a94a-c6eb10742898 req-a72c4632-97dd-4d18-8a44-52af40288f22 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2268579 Dec 10 14:24:56.316519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:56.388262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:24:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-39a0d164-0b08-4ccd-a868-64d33d44300f x-openstack-request-id: req-39a0d164-0b08-4ccd-a868-64d33d44300f {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:24:56.388590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a2c4f5f-1771-428d-b1b5-298cd362bc0e", "name": "network-vif-plugged", "status": "completed", "tag": "353a2f0c-9bc6-4935-a721-c19b3e0bc0da", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:24:56.388915 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-39a0d164-0b08-4ccd-a868-64d33d44300f {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:24:56.389336 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da', 'code': 200} Dec 10 14:24:56.429801 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP 907bdfeb-1546-46ea-8253-b727323a30c6 associated. External IP: 172.26.2.46, port: 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb. Dec 10 14:24:56.448119 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port 1a32ff1b-25aa-44f4-9af3-1128013f508d completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:24:56.453603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port 1a32ff1b-25aa-44f4-9af3-1128013f508d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:24:56.454323 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.482363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Router c7159e6e-b751-4d6c-932d-576c5c2b09dc has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:24:56.491200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Made reservation on behalf of a7e7e6d5ec1249eab11dc6b13a869de7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:56.495984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.499173 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e337dc-5bc5-408c-89ef-f456f95432c0 req-d1883de0-05e6-4556-ae73-fb338cf737cd tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:56.500796 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97e337dc-5bc5-408c-89ef-f456f95432c0 req-d1883de0-05e6-4556-ae73-fb338cf737cd tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 946 time: 0.1039994 Dec 10 14:24:56.606455 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:56.620174 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-98a1a7a0-872d-4cd5-9d3a-8cbdf77666b4 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "PUT /v2.0/routers/c7159e6e-b751-4d6c-932d-576c5c2b09dc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9367085 Dec 10 14:24:56.627826 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53176) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:56.635543 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff7bb9d0-9c07-403c-a842-6843cfdc8452 None None] Sync routers for ids ['c7159e6e-b751-4d6c-932d-576c5c2b09dc'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:56.679700 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff7bb9d0-9c07-403c-a842-6843cfdc8452 None None] Routers {'c7159e6e-b751-4d6c-932d-576c5c2b09dc'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:56.681539 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ff7bb9d0-9c07-403c-a842-6843cfdc8452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['c7159e6e-b751-4d6c-932d-576c5c2b09dc'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:56.684345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.686044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.739386 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ff7bb9d0-9c07-403c-a842-6843cfdc8452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:56.749392 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97e337dc-5bc5-408c-89ef-f456f95432c0 req-e2eae00a-4196-43f8-8b62-52e96cff0f15 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2387035 Dec 10 14:24:56.753765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-feaefc0d-8a4f-4b99-bc93-48b085a9bb49 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.777480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 1a32ff1b-25aa-44f4-9af3-1128013f508d, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=1a32ff1b-25aa-44f4-9af3-1128013f508d,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:56.778578 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff7bb9d0-9c07-403c-a842-6843cfdc8452 None None] Routers {'c7159e6e-b751-4d6c-932d-576c5c2b09dc'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:56.779265 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ff7bb9d0-9c07-403c-a842-6843cfdc8452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['c7159e6e-b751-4d6c-932d-576c5c2b09dc'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:56.827054 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ff7bb9d0-9c07-403c-a842-6843cfdc8452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:56.827628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff7bb9d0-9c07-403c-a842-6843cfdc8452 None None] The sync data for ids ['c7159e6e-b751-4d6c-932d-576c5c2b09dc'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:56.837816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event deleted for resources: {'Port': ['ID=bc2d76eb-dc35-4abd-9be8-f001554deec7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:56.857542 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.931311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=1a32ff1b-25aa-44f4-9af3-1128013f508d,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:56.967372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b23077-6eb9-4311-8c8f-012a1dd3ea41 req-52dbe9b7-71ef-4cfa-acc6-96df814e8a7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:56.969743 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-86b23077-6eb9-4311-8c8f-012a1dd3ea41 req-52dbe9b7-71ef-4cfa-acc6-96df814e8a7c service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 1099 time: 0.2586110 Dec 10 14:24:56.975043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-feaefc0d-8a4f-4b99-bc93-48b085a9bb49 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.977326 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-feaefc0d-8a4f-4b99-bc93-48b085a9bb49 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:56.990819 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.091470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-feaefc0d-8a4f-4b99-bc93-48b085a9bb49 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.092201 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-feaefc0d-8a4f-4b99-bc93-48b085a9bb49 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Fanout notify agent at l3_agent the message router_deleted on router c7159e6e-b751-4d6c-932d-576c5c2b09dc {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:24:57.099579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-feaefc0d-8a4f-4b99-bc93-48b085a9bb49 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.103146 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-feaefc0d-8a4f-4b99-bc93-48b085a9bb49 tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "DELETE /v2.0/routers/c7159e6e-b751-4d6c-932d-576c5c2b09dc HTTP/1.1" status: 204 len: 168 time: 0.4716961 Dec 10 14:24:57.103337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53186) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:57.147340 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53188) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:57.161869 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-6966c3e2-66bd-4b74-b16d-e8e79c834a9e tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Deleting subnet 0289a702-c4d2-4f4f-a3d1-eeb68609f52b {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:24:57.164735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6966c3e2-66bd-4b74-b16d-e8e79c834a9e tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.165881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.171522 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.208753 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6966c3e2-66bd-4b74-b16d-e8e79c834a9e tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.237172 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-86b23077-6eb9-4311-8c8f-012a1dd3ea41 req-19276338-2e96-4500-bebe-84f9bac33d2b service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2584207 Dec 10 14:24:57.245148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:24:57.294762 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.298208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'networks': [{'name': 'tempest-network--820743545'}, {'name': 'tempest-network--1188230864'}]} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:57.298625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'network': {'name': 'tempest-network--820743545'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:57.299338 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'network': {'name': 'tempest-network--1188230864'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:57.333874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.334399 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Fanout notify agent at l3_agent the message router_deleted on router a003c4a5-8f51-4a26-b8ef-6e572d26b46d {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:24:57.345226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.346413 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1af778ec-11a8-45ba-8371-20eb34ff6a69 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "DELETE /v2.0/routers/a003c4a5-8f51-4a26-b8ef-6e572d26b46d HTTP/1.1" status: 204 len: 168 time: 3.0850122 Dec 10 14:24:57.354838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53196) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:57.448891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6966c3e2-66bd-4b74-b16d-e8e79c834a9e tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.504500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Made reservation on behalf of 2f42fc032abf4f45b58e3cf6a9e11be4 for: {'network': 2} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:24:57.509128 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.526687 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a06558-df01-425c-b751-d55cdbe5e422 req-c09e4f42-ae6b-40c0-9b78-6f0271d08e1b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:57.528248 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d5a06558-df01-425c-b751-d55cdbe5e422 req-c09e4f42-ae6b-40c0-9b78-6f0271d08e1b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1591887 Dec 10 14:24:57.540547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.556869 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd03e26-9d03-481c-9e1a-acc8586dadd3 req-b3c3ab0e-8c78-400e-8178-6e9034a5b3f0 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:57.558571 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-efd03e26-9d03-481c-9e1a-acc8586dadd3 req-b3c3ab0e-8c78-400e-8178-6e9034a5b3f0 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 946 time: 0.1924841 Dec 10 14:24:57.646377 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d5a06558-df01-425c-b751-d55cdbe5e422 req-d606b17c-5907-49ad-853b-e5324e47e3f1 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1084013 Dec 10 14:24:57.673305 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-efd03e26-9d03-481c-9e1a-acc8586dadd3 req-06defe83-5c25-4d12-b05e-4235c6a2f902 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0980608 Dec 10 14:24:57.683729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6966c3e2-66bd-4b74-b16d-e8e79c834a9e tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.722736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6966c3e2-66bd-4b74-b16d-e8e79c834a9e tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.728416 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6966c3e2-66bd-4b74-b16d-e8e79c834a9e tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "DELETE /v2.0/subnets/0289a702-c4d2-4f4f-a3d1-eeb68609f52b HTTP/1.1" status: 204 len: 168 time: 0.6222062 Dec 10 14:24:57.728416 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6966c3e2-66bd-4b74-b16d-e8e79c834a9e tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event deleted for resources: {'Subnet': ['ID=0289a702-c4d2-4f4f-a3d1-eeb68609f52b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:57.734749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53200) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:57.735861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88b61454-f068-4b17-ba4c-21d000d6b4ea None None] Network 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:57.767010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event updated for resources: {'Subnet': ['ID=98872e2d-7886-464c-ba29-a756a514943a,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:57.803334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Checking segment: {'id': 'bab6f12a-9611-429f-a6c5-65d7001e80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'cddc1f75-fded-4d66-be87-4ea9449263df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:57.803701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Network hostable DHCP agents. Network: cddc1f75-fded-4d66-be87-4ea9449263df, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:24:57.810311 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:24:57.822813 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:57.826989 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43c24944-036d-4471-9da4-210d163db592 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:24:57.850641 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43c24944-036d-4471-9da4-210d163db592 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:57.853461 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-43c24944-036d-4471-9da4-210d163db592 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:57.914045 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-43c24944-036d-4471-9da4-210d163db592 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:57.934435 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43c24944-036d-4471-9da4-210d163db592 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:24:57.935611 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-43c24944-036d-4471-9da4-210d163db592 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:57.978215 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-43c24944-036d-4471-9da4-210d163db592 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:57.978862 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43c24944-036d-4471-9da4-210d163db592 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:24:57.979084 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.001755 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-172909e8-6fe6-4289-8555-c8e3b833155c None None] DHCP port deletion for 7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:24:58.009281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Network cddc1f75-fded-4d66-be87-4ea9449263df is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:24:58.016074 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9dfc37ca-cd62-42d8-8955-77aff8295205 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 5.6064117 Dec 10 14:24:58.026864 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53204) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:58.035682 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-bbbcfbf5-f683-4e41-94ac-b7a54e75185e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:58.066998 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-172909e8-6fe6-4289-8555-c8e3b833155c None None] Deleting port 7cf24920-e7c8-495b-b85d-44cbb7287549 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:58.067711 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-172909e8-6fe6-4289-8555-c8e3b833155c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.134547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, cddc1f75-fded-4d66-be87-4ea9449263df) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:58.153962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:58.154571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.173194 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-172909e8-6fe6-4289-8555-c8e3b833155c None None] For port 7cf24920-e7c8-495b-b85d-44cbb7287549, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7cf24920-e7c8-495b-b85d-44cbb7287549,segment=NetworkSegment(a6a42e1b-53b7-4681-a37c-f889e0fbbbfa),segment_id=a6a42e1b-53b7-4681-a37c-f889e0fbbbfa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:58.173665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-172909e8-6fe6-4289-8555-c8e3b833155c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.187313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.188900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-172909e8-6fe6-4289-8555-c8e3b833155c None None] Calling delete_port for 7cf24920-e7c8-495b-b85d-44cbb7287549 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:58.209159 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bbbcfbf5-f683-4e41-94ac-b7a54e75185e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.209456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.238285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdb8aa7f-e728-425b-a9ff-0377f173f5d5 None None] Network cddc1f75-fded-4d66-be87-4ea9449263df requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:24:58.243729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.256232 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-754ef51c-f426-473d-bd10-52755d48c132 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.3318920 Dec 10 14:24:58.256842 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53206) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:58.263096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Request body: {'router': {'name': 'tempest-FloatingIPAdminTestJSON-router-1560537552', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:58.265759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88188589-e931-49fd-b5ad-ef853aff924d req-35a6bc2d-8df0-45f6-9f47-a4092fefaeb0 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:58.267357 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-88188589-e931-49fd-b5ad-ef853aff924d req-35a6bc2d-8df0-45f6-9f47-a4092fefaeb0 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 946 time: 0.1382143 Dec 10 14:24:58.280507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1105e5-089d-42a6-b748-89200240a30d req-c5c85a84-4dda-43a7-9930-a871a051cd78 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:58.282490 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5c1105e5-089d-42a6-b748-89200240a30d req-c5c85a84-4dda-43a7-9930-a871a051cd78 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1815579 Dec 10 14:24:58.291817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.291817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.298466 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53208) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:58.356365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Request body: {'floatingip': {'port_id': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:24:58.405868 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-88188589-e931-49fd-b5ad-ef853aff924d req-84e7c346-e463-43df-9b8f-e3857e920342 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1222916 Dec 10 14:24:58.423161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=814b6c95-2f80-49ad-a21d-33fc40e35159,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:58.425785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] vlan segment allocate from pool success with {'vlan_id': 372, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:58.436082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for floatingip, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.444929 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.446417 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Added segment 00fe048f-80f3-4fba-ab01-2652d1c23420 of type vlan for network 3d85934c-307b-46c6-b5c5-173e5625ff05 Dec 10 14:24:58.477364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1a32ff1b-25aa-44f4-9af3-1128013f508d'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:24:58.480012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d45901c-6af5-4303-bef9-742d8c6b7319" -d '{"events": [{"server_uuid": "0eac01e5-2ef7-425a-8991-9164b917a3b5", "name": "network-vif-plugged", "status": "completed", "tag": "1a32ff1b-25aa-44f4-9af3-1128013f508d"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:24:58.496672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.497787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.505556 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Deleting port 7cf24920-e7c8-495b-b85d-44cbb7287549 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:58.505888 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.580201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bbbcfbf5-f683-4e41-94ac-b7a54e75185e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.612240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cddc1f75-fded-4d66-be87-4ea9449263df', 'network_id': 'cddc1f75-fded-4d66-be87-4ea9449263df', 'project_id': 'a7e7e6d5ec1249eab11dc6b13a869de7', 'fixed_ips': [{'subnet_id': '98872e2d-7886-464c-ba29-a756a514943a'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:24:58.613944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.626213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.630346 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:24:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-84fb659b-0438-43cf-801f-85fb2ccdc661 x-openstack-request-id: req-84fb659b-0438-43cf-801f-85fb2ccdc661 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:24:58.630672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0eac01e5-2ef7-425a-8991-9164b917a3b5", "name": "network-vif-plugged", "status": "completed", "tag": "1a32ff1b-25aa-44f4-9af3-1128013f508d", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:24:58.630932 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-84fb659b-0438-43cf-801f-85fb2ccdc661 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:24:58.631333 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1a32ff1b-25aa-44f4-9af3-1128013f508d', 'code': 200} Dec 10 14:24:58.634919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-172909e8-6fe6-4289-8555-c8e3b833155c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.673845 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.684789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bbbcfbf5-f683-4e41-94ac-b7a54e75185e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.684789 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-bbbcfbf5-f683-4e41-94ac-b7a54e75185e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP 907bdfeb-1546-46ea-8253-b727323a30c6 disassociated. External IP: 172.26.2.46, port: 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb. Dec 10 14:24:58.700356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] For port 7cf24920-e7c8-495b-b85d-44cbb7287549, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7cf24920-e7c8-495b-b85d-44cbb7287549,segment=NetworkSegment(a6a42e1b-53b7-4681-a37c-f889e0fbbbfa),segment_id=a6a42e1b-53b7-4681-a37c-f889e0fbbbfa)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:58.700866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.730891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Deleting port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:24:58.730891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.731272 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Calling delete_port for 7cf24920-e7c8-495b-b85d-44cbb7287549 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:58.740429 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] vlan segment allocate from pool success with {'vlan_id': 362, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:24:58.741360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172909e8-6fe6-4289-8555-c8e3b833155c None None] Pushing event deleted for resources: {'Port': ['ID=7cf24920-e7c8-495b-b85d-44cbb7287549,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:58.743343 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-172909e8-6fe6-4289-8555-c8e3b833155c None None] No DVR routers for this DVR port 7cf24920-e7c8-495b-b85d-44cbb7287549 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:24:58.771925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.772271 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Added segment 9ebb8030-bafa-4552-9c9b-4713aed8b9db of type vlan for network 3b2a36f9-397a-49bb-8ffd-c97e4a1bc19e Dec 10 14:24:58.847859 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Allocated IP 172.20.0.2 (cddc1f75-fded-4d66-be87-4ea9449263df/98872e2d-7886-464c-ba29-a756a514943a/3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:24:58.919647 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:58.960688 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fad8dab-7cfa-40d9-a08a-e7641d7ff7e8 req-c6c0deba-e0fb-40ee-a6a8-42225f9c19c4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:58.962210 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2fad8dab-7cfa-40d9-a08a-e7641d7ff7e8 req-c6c0deba-e0fb-40ee-a6a8-42225f9c19c4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 946 time: 0.1421928 Dec 10 14:24:58.973951 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.014722 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event deleted for resources: {'Port': ['ID=7cf24920-e7c8-495b-b85d-44cbb7287549,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:59.020383 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] No DVR routers for this DVR port 7cf24920-e7c8-495b-b85d-44cbb7287549 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:24:59.022030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.061952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.062453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.067933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:59.072762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:59.073387 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.102994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.135144 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.148354 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2fad8dab-7cfa-40d9-a08a-e7641d7ff7e8 req-b19f8b9c-91eb-423d-bbc5-341217a18db0 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1713250 Dec 10 14:24:59.160436 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] For port b2afcf6e-a941-4f84-bd8a-dc7c43dcff25, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b2afcf6e-a941-4f84-bd8a-dc7c43dcff25,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:24:59.160802 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.183977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Network cddc1f75-fded-4d66-be87-4ea9449263df is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:24:59.187006 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:24:59.191445 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:24:59.196900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Pushing event updated for resources: {'Port': ['ID=3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:59.218873 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.221605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Network': ['ID=3d85934c-307b-46c6-b5c5-173e5625ff05,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:59.240768 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1319 time: 2.0900776 Dec 10 14:24:59.248796 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 3d85934c-307b-46c6-b5c5-173e5625ff05 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:59.252961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53220) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:59.274155 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7a7d6fbc-4574-4686-8d7f-b0c28ab87c25']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:59.298948 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Attempting to bind port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:24:59.299440 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Attempting to bind port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'bab6f12a-9611-429f-a6c5-65d7001e80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'cddc1f75-fded-4d66-be87-4ea9449263df'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:24:59.299900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Attempting to bind port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b on network cddc1f75-fded-4d66-be87-4ea9449263df {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:24:59.314363 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:24:59.314897 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Checking segment: {'id': 'bab6f12a-9611-429f-a6c5-65d7001e80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'cddc1f75-fded-4d66-be87-4ea9449263df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:24:59.315540 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.315980 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Bound using segment: {'id': 'bab6f12a-9611-429f-a6c5-65d7001e80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'cddc1f75-fded-4d66-be87-4ea9449263df'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:24:59.316771 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Bound port: 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bab6f12a-9611-429f-a6c5-65d7001e80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'cddc1f75-fded-4d66-be87-4ea9449263df'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:24:59.317058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.335442 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a6a42e1b-53b7-4681-a37c-f889e0fbbbfa') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:59.335725 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a6a42e1b-53b7-4681-a37c-f889e0fbbbfa') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:59.373060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.399988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b815edc-80e0-448b-a923-be27f1a051be tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Network': ['ID=3b2a36f9-397a-49bb-8ffd-c97e4a1bc19e,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:59.405750 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7cf24920-e7c8-495b-b85d-44cbb7287549 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:24:59.411789 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.415818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 3b2a36f9-397a-49bb-8ffd-c97e4a1bc19e details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:24:59.425301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Releasing vlan 376 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:59.425741 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:59.430596 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:24:59.465226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Calling delete_port for b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:24:59.495774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04deffb1-5565-481a-8a76-5b5238369904 req-290a03b5-359c-4487-b41e-c8e90e4a9c93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:59.498977 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-04deffb1-5565-481a-8a76-5b5238369904 req-290a03b5-359c-4487-b41e-c8e90e4a9c93 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 1099 time: 0.4728029 Dec 10 14:24:59.516984 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 7cf24920-e7c8-495b-b85d-44cbb7287549 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:24:59.517563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7cf24920-e7c8-495b-b85d-44cbb7287549 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:24:59.518178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device bc2d76eb-dc35-4abd-9be8-f001554deec7 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:24:59.520596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4c8e900-bfb9-43f7-ac82-9479fae4f5cb tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:59.526639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4c8e900-bfb9-43f7-ac82-9479fae4f5cb tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:59.532823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4c8e900-bfb9-43f7-ac82-9479fae4f5cb tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:59.539094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4c8e900-bfb9-43f7-ac82-9479fae4f5cb tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:59.540809 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d4c8e900-bfb9-43f7-ac82-9479fae4f5cb tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2406 time: 0.2819443 Dec 10 14:24:59.542106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: bc2d76eb-dc35-4abd-9be8-f001554deec7 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:24:59.542613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device bc2d76eb-dc35-4abd-9be8-f001554deec7 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:24:59.544261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53224) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:24:59.575907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] For port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:24:59.624204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] For port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b,segment=NetworkSegment(bab6f12a-9611-429f-a6c5-65d7001e80de),segment_id=bab6f12a-9611-429f-a6c5-65d7001e80de)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:24:59.629460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.643734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.647004 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] 10.222.0.57 "DELETE /v2.0/networks/7a7d6fbc-4574-4686-8d7f-b0c28ab87c25 HTTP/1.1" status: 204 len: 168 time: 1.9108908 Dec 10 14:24:59.670075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33c279e-4c63-4140-83f6-c7d9d31fc3ea tempest-FloatingIPNegativeTestJSON-2145254924 tempest-FloatingIPNegativeTestJSON-2145254924-project] Pushing event deleted for resources: {'Network': ['ID=7a7d6fbc-4574-4686-8d7f-b0c28ab87c25,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:59.680724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b605345f-2a54-436d-b45e-ecddfa07a706 req-0382f704-08a6-4032-9a2e-f096e13cbfc0 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:24:59.682378 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b605345f-2a54-436d-b45e-ecddfa07a706 req-0382f704-08a6-4032-9a2e-f096e13cbfc0 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 946 time: 0.1395030 Dec 10 14:24:59.687451 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.729738 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.769249 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b605345f-2a54-436d-b45e-ecddfa07a706 req-14b466a1-236b-460e-898e-347b73a38971 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0763795 Dec 10 14:24:59.797238 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-04deffb1-5565-481a-8a76-5b5238369904 req-356f599d-117c-4fdb-abba-0e18b1dc62a6 service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2569332 Dec 10 14:24:59.847109 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.851562 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e01a4a-1baf-4fd7-b8d8-62c08d9a32eb None None] Pushing event updated for resources: {'Port': ['ID=3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:24:59.866678 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.resource_extend [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 10 14:24:59.877384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3d85934c-307b-46c6-b5c5-173e5625ff05']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:59.886914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '00fe048f-80f3-4fba-ab01-2652d1c23420') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:59.887247 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '00fe048f-80f3-4fba-ab01-2652d1c23420') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:24:59.909399 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.912917 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bbbcfbf5-f683-4e41-94ac-b7a54e75185e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:24:59.928372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.938009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Releasing vlan 372 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:24:59.938442 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.948020 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:24:59.961496 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:00.027176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.076760 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d067e0-f4fc-4743-bc6b-228be2c11266 req-aba20944-0824-49ec-93f0-8d292df5258c tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:00.081056 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a6d067e0-f4fc-4743-bc6b-228be2c11266 req-aba20944-0824-49ec-93f0-8d292df5258c tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 946 time: 0.1181383 Dec 10 14:25:00.100748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53230) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:00.107507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Request body: {'floatingip': {'port_id': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:00.179164 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.212677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.219909 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/networks/3d85934c-307b-46c6-b5c5-173e5625ff05 HTTP/1.1" status: 204 len: 168 time: 0.6677530 Dec 10 14:25:00.221620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a0a2845-d780-4980-a3c5-2966b72dc3c0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Network': ['ID=3d85934c-307b-46c6-b5c5-173e5625ff05,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:00.225378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53236) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:00.272969 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.299732 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for floatingip, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.346290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53238) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:00.375738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event deleted for resources: {'Port': ['ID=b2afcf6e-a941-4f84-bd8a-dc7c43dcff25,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:00.439961 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbbcfbf5-f683-4e41-94ac-b7a54e75185e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:00.445080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.455322 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f1f5550-3885-4ad3-a555-8bca5148b0fd None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:00.472603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f1f5550-3885-4ad3-a555-8bca5148b0fd None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:00.477361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4f1f5550-3885-4ad3-a555-8bca5148b0fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:00.492319 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.497910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bbbcfbf5-f683-4e41-94ac-b7a54e75185e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.518029 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-139ab61d-5960-48ec-a2e5-e8ae0e59f120 req-0a8925c3-1e36-41b1-9dd8-6ff2da8c8f50 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:00.520364 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Floating IP 0247fae1-143d-4fab-8336-554866ced01e associated. External IP: 172.26.2.92, port: 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d. Dec 10 14:25:00.525635 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-139ab61d-5960-48ec-a2e5-e8ae0e59f120 req-0a8925c3-1e36-41b1-9dd8-6ff2da8c8f50 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 946 time: 0.1802752 Dec 10 14:25:00.539163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.540100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4f1f5550-3885-4ad3-a555-8bca5148b0fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:00.545793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.553666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f1f5550-3885-4ad3-a555-8bca5148b0fd None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:00.554594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4f1f5550-3885-4ad3-a555-8bca5148b0fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:00.602207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4f1f5550-3885-4ad3-a555-8bca5148b0fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:00.603005 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f1f5550-3885-4ad3-a555-8bca5148b0fd None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:00.662324 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bbbcfbf5-f683-4e41-94ac-b7a54e75185e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/floatingips/907bdfeb-1546-46ea-8253-b727323a30c6 HTTP/1.1" status: 200 len: 687 time: 2.6343634 Dec 10 14:25:00.675125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53242) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:00.752365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.759055 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.811840 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-139ab61d-5960-48ec-a2e5-e8ae0e59f120 req-3658a714-b01a-4f33-9396-74a501e74913 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2851734 Dec 10 14:25:00.815392 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:00.828883 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-555b0add-1702-4033-bec3-34916f922bc5 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=e68e4d52db984b87ab42e0ca79c7de4c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4791434 Dec 10 14:25:00.840760 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53244) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:00.866714 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:25:00.894799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3b2a36f9-397a-49bb-8ffd-c97e4a1bc19e']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:00.914217 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Allocated IP 172.26.2.238 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/7613d4bb-4ff6-4d1c-94a9-405493ee29a5) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:00.951751 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9ebb8030-bafa-4552-9c9b-4713aed8b9db') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:00.952236 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9ebb8030-bafa-4552-9c9b-4713aed8b9db') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:00.994878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.062306 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.090701 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.115966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Releasing vlan 362 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:01.116377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:01.119674 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:01.159764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-067cd3ad-c530-4fcf-9fbf-eff8926d42f9 None None] Network cddc1f75-fded-4d66-be87-4ea9449263df requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:01.227999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-847268c7-9fd8-4d3a-b191-4b2481340293 None None] Provisioning complete for port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:01.228390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-847268c7-9fd8-4d3a-b191-4b2481340293 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.262194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.262782 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 884fb027-f010-4f97-977b-e996c3355469 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:25:01.272584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.278251 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.279446 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-42af61f8-d682-4701-9caf-09ff9f9147a9 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "DELETE /v2.0/routers/884fb027-f010-4f97-977b-e996c3355469 HTTP/1.1" status: 204 len: 168 time: 3.9215376 Dec 10 14:25:01.283825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53246) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:01.293519 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-456499015', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:01.363573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.365877 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port 086400c3-84c7-4e62-b5d8-0bd40028d734 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:01.366208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.398269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.413207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-847268c7-9fd8-4d3a-b191-4b2481340293 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.421943 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:01.474773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-847268c7-9fd8-4d3a-b191-4b2481340293 None None] For port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b,segment=NetworkSegment(bab6f12a-9611-429f-a6c5-65d7001e80de),segment_id=bab6f12a-9611-429f-a6c5-65d7001e80de)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:01.503341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.504581 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.530516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.551999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-847268c7-9fd8-4d3a-b191-4b2481340293 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.612565 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-847268c7-9fd8-4d3a-b191-4b2481340293 None None] Pushing event updated for resources: {'Port': ['ID=3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:01.657713 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.718488 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:01.722932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.728897 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] Sync routers for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:01.738937 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:01.739555 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:01.756208 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-923ff1fb-c2eb-420f-b844-d074bb06779f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "PUT /v2.0/floatingips/0247fae1-143d-4fab-8336-554866ced01e HTTP/1.1" status: 200 len: 990 time: 3.4371002 Dec 10 14:25:01.756208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '861150e5-b254-4a49-9e82-64b522c2d27d', 'tag': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:25:01.756475 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e" -d '{"events": [{"name": "network-changed", "server_uuid": "861150e5-b254-4a49-9e82-64b522c2d27d", "tag": "43abbe6e-ce29-43e5-89c8-32eadeb4aa8d"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:25:01.775301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e19dee91-5739-4ecf-801d-0d125c5acf93 None None] Provisioning complete for port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:01.776551 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e19dee91-5739-4ecf-801d-0d125c5acf93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.858569 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:25:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd1c30f0-3ccc-4a60-8309-25291a174ba9 x-openstack-request-id: req-dd1c30f0-3ccc-4a60-8309-25291a174ba9 {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:25:01.859301 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "861150e5-b254-4a49-9e82-64b522c2d27d", "tag": "43abbe6e-ce29-43e5-89c8-32eadeb4aa8d", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:25:01.859875 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-dd1c30f0-3ccc-4a60-8309-25291a174ba9 {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:25:01.861275 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '861150e5-b254-4a49-9e82-64b522c2d27d', 'tag': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d', 'status': 'completed', 'code': 200} Dec 10 14:25:01.862734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:01.868223 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:01.871367 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.resource_extend [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] It took 0.43 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 10 14:25:01.962073 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:01.995611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:01.996126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.005608 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.009020 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.012670 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/networks/3b2a36f9-397a-49bb-8ffd-c97e4a1bc19e HTTP/1.1" status: 204 len: 168 time: 1.7852824 Dec 10 14:25:02.036794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53256) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:02.049503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:02.092535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.093013 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.112844 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for 086400c3-84c7-4e62-b5d8-0bd40028d734 owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:02.117926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731e3dd0-fa38-4a69-9f8d-278e571a3053 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Network': ['ID=3b2a36f9-397a-49bb-8ffd-c97e4a1bc19e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:02.135943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.184011 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:02.195552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.201934 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:02.218547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event updated for resources: {'Port': ['ID=7613d4bb-4ff6-4d1c-94a9-405493ee29a5,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:02.271929 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4604f3d2-3795-4298-9081-b082ca066a88 req-a3939087-77a6-41ec-bd0d-fa973849f9fb tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:02.273553 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4604f3d2-3795-4298-9081-b082ca066a88 req-a3939087-77a6-41ec-bd0d-fa973849f9fb tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 946 time: 0.2594118 Dec 10 14:25:02.279483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-69df429a-a0fd-4b45-878a-1f6faedf632c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:02.281033 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-69df429a-a0fd-4b45-878a-1f6faedf632c service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1098 time: 0.4154115 Dec 10 14:25:02.310283 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.312898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.316311 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/94564528-0c2c-477d-ac03-339269b049de HTTP/1.1" status: 204 len: 168 time: 1.4722099 Dec 10 14:25:02.335823 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '0247fae1-143d-4fab-8336-554866ced01e', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'floating_ip_address': '172.26.2.92', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'port_id': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 144, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'mac_address': 'fa:16:3e:05:8c:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '861150e5-b254-4a49-9e82-64b522c2d27d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:24:21Z', 'updated_at': '2021-12-10T14:24:59Z', 'revision_number': 1, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:21Z', 'revision_number': 5, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:02.363273 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] Checking router: 196472fe-b965-4c82-9c4d-82a1d2dbdf83 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:25:02.364967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94564528-0c2c-477d-ac03-339269b049de,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:02.372558 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:02.373369 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:02.389292 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Floating IP 5f7a1c28-5e2b-40f5-bfbe-2878d2b822fe associated. External IP: 172.26.2.178, port: 353a2f0c-9bc6-4935-a721-c19b3e0bc0da. Dec 10 14:25:02.394206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.394558 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.394902 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.395235 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.395566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.395898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.396225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.396551 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.396876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.397197 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.397543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.397862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.398178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0411edfc-2d6f-49af-b3ac-ea9a30482851 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:02.420839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af468be4-2ec6-4aa9-b31f-1fddc6712085 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:02.427593 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af468be4-2ec6-4aa9-b31f-1fddc6712085 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:02.429205 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-af468be4-2ec6-4aa9-b31f-1fddc6712085 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.3836951 Dec 10 14:25:02.466894 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53260) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:02.478134 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4604f3d2-3795-4298-9081-b082ca066a88 req-552a6af4-24e3-4154-b3c2-8c656caf3ad1 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1703682 Dec 10 14:25:02.491341 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:02.491462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1260092573'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:02.679949 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-6e197735-5f71-494f-9b94-18de866e2ad1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:02.681594 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-6e197735-5f71-494f-9b94-18de866e2ad1 service neutron] 10.222.0.39 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 912 time: 0.3664289 Dec 10 14:25:02.733026 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.743785 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '0247fae1-143d-4fab-8336-554866ced01e', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'floating_ip_address': '172.26.2.92', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'port_id': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 144, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'mac_address': 'fa:16:3e:05:8c:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '861150e5-b254-4a49-9e82-64b522c2d27d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:24:21Z', 'updated_at': '2021-12-10T14:24:59Z', 'revision_number': 1, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:21Z', 'revision_number': 5, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:02.755942 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Made reservation on behalf of 2f42fc032abf4f45b58e3cf6a9e11be4 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:02.759351 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.760009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Router 67c47c57-09e4-4303-97e1-a2215115ce2a has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:02.773579 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9118ea9-99b5-4616-bfc7-e965e923a5bc None None] The sync data for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv is: [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '0247fae1-143d-4fab-8336-554866ced01e', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'floating_ip_address': '172.26.2.92', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'port_id': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 144, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'mac_address': 'fa:16:3e:05:8c:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '861150e5-b254-4a49-9e82-64b522c2d27d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:24:21Z', 'updated_at': '2021-12-10T14:24:59Z', 'revision_number': 1, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:21Z', 'revision_number': 5, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:02.853094 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-7e04d292-459b-44a8-967c-e5023bebb5c8 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 998 time: 0.1625991 Dec 10 14:25:02.868044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=086400c3-84c7-4e62-b5d8-0bd40028d734,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:02.889639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-77054291-1992-430c-abe7-1aca6f2f38d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.913516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] vlan segment allocate from pool success with {'vlan_id': 356, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:02.931259 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdccf2dd-5e0d-4113-b52d-87c067947ed6 req-380e6f3e-cb09-4caa-ba7c-82d7c1b5a38a tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:02.933357 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cdccf2dd-5e0d-4113-b52d-87c067947ed6 req-380e6f3e-cb09-4caa-ba7c-82d7c1b5a38a tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 946 time: 0.2214081 Dec 10 14:25:02.945245 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53268) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:02.951137 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-733ff931-e79b-4ed8-ac79-6398aeb7057d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Request body: {'floatingip': {'port_id': '1a32ff1b-25aa-44f4-9af3-1128013f508d'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:02.974990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:02.975332 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Added segment 038c7e92-60f5-4c0a-96d9-d22408fc1131 of type vlan for network bc754a23-7197-4268-baee-89f45654324c Dec 10 14:25:03.056516 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.059497 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.060689 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a11f569d-5ed2-4b6b-becd-a2128aff0670 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/floatingips/907bdfeb-1546-46ea-8253-b727323a30c6 HTTP/1.1" status: 204 len: 168 time: 2.3832614 Dec 10 14:25:03.067843 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53278) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:03.074720 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': 'a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:03.101602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-733ff931-e79b-4ed8-ac79-6398aeb7057d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for floatingip, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.138375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9093d85a-2191-4247-bd92-2ab1aef9d862 None None] New status for floating IP 0247fae1-143d-4fab-8336-554866ced01e: ACTIVE {{(pid=103812) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:25:03.247503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.295430 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:03.305961 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] Sync routers for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:03.326449 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:03.327596 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:03.345251 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.409164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-b7b6677f-d268-4475-8238-f81223113927 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:03.410720 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-b7b6677f-d268-4475-8238-f81223113927 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 200 len: 850 time: 0.5435460 Dec 10 14:25:03.441194 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8ea21035-73fe-44ee-a043-3911119f184f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "PUT /v2.0/floatingips/5f7a1c28-5e2b-40f5-bfbe-2878d2b822fe HTTP/1.1" status: 200 len: 992 time: 3.3360658 Dec 10 14:25:03.442410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'tag': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:25:03.444014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34" -d '{"events": [{"name": "network-changed", "server_uuid": "4a2c4f5f-1771-428d-b1b5-298cd362bc0e", "tag": "353a2f0c-9bc6-4935-a721-c19b3e0bc0da"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:25:03.506011 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.545699 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:25:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7d8604e-c54d-40c1-ac84-9aa39fddeafd x-openstack-request-id: req-c7d8604e-c54d-40c1-ac84-9aa39fddeafd {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:25:03.546195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4a2c4f5f-1771-428d-b1b5-298cd362bc0e", "tag": "353a2f0c-9bc6-4935-a721-c19b3e0bc0da", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:25:03.546617 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-c7d8604e-c54d-40c1-ac84-9aa39fddeafd {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:25:03.547159 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'tag': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da', 'status': 'completed', 'code': 200} Dec 10 14:25:03.569930 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:03.589707 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:03.606512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.721825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-3a3af83f-676a-4e1b-a2d6-27ce6b0e93a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:03.723613 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-3a3af83f-676a-4e1b-a2d6-27ce6b0e93a8 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=8f11a2c4cb6b474d81f884b20c96a97b&device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 1099 time: 0.1679556 Dec 10 14:25:03.726860 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:03.727298 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.739149 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.744845 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:03.745459 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.788236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.841486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.872962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:25:03.919477 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:03.937095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:25:03.937925 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b2afcf6e-a941-4f84-bd8a-dc7c43dcff25 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:25:03.945311 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:14Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '5f7a1c28-5e2b-40f5-bfbe-2878d2b822fe', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'floating_ip_address': '172.26.2.178', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'port_id': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 171, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'mac_address': 'fa:16:3e:bc:67:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:24:25Z', 'updated_at': '2021-12-10T14:25:01Z', 'revision_number': 1, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d', 'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'mac_address': 'fa:16:3e:92:7a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:12Z', 'updated_at': '2021-12-10T14:24:22Z', 'revision_number': 5, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'subnets': [{'id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:03.945946 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.4665313 Dec 10 14:25:03.955985 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53294) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:03.957299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-6f7cb996-ee44-41ee-b29d-cad8c37b357a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:03.959472 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-6f7cb996-ee44-41ee-b29d-cad8c37b357a service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=1cc2d855-81bd-4d95-a565-455c7130be80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.4995918 Dec 10 14:25:03.973258 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-253495021'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:03.988013 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] Checking router: 67c47c57-09e4-4303-97e1-a2215115ce2a for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:25:04.003281 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:04.004218 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:04.034808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-ca6bfac2-4520-48e7-85b2-afb0a4d0c764 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:04.036169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Network': ['ID=bc754a23-7197-4268-baee-89f45654324c,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:04.036433 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-ca6bfac2-4520-48e7-85b2-afb0a4d0c764 service neutron] 10.222.0.39 "GET /v2.0/networks?id=90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 HTTP/1.1" status: 200 len: 907 time: 0.2703962 Dec 10 14:25:04.086650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53296) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:04.116797 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.117145 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.117511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.117850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.118182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.118512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.118839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.119160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.119483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.119807 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.120129 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.120448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.120765 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9be377f0-128e-4baa-8a75-f87af0833744 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:04.138677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network bc754a23-7197-4268-baee-89f45654324c details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:04.150718 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:04.165536 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:04.205444 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Made reservation on behalf of 2f42fc032abf4f45b58e3cf6a9e11be4 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:04.208937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:04.229401 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-37f935d7-8060-472b-909f-1b1779b51627 service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2597237 Dec 10 14:25:04.293631 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.26.2.171 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/fe01b7dd-35e5-4b1e-83e4-8169a725877d) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:04.325249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] vlan segment allocate from pool success with {'vlan_id': 393, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:04.338579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-733ff931-e79b-4ed8-ac79-6398aeb7057d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:04.344374 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-241e9454-3835-40d8-a9b3-4b2d452f7bdb service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=353a2f0c-9bc6-4935-a721-c19b3e0bc0da HTTP/1.1" status: 200 len: 1000 time: 0.2780931 Dec 10 14:25:04.371064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:04.371683 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Added segment 3ca7405d-1039-400f-ab70-5e9705038b3f of type vlan for network 8942246a-531b-4dd4-9337-b2e7e8b5cfe5 Dec 10 14:25:04.381663 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d11a2c91-2b5c-4b03-8d0b-4b955f99861e req-647b98e7-6c78-4845-8ff4-ca7f7ededb5c service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1425905 Dec 10 14:25:04.445677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2e4235a1-9c9f-48c0-84fd-077c33d1965e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-22864245', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:04.462431 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-733ff931-e79b-4ed8-ac79-6398aeb7057d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:04.470145 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:14Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '5f7a1c28-5e2b-40f5-bfbe-2878d2b822fe', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'floating_ip_address': '172.26.2.178', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'port_id': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 171, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'mac_address': 'fa:16:3e:bc:67:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:24:25Z', 'updated_at': '2021-12-10T14:25:01Z', 'revision_number': 1, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d', 'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'mac_address': 'fa:16:3e:92:7a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:12Z', 'updated_at': '2021-12-10T14:24:22Z', 'revision_number': 5, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'subnets': [{'id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:04.501994 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af265a77-b7b5-4001-98a9-a5f1ac9df17e None None] The sync data for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv is: [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:14Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '5f7a1c28-5e2b-40f5-bfbe-2878d2b822fe', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'floating_ip_address': '172.26.2.178', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'port_id': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 171, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'mac_address': 'fa:16:3e:bc:67:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:24:25Z', 'updated_at': '2021-12-10T14:25:01Z', 'revision_number': 1, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d', 'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'mac_address': 'fa:16:3e:92:7a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:12Z', 'updated_at': '2021-12-10T14:24:22Z', 'revision_number': 5, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'subnets': [{'id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:04.530436 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Router 43cfa4d1-b60d-4556-8238-383470614599 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:25:04.648692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:04.660688 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6525f549-73c4-44c4-ab2c-987f39087283 None None] Sync routers for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:04.680561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6525f549-73c4-44c4-ab2c-987f39087283 None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:04.681589 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-6525f549-73c4-44c4-ab2c-987f39087283 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:04.717895 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-6525f549-73c4-44c4-ab2c-987f39087283 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:04.728796 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6525f549-73c4-44c4-ab2c-987f39087283 None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:04.729857 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-6525f549-73c4-44c4-ab2c-987f39087283 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:24:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:04.768700 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6abb7394-56f9-4cf0-af8d-b0724b357407 None None] New status for floating IP 5f7a1c28-5e2b-40f5-bfbe-2878d2b822fe: ACTIVE {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:25:04.774825 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-6525f549-73c4-44c4-ab2c-987f39087283 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:04.776012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6525f549-73c4-44c4-ab2c-987f39087283 None None] The sync data for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:04.862030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:04.864856 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-454b8366-c854-4832-9816-b0b2fb680bac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:04.866347 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-454b8366-c854-4832-9816-b0b2fb680bac service neutron] 10.222.0.39 "GET /v2.0/subnets?id=f95bfcc0-b514-425e-a401-25563b482fae HTTP/1.1" status: 200 len: 845 time: 0.5148549 Dec 10 14:25:04.963073 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4235a1-9c9f-48c0-84fd-077c33d1965e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:04.964094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4235a1-9c9f-48c0-84fd-077c33d1965e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:04.983630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:04.987560 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-365bacab-a2a9-4b46-97ad-0bda6add77a8 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 892 time: 6.7252717 Dec 10 14:25:04.987804 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53304) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:05.016847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.042842 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-733ff931-e79b-4ed8-ac79-6398aeb7057d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Floating IP 287231e3-6f8f-425c-b76d-d645e0eb329e associated. External IP: 172.26.2.196, port: 1a32ff1b-25aa-44f4-9af3-1128013f508d. Dec 10 14:25:05.049836 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-b9c418c6-763b-4071-80db-9a9f755ad04f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:05.051354 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-b9c418c6-763b-4071-80db-9a9f755ad04f service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=90ab95ca-b6c7-4d4c-8815-86eb5dad26d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1760705 Dec 10 14:25:05.113903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4235a1-9c9f-48c0-84fd-077c33d1965e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.126279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.131782 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:05.132359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.137388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6939baad-0651-44ab-b9f0-1d2174b05046 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.257400 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4235a1-9c9f-48c0-84fd-077c33d1965e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.321954 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.3610451 Dec 10 14:25:05.322775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bca2928-b5ce-4d7d-af7c-24c4091b7605 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Network': ['ID=8942246a-531b-4dd4-9337-b2e7e8b5cfe5,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:05.326298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53308) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:05.333302 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'ports': [{'network_id': 'bc754a23-7197-4268-baee-89f45654324c', 'name': 'tempest-port--1406546413', 'admin_state_up': True}, {'network_id': '8942246a-531b-4dd4-9337-b2e7e8b5cfe5', 'admin_state_up': False}]} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:05.333753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'port': {'network_id': 'bc754a23-7197-4268-baee-89f45654324c', 'name': 'tempest-port--1406546413', 'admin_state_up': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:05.334473 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'port': {'network_id': '8942246a-531b-4dd4-9337-b2e7e8b5cfe5', 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:05.339426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 8942246a-531b-4dd4-9337-b2e7e8b5cfe5 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:05.364946 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-eb2f88a5-f8bf-4b90-9646-2a4eb39751b1 service neutron] 10.222.0.39 "GET /v2.0/networks/90ab95ca-b6c7-4d4c-8815-86eb5dad26d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2529290 Dec 10 14:25:05.421729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.425482 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e4235a1-9c9f-48c0-84fd-077c33d1965e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.426706 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2e4235a1-9c9f-48c0-84fd-077c33d1965e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 1.3415952 Dec 10 14:25:05.445307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53310) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:05.477824 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-643694437'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:05.534227 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Allocated IP 172.26.2.104 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/b5e6a4c2-3747-4d6f-a6b6-64964b102298) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:05.568464 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:05.583932 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:05.590519 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:05.620560 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=fe01b7dd-35e5-4b1e-83e4-8169a725877d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:05.667116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Made reservation on behalf of d3343b3b6d35425bb712248f00332c2c for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:05.671094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.676509 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-733ff931-e79b-4ed8-ac79-6398aeb7057d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:05.686565 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c8dd7433-1085-4669-8ed9-8c9ddcfa4b34 req-c16f7b69-815d-43c2-a4f6-d08554d81853 service neutron] 10.222.0.39 "GET /v2.0/networks/90ab95ca-b6c7-4d4c-8815-86eb5dad26d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3136501 Dec 10 14:25:05.690492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.716959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.778251 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.844282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Made reservation on behalf of 2f42fc032abf4f45b58e3cf6a9e11be4 for: {'port': 2} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:05.848773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.877074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.978700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-733ff931-e79b-4ed8-ac79-6398aeb7057d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:05.985376 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-733ff931-e79b-4ed8-ac79-6398aeb7057d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:05.992704 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] Sync routers for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:06.003629 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:06.004376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:06.031314 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] device_id is not set on port 8f0f5024-96b3-45a0-a15b-6bd878bd758f yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:25:06.034627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.043593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.046641 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-733ff931-e79b-4ed8-ac79-6398aeb7057d tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "PUT /v2.0/floatingips/287231e3-6f8f-425c-b76d-d645e0eb329e HTTP/1.1" status: 200 len: 992 time: 3.1003685 Dec 10 14:25:06.048394 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'tag': '1a32ff1b-25aa-44f4-9af3-1128013f508d'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:25:06.059194 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c1d17c95-d4bd-48c8-b665-be524f164088" -d '{"events": [{"name": "network-changed", "server_uuid": "0eac01e5-2ef7-425a-8991-9164b917a3b5", "tag": "1a32ff1b-25aa-44f4-9af3-1128013f508d"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:25:06.132464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:06.143755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:06.145636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:25:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7125d294-3652-459f-9353-063c582a517c x-openstack-request-id: req-7125d294-3652-459f-9353-063c582a517c {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:25:06.145636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0eac01e5-2ef7-425a-8991-9164b917a3b5", "tag": "1a32ff1b-25aa-44f4-9af3-1128013f508d", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:25:06.145636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-7125d294-3652-459f-9353-063c582a517c {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:25:06.145910 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'tag': '1a32ff1b-25aa-44f4-9af3-1128013f508d', 'status': 'completed', 'code': 200} Dec 10 14:25:06.155852 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:06.161533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event updated for resources: {'Port': ['ID=b5e6a4c2-3747-4d6f-a6b6-64964b102298,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:06.173837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:06.197656 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.237579 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Allocated IP 172.20.0.1 (cddc1f75-fded-4d66-be87-4ea9449263df/98872e2d-7886-464c-ba29-a756a514943a/4b329c76-1d1a-4d3d-96ed-51b3b3843f11) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:06.249115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] vlan segment allocate from pool success with {'vlan_id': 366, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:06.275592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.275947 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Added segment 49c83a4f-e933-447b-901a-02f0bc8ab550 of type vlan for network 5cb05196-50ab-470a-b82c-465f1679670b Dec 10 14:25:06.277403 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2af44980-7143-4ee5-a786-f41850ee0e98,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:06.295673 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-fbbea941-d3f7-47d6-8256-67bcc34f9240 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:06.297327 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-fbbea941-d3f7-47d6-8256-67bcc34f9240 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=af5207bd54c6403799a8cc223fa0ea80&device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 1099 time: 0.1187425 Dec 10 14:25:06.319027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.347654 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.378606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.475041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-b38ca90a-6b1b-4363-ba9e-ec5ac8b401ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:06.476558 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-b38ca90a-6b1b-4363-ba9e-ec5ac8b401ad service neutron] 10.222.0.39 "GET /v2.0/networks?id=8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 HTTP/1.1" status: 200 len: 913 time: 0.1591990 Dec 10 14:25:06.516865 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '287231e3-6f8f-425c-b76d-d645e0eb329e', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'floating_ip_address': '172.26.2.196', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'port_id': '1a32ff1b-25aa-44f4-9af3-1128013f508d', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 183, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'mac_address': 'fa:16:3e:b8:b8:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:24:27Z', 'updated_at': '2021-12-10T14:25:03Z', 'revision_number': 1, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a0de3123-62f5-41a9-921c-6e2250a89def', 'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'mac_address': 'fa:16:3e:e1:ab:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_interface', 'standard_attr_id': 125, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:24Z', 'revision_number': 5, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'subnets': [{'id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:06.544937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] Checking router: 6b7d9a03-a75e-4f11-8074-0360686c8ab9 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:25:06.553778 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:06.554394 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:06.575359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.580867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:06.581539 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.591017 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.627780 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-6d801020-fdc6-48b2-9825-a6965d96b907 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=1a32ff1b-25aa-44f4-9af3-1128013f508d HTTP/1.1" status: 200 len: 1000 time: 0.1350164 Dec 10 14:25:06.664944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:06.723962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Network': ['ID=5cb05196-50ab-470a-b82c-465f1679670b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:06.751039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 5cb05196-50ab-470a-b82c-465f1679670b details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:06.752743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.781913 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-ccfe3706-bc18-47fd-9c00-4ec059655e4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:06.783380 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-ccfe3706-bc18-47fd-9c00-4ec059655e4d service neutron] 10.222.0.39 "GET /v2.0/subnets?id=f3e2204d-7027-4309-a5db-3d266a3ff37e HTTP/1.1" status: 200 len: 851 time: 0.1218066 Dec 10 14:25:06.787114 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6b33fecc-5306-482e-9ef7-6611bf03631f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.3400857 Dec 10 14:25:06.791082 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53322) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:06.806234 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Request body: {'subnet': {'network_id': '5cb05196-50ab-470a-b82c-465f1679670b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:06.873186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:06.874898 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] device_id is not set on port 79f0c295-7d66-45dd-9600-209f02537e3d yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:25:06.939182 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-d8b9bf96-bdad-41a2-be3e-80ab225ec588 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:06.940728 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-d8b9bf96-bdad-41a2-be3e-80ab225ec588 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=8a88c7d6-baa3-4bff-a8db-78e7aa6fb066&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1475031 Dec 10 14:25:07.016079 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.036124 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '287231e3-6f8f-425c-b76d-d645e0eb329e', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'floating_ip_address': '172.26.2.196', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'port_id': '1a32ff1b-25aa-44f4-9af3-1128013f508d', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 183, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'mac_address': 'fa:16:3e:b8:b8:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:24:27Z', 'updated_at': '2021-12-10T14:25:03Z', 'revision_number': 1, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a0de3123-62f5-41a9-921c-6e2250a89def', 'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'mac_address': 'fa:16:3e:e1:ab:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_interface', 'standard_attr_id': 125, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:24Z', 'revision_number': 5, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'subnets': [{'id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:07.057193 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.060966 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-eb91d024-bc2d-4b5a-b3a9-9fa5bf2b00ba service neutron] 10.222.0.39 "GET /v2.0/networks/8a88c7d6-baa3-4bff-a8db-78e7aa6fb066?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1111805 Dec 10 14:25:07.064162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce604f05-9fc9-42a5-ac1f-064123cbb67a None None] The sync data for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv is: [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '287231e3-6f8f-425c-b76d-d645e0eb329e', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'floating_ip_address': '172.26.2.196', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'port_id': '1a32ff1b-25aa-44f4-9af3-1128013f508d', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 183, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'mac_address': 'fa:16:3e:b8:b8:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:24:27Z', 'updated_at': '2021-12-10T14:25:03Z', 'revision_number': 1, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a0de3123-62f5-41a9-921c-6e2250a89def', 'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'mac_address': 'fa:16:3e:e1:ab:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_interface', 'standard_attr_id': 125, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:24Z', 'revision_number': 5, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'subnets': [{'id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:07.120926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.134310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Network cddc1f75-fded-4d66-be87-4ea9449263df is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:07.141838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.150019 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.153069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:07.163542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Made reservation on behalf of d3343b3b6d35425bb712248f00332c2c for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:07.167380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.190282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event updated for resources: {'Port': ['ID=4b329c76-1d1a-4d3d-96ed-51b3b3843f11,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:07.192732 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:07.289979 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=fe01b7dd-35e5-4b1e-83e4-8169a725877d,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:07.301855 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c1d17c95-d4bd-48c8-b665-be524f164088 req-3e620c2c-5baa-408c-ba41-16570f1dd264 service neutron] 10.222.0.39 "GET /v2.0/networks/8a88c7d6-baa3-4bff-a8db-78e7aa6fb066?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2328403 Dec 10 14:25:07.313407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.377448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.456778 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b18db1b-1465-403d-95c3-86c3bf57c6f3 None None] New status for floating IP 287231e3-6f8f-425c-b76d-d645e0eb329e: ACTIVE {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:25:07.515508 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.541799 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.547749 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6e540d66-1e13-4f04-93e1-0f9b4ac21703 None None] Provisioning complete for port 4b329c76-1d1a-4d3d-96ed-51b3b3843f11 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:07.548658 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6e540d66-1e13-4f04-93e1-0f9b4ac21703 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.641050 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Port': ['ID=8f0f5024-96b3-45a0-a15b-6bd878bd758f,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:07.733063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.735734 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6e540d66-1e13-4f04-93e1-0f9b4ac21703 None None] Port 4b329c76-1d1a-4d3d-96ed-51b3b3843f11 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:07.770602 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Checking segment: {'id': '038c7e92-60f5-4c0a-96d9-d22408fc1131', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'bc754a23-7197-4268-baee-89f45654324c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:07.771499 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Network hostable DHCP agents. Network: bc754a23-7197-4268-baee-89f45654324c, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:07.798475 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:07.851688 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP d55e5ecc-5d33-4955-b3db-2663f683892e associated. External IP: 172.26.2.171, port: a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125. Dec 10 14:25:07.979703 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Network bc754a23-7197-4268-baee-89f45654324c is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:08.075015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.114585 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, bc754a23-7197-4268-baee-89f45654324c) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:08.122411 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:08.122874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.125226 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbbe87aa-e9c1-4802-9633-c06634a17bd0 None None] Network bc754a23-7197-4268-baee-89f45654324c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:08.157548 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:08.160703 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Subnet': ['ID=0ab3f6eb-2c96-49a5-975e-9c2eec17c607,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:08.180369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Checking segment: {'id': '49c83a4f-e933-447b-901a-02f0bc8ab550', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '5cb05196-50ab-470a-b82c-465f1679670b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:08.180731 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network hostable DHCP agents. Network: 5cb05196-50ab-470a-b82c-465f1679670b, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:08.198809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Router 69343414-ca56-465a-9086-08c0e2e77d71 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:25:08.208278 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.211818 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Port': ['ID=79f0c295-7d66-45dd-9600-209f02537e3d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:08.235276 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Checking segment: {'id': '3ca7405d-1039-400f-ab70-5e9705038b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': '8942246a-531b-4dd4-9337-b2e7e8b5cfe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:08.240872 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Network hostable DHCP agents. Network: 8942246a-531b-4dd4-9337-b2e7e8b5cfe5, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:08.297184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:08.308030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d428fd2-4fbc-4d9c-aeb8-9dd6bdf8da13 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:08.318880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d428fd2-4fbc-4d9c-aeb8-9dd6bdf8da13 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:08.319584 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2d428fd2-4fbc-4d9c-aeb8-9dd6bdf8da13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:08.323053 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.330354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network 5cb05196-50ab-470a-b82c-465f1679670b is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:08.357607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2d428fd2-4fbc-4d9c-aeb8-9dd6bdf8da13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:08.366816 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d428fd2-4fbc-4d9c-aeb8-9dd6bdf8da13 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:08.367532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2d428fd2-4fbc-4d9c-aeb8-9dd6bdf8da13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:08.380395 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Network 8942246a-531b-4dd4-9337-b2e7e8b5cfe5 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:08.403694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2d428fd2-4fbc-4d9c-aeb8-9dd6bdf8da13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:08.404433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d428fd2-4fbc-4d9c-aeb8-9dd6bdf8da13 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:08.413243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:08.416829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event updated for resources: {'Port': ['ID=4b329c76-1d1a-4d3d-96ed-51b3b3843f11,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:08.424321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.425764 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.428841 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d5b8a1e-414f-435e-a224-156262df8de6 None None] Sync routers for ids ['69343414-ca56-465a-9086-08c0e2e77d71'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:08.440360 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d5b8a1e-414f-435e-a224-156262df8de6 None None] Routers {'69343414-ca56-465a-9086-08c0e2e77d71'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:08.440996 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6d5b8a1e-414f-435e-a224-156262df8de6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['69343414-ca56-465a-9086-08c0e2e77d71'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:08.467072 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fabfcd16-4fd3-4734-90bd-e397f404296b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 5.3978193 Dec 10 14:25:08.469082 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 5cb05196-50ab-470a-b82c-465f1679670b) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:08.477207 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 8942246a-531b-4dd4-9337-b2e7e8b5cfe5) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:08.479529 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6d5b8a1e-414f-435e-a224-156262df8de6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:08.480074 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb5b84c7-e1a5-4d4b-9a49-85bff8f13bf8 None None] Network 5cb05196-50ab-470a-b82c-465f1679670b requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:08.482669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:08.485747 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53332) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:08.489404 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:08.490251 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d5b8a1e-414f-435e-a224-156262df8de6 None None] Routers {'69343414-ca56-465a-9086-08c0e2e77d71'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:08.490857 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6d5b8a1e-414f-435e-a224-156262df8de6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['69343414-ca56-465a-9086-08c0e2e77d71'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:08.494498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:08.495118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.498790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:08.499545 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.529056 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6d5b8a1e-414f-435e-a224-156262df8de6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:08.529985 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d5b8a1e-414f-435e-a224-156262df8de6 None None] The sync data for ids ['69343414-ca56-465a-9086-08c0e2e77d71'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:08.535589 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f03c0e4e-9229-45a3-be0c-f399994a81c6 None None] Network 8942246a-531b-4dd4-9337-b2e7e8b5cfe5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:08.547945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.551889 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a3cd1382-a42a-49c3-8db5-3e77d5f32904 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 7.2642188 Dec 10 14:25:08.553565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53336) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:08.557874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f608ea3a-db56-4eb6-b6a5-4e2cc34998ae tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': False}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:08.594123 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-18f5edfb-099b-4415-b933-17b99d20cc87 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "GET /v2.0/floatingips/d55e5ecc-5d33-4955-b3db-2663f683892e HTTP/1.1" status: 200 len: 977 time: 0.1060250 Dec 10 14:25:08.596505 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53338) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:08.604995 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-eed444e7-a7a8-44f9-a4fd-6e2dcb13a7c9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 3.2772651 Dec 10 14:25:08.611392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53340) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:08.704390 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a31e032c-458f-4e1f-a0cb-db0ecf33fa01 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9093764 Dec 10 14:25:08.707819 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53342) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:08.712995 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Request body: {'network': {'name': 'tempest-router-network01--1018132222'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:08.726917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-5cb05196-50ab-470a-b82c-465f1679670b', 'network_id': '5cb05196-50ab-470a-b82c-465f1679670b', 'project_id': 'd3343b3b6d35425bb712248f00332c2c', 'fixed_ips': [{'subnet_id': '0ab3f6eb-2c96-49a5-975e-9c2eec17c607'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:08.727798 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.784757 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6b288507-edbe-4da6-a7df-ecdcf970adf6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 980 time: 0.1869361 Dec 10 14:25:08.787199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53344) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:08.787357 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Network cddc1f75-fded-4d66-be87-4ea9449263df is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:08.791589 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:08.792857 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'port_id': '8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:08.816012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.819158 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88045c32-b4dc-4a8d-a9d0-132795070842 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:08.831373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88045c32-b4dc-4a8d-a9d0-132795070842 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:08.831373 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-88045c32-b4dc-4a8d-a9d0-132795070842 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.2173409 Dec 10 14:25:08.836385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53346) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:08.859737 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Made reservation on behalf of d3343b3b6d35425bb712248f00332c2c for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:08.863863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.911114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] vlan segment allocate from pool success with {'vlan_id': 365, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:08.936427 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.982091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:08.982615 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Added segment 58a8d89d-1ce9-45fc-a09d-dc7a2195428b of type vlan for network 7227165d-b534-4973-be59-efaecf3d309c Dec 10 14:25:08.995114 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Allocated IP 172.20.0.2 (5cb05196-50ab-470a-b82c-465f1679670b/0ab3f6eb-2c96-49a5-975e-9c2eec17c607/6dc4c83f-ff68-477c-9142-8f39a51b7434) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:09.103287 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.221527 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3bed671c-54cd-45cd-b764-287b38801ca1 None None] Provisioning complete for port 4b329c76-1d1a-4d3d-96ed-51b3b3843f11 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:09.222126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3bed671c-54cd-45cd-b764-287b38801ca1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.255984 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.261565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:09.262141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.305891 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.312630 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3bed671c-54cd-45cd-b764-287b38801ca1 None None] Port 4b329c76-1d1a-4d3d-96ed-51b3b3843f11 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:09.378324 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Network': ['ID=7227165d-b534-4973-be59-efaecf3d309c,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:09.390677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 7227165d-b534-4973-be59-efaecf3d309c details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:09.392235 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a387cc06-d504-43bd-9aae-85fab4b63c2f tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6834540 Dec 10 14:25:09.395284 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53350) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:09.400022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Request body: {'network': {'name': 'tempest-router-network02--929285508'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:09.454954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.493120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Network 5cb05196-50ab-470a-b82c-465f1679670b is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:09.501463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Router 43cfa4d1-b60d-4556-8238-383470614599 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:09.507042 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:09.512216 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:09.513748 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f608ea3a-db56-4eb6-b6a5-4e2cc34998ae tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.521108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9860e039-99cb-45c8-8394-a39ff2a80480 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Deleting port 8f0f5024-96b3-45a0-a15b-6bd878bd758f {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:09.521108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9860e039-99cb-45c8-8394-a39ff2a80480 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.562744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Pushing event updated for resources: {'Port': ['ID=6dc4c83f-ff68-477c-9142-8f39a51b7434,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:09.576520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.577061 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.577538 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.578008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.578443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.578880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.579327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.579762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.580205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.580650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.581076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.582183 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.582183 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:25:09.589213 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Attempting to bind port 6dc4c83f-ff68-477c-9142-8f39a51b7434 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:09.590044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Attempting to bind port 6dc4c83f-ff68-477c-9142-8f39a51b7434 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '49c83a4f-e933-447b-901a-02f0bc8ab550', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '5cb05196-50ab-470a-b82c-465f1679670b'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:09.590517 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Attempting to bind port 6dc4c83f-ff68-477c-9142-8f39a51b7434 on network 5cb05196-50ab-470a-b82c-465f1679670b {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:09.596100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:09.601458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Checking segment: {'id': '49c83a4f-e933-447b-901a-02f0bc8ab550', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '5cb05196-50ab-470a-b82c-465f1679670b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:09.601458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.601458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Bound using segment: {'id': '49c83a4f-e933-447b-901a-02f0bc8ab550', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '5cb05196-50ab-470a-b82c-465f1679670b'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:09.601458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Bound port: 6dc4c83f-ff68-477c-9142-8f39a51b7434, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '49c83a4f-e933-447b-901a-02f0bc8ab550', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '5cb05196-50ab-470a-b82c-465f1679670b'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:09.601458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.601886 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Made reservation on behalf of d3343b3b6d35425bb712248f00332c2c for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:09.605302 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.648722 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] vlan segment allocate from pool success with {'vlan_id': 384, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:09.658046 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9860e039-99cb-45c8-8394-a39ff2a80480 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.683645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] For port 6dc4c83f-ff68-477c-9142-8f39a51b7434, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:09.686132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9860e039-99cb-45c8-8394-a39ff2a80480 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Calling delete_port for 8f0f5024-96b3-45a0-a15b-6bd878bd758f owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:09.688008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] For port 6dc4c83f-ff68-477c-9142-8f39a51b7434, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6dc4c83f-ff68-477c-9142-8f39a51b7434,segment=NetworkSegment(49c83a4f-e933-447b-901a-02f0bc8ab550),segment_id=49c83a4f-e933-447b-901a-02f0bc8ab550)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:09.693942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.694302 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Added segment 5b1a4aea-89c6-4b5a-976b-a83dcb3e9567 of type vlan for network 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca Dec 10 14:25:09.765590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.773908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.790945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.808707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:09.816305 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-86be0e00-d3a2-455b-b806-0c7d3aaeeb56 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "PUT /v2.0/routers/43cfa4d1-b60d-4556-8238-383470614599/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8274608 Dec 10 14:25:09.821330 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53356) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:09.823881 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f6171fe-da13-4981-9715-98d82a24f89f None None] Sync routers for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:09.830488 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Request body: {'port': {'network_id': 'cddc1f75-fded-4d66-be87-4ea9449263df', 'name': 'tempest-FloatingIPAdminTestJSON-1448669041'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:09.851043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.852207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c56fe616-1e56-47e5-84ac-e148100da09c None None] Pushing event updated for resources: {'Port': ['ID=6dc4c83f-ff68-477c-9142-8f39a51b7434,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:09.855786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f6171fe-da13-4981-9715-98d82a24f89f None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:09.856422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7f6171fe-da13-4981-9715-98d82a24f89f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:09.896244 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7f6171fe-da13-4981-9715-98d82a24f89f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:09.900978 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.906703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f6171fe-da13-4981-9715-98d82a24f89f None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:09.907131 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:09.907493 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7f6171fe-da13-4981-9715-98d82a24f89f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:09.907839 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:09.950486 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7f6171fe-da13-4981-9715-98d82a24f89f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:09.951663 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f6171fe-da13-4981-9715-98d82a24f89f None None] The sync data for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:10.038364 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.6396298 Dec 10 14:25:10.040984 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53358) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:10.051317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Request body: {'subnet': {'network_id': '7227165d-b534-4973-be59-efaecf3d309c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:10.061692 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8699d80-c83e-4307-8f0b-23650b2b6f58 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Network': ['ID=2d3a78f5-ce1f-4d70-a49e-78fdf44089ca,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:10.077459 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:10.103058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9860e039-99cb-45c8-8394-a39ff2a80480 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.173999 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP d55e5ecc-5d33-4955-b3db-2663f683892e associated. External IP: 172.26.2.171, port: a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125. Dec 10 14:25:10.174152 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9860e039-99cb-45c8-8394-a39ff2a80480 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.179703 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9860e039-99cb-45c8-8394-a39ff2a80480 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/ports/8f0f5024-96b3-45a0-a15b-6bd878bd758f HTTP/1.1" status: 204 len: 168 time: 1.3397646 Dec 10 14:25:10.181540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9860e039-99cb-45c8-8394-a39ff2a80480 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Port': ['ID=8f0f5024-96b3-45a0-a15b-6bd878bd758f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:10.184832 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53362) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:10.251916 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Made reservation on behalf of a7e7e6d5ec1249eab11dc6b13a869de7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:10.256261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.310093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] device_id is not set on port 0e283c53-d685-420d-9540-2d89bb5ea30d yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:25:10.420815 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-5a37e461-1632-449e-9e68-19ea5dcb1b7f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Deleting port 79f0c295-7d66-45dd-9600-209f02537e3d {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:10.421144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5a37e461-1632-449e-9e68-19ea5dcb1b7f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.438703 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Made reservation on behalf of d3343b3b6d35425bb712248f00332c2c for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:10.442136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.507682 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f608ea3a-db56-4eb6-b6a5-4e2cc34998ae tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.513479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Allocated IP 172.20.0.12 (cddc1f75-fded-4d66-be87-4ea9449263df/98872e2d-7886-464c-ba29-a756a514943a/0e283c53-d685-420d-9540-2d89bb5ea30d) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:10.518161 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f608ea3a-db56-4eb6-b6a5-4e2cc34998ae tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.594920 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5a37e461-1632-449e-9e68-19ea5dcb1b7f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.622271 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-5a37e461-1632-449e-9e68-19ea5dcb1b7f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Calling delete_port for 79f0c295-7d66-45dd-9600-209f02537e3d owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:10.635432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:10.732498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f608ea3a-db56-4eb6-b6a5-4e2cc34998ae tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Router 69343414-ca56-465a-9086-08c0e2e77d71 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:10.823618 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.849518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:10.860383 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a663944-22cd-4c8e-b2e8-e54424af2daa None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:10.870706 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a663944-22cd-4c8e-b2e8-e54424af2daa None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:10.871323 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0a663944-22cd-4c8e-b2e8-e54424af2daa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:10.908585 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f608ea3a-db56-4eb6-b6a5-4e2cc34998ae tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:10.920749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f608ea3a-db56-4eb6-b6a5-4e2cc34998ae tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:10.920749 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f608ea3a-db56-4eb6-b6a5-4e2cc34998ae tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "PUT /v2.0/routers/69343414-ca56-465a-9086-08c0e2e77d71 HTTP/1.1" status: 200 len: 921 time: 2.3617830 Dec 10 14:25:10.922589 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53368) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:10.923078 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f60c84cf-9cc0-49c5-844c-a2f33717228e None None] Sync routers for ids ['69343414-ca56-465a-9086-08c0e2e77d71'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:10.931901 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0a663944-22cd-4c8e-b2e8-e54424af2daa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:10.943378 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f60c84cf-9cc0-49c5-844c-a2f33717228e None None] Routers {'69343414-ca56-465a-9086-08c0e2e77d71'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:10.944008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f60c84cf-9cc0-49c5-844c-a2f33717228e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['69343414-ca56-465a-9086-08c0e2e77d71'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:10.973381 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a663944-22cd-4c8e-b2e8-e54424af2daa None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:10.974042 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0a663944-22cd-4c8e-b2e8-e54424af2daa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:10.993558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f60c84cf-9cc0-49c5-844c-a2f33717228e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:11.003162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d20f3b0-e4f1-4556-8d03-b4de6ceca3ca None None] Network 5cb05196-50ab-470a-b82c-465f1679670b requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:11.007574 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f60c84cf-9cc0-49c5-844c-a2f33717228e None None] Routers {'69343414-ca56-465a-9086-08c0e2e77d71'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:11.008203 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f60c84cf-9cc0-49c5-844c-a2f33717228e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['69343414-ca56-465a-9086-08c0e2e77d71'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:11.036666 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.039315 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0a663944-22cd-4c8e-b2e8-e54424af2daa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:11.040269 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a663944-22cd-4c8e-b2e8-e54424af2daa None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:11.095784 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f60c84cf-9cc0-49c5-844c-a2f33717228e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:11.096340 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f60c84cf-9cc0-49c5-844c-a2f33717228e None None] The sync data for ids ['69343414-ca56-465a-9086-08c0e2e77d71'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:11.110934 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Network cddc1f75-fded-4d66-be87-4ea9449263df is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:11.118678 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:11.121862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:11.123479 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-903757da-efb2-45fe-bc46-4351a6cb0c4e None None] Provisioning complete for port 6dc4c83f-ff68-477c-9142-8f39a51b7434 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:11.123848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-903757da-efb2-45fe-bc46-4351a6cb0c4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.132353 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-32a1b7c7-2078-4206-a633-78a5897f9648 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/routers/69343414-ca56-465a-9086-08c0e2e77d71 HTTP/1.1" status: 200 len: 921 time: 0.2041209 Dec 10 14:25:11.132353 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53370) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:11.186070 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event updated for resources: {'Port': ['ID=0e283c53-d685-420d-9540-2d89bb5ea30d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:11.253125 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:11.253812 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.271421 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a264e88-4c04-42ab-be63-fafde07a2eee tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:11.272970 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9a264e88-4c04-42ab-be63-fafde07a2eee tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=69343414-ca56-465a-9086-08c0e2e77d71&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1399658 Dec 10 14:25:11.276689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53374) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:11.339101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-903757da-efb2-45fe-bc46-4351a6cb0c4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.412122 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5a37e461-1632-449e-9e68-19ea5dcb1b7f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.414541 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-903757da-efb2-45fe-bc46-4351a6cb0c4e None None] For port 6dc4c83f-ff68-477c-9142-8f39a51b7434, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6dc4c83f-ff68-477c-9142-8f39a51b7434,segment=NetworkSegment(49c83a4f-e933-447b-901a-02f0bc8ab550),segment_id=49c83a4f-e933-447b-901a-02f0bc8ab550)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:11.416212 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.514867 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6dc4c83f-ff68-477c-9142-8f39a51b7434 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:11.515474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5a37e461-1632-449e-9e68-19ea5dcb1b7f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.519247 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5a37e461-1632-449e-9e68-19ea5dcb1b7f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/ports/79f0c295-7d66-45dd-9600-209f02537e3d HTTP/1.1" status: 204 len: 168 time: 1.3311508 Dec 10 14:25:11.523605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a37e461-1632-449e-9e68-19ea5dcb1b7f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Port': ['ID=79f0c295-7d66-45dd-9600-209f02537e3d,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:11.529023 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53376) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:11.565279 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-903757da-efb2-45fe-bc46-4351a6cb0c4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.629744 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4b01cc08-fd83-4506-b2d8-c39198116729 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0957789 Dec 10 14:25:11.631452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 6dc4c83f-ff68-477c-9142-8f39a51b7434 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:11.631452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.637779 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Subnet': ['ID=f39cba28-0ea0-4d08-8bc7-c4185041907e,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:11.648064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53378) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:11.654674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1652144439'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:11.665127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903757da-efb2-45fe-bc46-4351a6cb0c4e None None] Pushing event updated for resources: {'Port': ['ID=6dc4c83f-ff68-477c-9142-8f39a51b7434,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:11.683645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Checking segment: {'id': '58a8d89d-1ce9-45fc-a09d-dc7a2195428b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '7227165d-b534-4973-be59-efaecf3d309c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:11.684911 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network hostable DHCP agents. Network: 7227165d-b534-4973-be59-efaecf3d309c, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:11.697938 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-efe9e120-78c6-43a4-905b-2b4797c14ae5 None None] Provisioning complete for port 0e283c53-d685-420d-9540-2d89bb5ea30d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:11.698451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-efe9e120-78c6-43a4-905b-2b4797c14ae5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.703529 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a22a08a4-41c1-43d4-b3d8-c93af8dd67d2 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 935 time: 1.8815162 Dec 10 14:25:11.713176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53380) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:11.759744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:11.772444 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-efe9e120-78c6-43a4-905b-2b4797c14ae5 None None] Port 0e283c53-d685-420d-9540-2d89bb5ea30d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:11.777454 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c07f29bd-0428-413a-8b54-93547691d11f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:11.778686 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c07f29bd-0428-413a-8b54-93547691d11f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 881 time: 0.5006323 Dec 10 14:25:11.781847 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53386) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:11.787511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-efe9e120-78c6-43a4-905b-2b4797c14ae5 None None] Provisioning complete for port 6dc4c83f-ff68-477c-9142-8f39a51b7434 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:11.787511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-efe9e120-78c6-43a4-905b-2b4797c14ae5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.818937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Made reservation on behalf of 2f42fc032abf4f45b58e3cf6a9e11be4 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:11.822795 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.847159 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9b0b8c2e-6904-4406-bc5f-f6b5fcde38fd tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=69343414-ca56-465a-9086-08c0e2e77d71 HTTP/1.1" status: 200 len: 205 time: 0.0639958 Dec 10 14:25:11.850637 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53388) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:11.879570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network 7227165d-b534-4973-be59-efaecf3d309c is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:11.893868 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] vlan segment allocate from pool success with {'vlan_id': 373, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:11.913924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'project_id': 'a7e7e6d5ec1249eab11dc6b13a869de7', 'port_id': '0e283c53-d685-420d-9540-2d89bb5ea30d'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:11.915185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.915863 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Added segment 45f2c3cb-962f-4a19-944b-814b20ddece2 of type vlan for network 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d Dec 10 14:25:11.926834 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:11.938874 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58bf3ea8-fefb-4c3f-a905-09b71fe1ad7c None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:11.940263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.956236 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58bf3ea8-fefb-4c3f-a905-09b71fe1ad7c None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:11.956849 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-58bf3ea8-fefb-4c3f-a905-09b71fe1ad7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:11.990646 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:11.991058 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-58bf3ea8-fefb-4c3f-a905-09b71fe1ad7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:12.001012 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58bf3ea8-fefb-4c3f-a905-09b71fe1ad7c None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:12.001649 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-58bf3ea8-fefb-4c3f-a905-09b71fe1ad7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:12.021682 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.029310 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 7227165d-b534-4973-be59-efaecf3d309c) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:12.038131 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b743766-dbe7-47ea-aea2-c353c160b509 None None] Network 7227165d-b534-4973-be59-efaecf3d309c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:12.042030 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-58bf3ea8-fefb-4c3f-a905-09b71fe1ad7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:12.042884 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58bf3ea8-fefb-4c3f-a905-09b71fe1ad7c None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:12.043192 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:12.044380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.056206 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fa2853c8-90a1-417e-8e2e-a025071de4ac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/floatingips/d55e5ecc-5d33-4955-b3db-2663f683892e HTTP/1.1" status: 200 len: 979 time: 3.2678645 Dec 10 14:25:12.060853 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53392) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:12.065756 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-240154ca-83ef-4dd4-8ebb-8b05b3883483 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:12.090118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.131730 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-240154ca-83ef-4dd4-8ebb-8b05b3883483 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.153938 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.166023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-7227165d-b534-4973-be59-efaecf3d309c', 'network_id': '7227165d-b534-4973-be59-efaecf3d309c', 'project_id': 'd3343b3b6d35425bb712248f00332c2c', 'fixed_ips': [{'subnet_id': 'f39cba28-0ea0-4d08-8bc7-c4185041907e'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:12.167119 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.179449 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4107a093-0418-4800-988d-4bf276b6d0fa tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1321423 Dec 10 14:25:12.182524 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53394) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:12.188418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Request body: {'subnet': {'network_id': '2d3a78f5-ce1f-4d70-a49e-78fdf44089ca', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:12.228684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.236345 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:12.236700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.275004 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.306916 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Allocated IP 172.20.0.2 (7227165d-b534-4973-be59-efaecf3d309c/f39cba28-0ea0-4d08-8bc7-c4185041907e/a6ad88e6-de35-45f2-bac8-b5f03e83b49a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:12.330016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Network': ['ID=97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:12.367510 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:12.372445 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-01363747-9a80-4285-bd52-7325cf62e0b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.7232485 Dec 10 14:25:12.377513 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53398) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:12.383780 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1839611311'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:12.392499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-240154ca-83ef-4dd4-8ebb-8b05b3883483 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.451235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Deleting port b5e6a4c2-3747-4d6f-a6b6-64964b102298 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:12.451576 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.453650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-240154ca-83ef-4dd4-8ebb-8b05b3883483 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.454179 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Allocated IP 172.26.2.170 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/a663845a-05c8-469b-8dab-4019deca8e38) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:12.454293 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-240154ca-83ef-4dd4-8ebb-8b05b3883483 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP d55e5ecc-5d33-4955-b3db-2663f683892e disassociated. External IP: 172.26.2.171, port: 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb. Dec 10 14:25:12.522126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Made reservation on behalf of d3343b3b6d35425bb712248f00332c2c for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:12.526433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.542200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.614536 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Made reservation on behalf of 2f42fc032abf4f45b58e3cf6a9e11be4 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:12.617457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.631976 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.662792 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.681368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] vlan segment allocate from pool success with {'vlan_id': 357, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:12.683729 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Network 7227165d-b534-4973-be59-efaecf3d309c is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:12.685955 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:12.693095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:12.696407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Calling delete_port for b5e6a4c2-3747-4d6f-a6b6-64964b102298 owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:12.697556 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.697894 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Added segment b3d60bfc-9506-4713-8311-5d159b02c1f5 of type vlan for network 9f39a229-1929-4388-8162-9c2a4c522b85 Dec 10 14:25:12.709190 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Pushing event updated for resources: {'Port': ['ID=a6ad88e6-de35-45f2-bac8-b5f03e83b49a,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:12.729466 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.755385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.755712 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Attempting to bind port a6ad88e6-de35-45f2-bac8-b5f03e83b49a on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:12.756179 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Attempting to bind port a6ad88e6-de35-45f2-bac8-b5f03e83b49a by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '58a8d89d-1ce9-45fc-a09d-dc7a2195428b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '7227165d-b534-4973-be59-efaecf3d309c'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:12.756659 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Attempting to bind port a6ad88e6-de35-45f2-bac8-b5f03e83b49a on network 7227165d-b534-4973-be59-efaecf3d309c {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:12.758584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-240154ca-83ef-4dd4-8ebb-8b05b3883483 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:12.762920 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:12.763269 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Checking segment: {'id': '58a8d89d-1ce9-45fc-a09d-dc7a2195428b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '7227165d-b534-4973-be59-efaecf3d309c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:12.763770 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.764271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Bound using segment: {'id': '58a8d89d-1ce9-45fc-a09d-dc7a2195428b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '7227165d-b534-4973-be59-efaecf3d309c'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:12.764848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Bound port: a6ad88e6-de35-45f2-bac8-b5f03e83b49a, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '58a8d89d-1ce9-45fc-a09d-dc7a2195428b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '7227165d-b534-4973-be59-efaecf3d309c'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:12.765458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.832322 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] For port a6ad88e6-de35-45f2-bac8-b5f03e83b49a, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:12.835960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] For port a6ad88e6-de35-45f2-bac8-b5f03e83b49a, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a6ad88e6-de35-45f2-bac8-b5f03e83b49a,segment=NetworkSegment(58a8d89d-1ce9-45fc-a09d-dc7a2195428b),segment_id=58a8d89d-1ce9-45fc-a09d-dc7a2195428b)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:12.889172 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-240154ca-83ef-4dd4-8ebb-8b05b3883483 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:12.895139 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-240154ca-83ef-4dd4-8ebb-8b05b3883483 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.899133 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.905083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:12.906454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.919371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:12.927090 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6c4825d-11d9-4372-a464-9f2f17ba58b2 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:12.981207 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-240154ca-83ef-4dd4-8ebb-8b05b3883483 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/floatingips/d55e5ecc-5d33-4955-b3db-2663f683892e HTTP/1.1" status: 200 len: 688 time: 0.9192216 Dec 10 14:25:12.985052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53402) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:12.992136 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6c4825d-11d9-4372-a464-9f2f17ba58b2 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:12.992136 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e6c4825d-11d9-4372-a464-9f2f17ba58b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:12.997314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Network': ['ID=9f39a229-1929-4388-8162-9c2a4c522b85,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:13.034817 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e6c4825d-11d9-4372-a464-9f2f17ba58b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:13.035919 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a623aad3-6bf8-4833-84b7-ad91f2e557f9 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.6570649 Dec 10 14:25:13.040760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.043236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.047141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 9f39a229-1929-4388-8162-9c2a4c522b85 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:13.077710 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84569c6-973d-418c-a57a-31a43c1ec705 None None] Pushing event updated for resources: {'Port': ['ID=a6ad88e6-de35-45f2-bac8-b5f03e83b49a,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:13.090549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6c4825d-11d9-4372-a464-9f2f17ba58b2 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:13.091279 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e6c4825d-11d9-4372-a464-9f2f17ba58b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:13.174157 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53406) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:13.187513 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'subnets': [{'network_id': '97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--750757311', 'ip_version': 4}, {'network_id': '9f39a229-1929-4388-8162-9c2a4c522b85', 'cidr': '172.20.0.16/28', 'ip_version': 4}]} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:13.187698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'subnet': {'network_id': '97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--750757311', 'ip_version': 4}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:13.188793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Request body: {'subnet': {'network_id': '9f39a229-1929-4388-8162-9c2a4c522b85', 'cidr': '172.20.0.16/28', 'ip_version': 4}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:13.200843 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.204283 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:13.241626 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:13.261701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:13.305263 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Pushing event updated for resources: {'Port': ['ID=a663845a-05c8-469b-8dab-4019deca8e38,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:13.362002 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Subnet': ['ID=6bf30801-611a-4d65-8217-e69f96f2373c,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:13.362180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e6c4825d-11d9-4372-a464-9f2f17ba58b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:13.362180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6c4825d-11d9-4372-a464-9f2f17ba58b2 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:13.416140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event deleted for resources: {'Port': ['ID=b5e6a4c2-3747-4d6f-a6b6-64964b102298,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:13.457568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Checking segment: {'id': '5b1a4aea-89c6-4b5a-976b-a83dcb3e9567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '2d3a78f5-ce1f-4d70-a49e-78fdf44089ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:13.457934 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network hostable DHCP agents. Network: 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:13.502370 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port fe01b7dd-35e5-4b1e-83e4-8169a725877d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:13.502713 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.519090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.535859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Made reservation on behalf of 2f42fc032abf4f45b58e3cf6a9e11be4 for: {'subnet': 2} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:13.542048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.542395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.581363 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6dc4c83f-ff68-477c-9142-8f39a51b7434 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:13.635638 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:13.636927 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 6dc4c83f-ff68-477c-9142-8f39a51b7434 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:13.637532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.682061 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.690788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.724519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a6ad88e6-de35-45f2-bac8-b5f03e83b49a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:13.735723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:13.754090 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0eaa5fb7-a8c7-40bb-974d-2872a35357d3 None None] Network 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:13.800253 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:13.800859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.844519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a6ad88e6-de35-45f2-bac8-b5f03e83b49a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:13.844905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.868053 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.868420 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.887827 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for fe01b7dd-35e5-4b1e-83e4-8169a725877d owned by network:floatingip {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:13.891103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.891629 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Fanout notify agent at l3_agent the message router_deleted on router 69343414-ca56-465a-9086-08c0e2e77d71 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:25:13.900268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-2d3a78f5-ce1f-4d70-a49e-78fdf44089ca', 'network_id': '2d3a78f5-ce1f-4d70-a49e-78fdf44089ca', 'project_id': 'd3343b3b6d35425bb712248f00332c2c', 'fixed_ips': [{'subnet_id': '6bf30801-611a-4d65-8217-e69f96f2373c'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:13.901155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.901538 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:13.902744 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dacbe466-8f7c-472d-912f-ca895f638fc9 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/69343414-ca56-465a-9086-08c0e2e77d71 HTTP/1.1" status: 204 len: 168 time: 2.0511768 Dec 10 14:25:13.909265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53410) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:13.913295 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b2d2d31d-b1a7-4057-bc01-9e9ab47f91dc tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1767606891', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:13.946076 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8c88de7d-0f9b-4e23-9cba-ff0007c9c898 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7623243 Dec 10 14:25:13.948088 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53412) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:14.052498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.082207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.158660 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Subnet': ['ID=3961604e-9cee-4ec8-b98d-27c764f6f7dd,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:14.162620 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Allocated IP 172.20.0.2 (2d3a78f5-ce1f-4d70-a49e-78fdf44089ca/6bf30801-611a-4d65-8217-e69f96f2373c/01814436-81dc-492c-b230-07ed49056ef1) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:14.172579 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port a6ad88e6-de35-45f2-bac8-b5f03e83b49a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a6ad88e6-de35-45f2-bac8-b5f03e83b49a,segment=NetworkSegment(58a8d89d-1ce9-45fc-a09d-dc7a2195428b),segment_id=58a8d89d-1ce9-45fc-a09d-dc7a2195428b)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:14.178771 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Checking segment: {'id': '45f2c3cb-962f-4a19-944b-814b20ddece2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:14.179154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Network hostable DHCP agents. Network: 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:14.251581 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.273123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Network 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:14.336438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=a6ad88e6-de35-45f2-bac8-b5f03e83b49a,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:14.368612 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:14.368813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20452aff-a45a-4575-b71a-d1ba70562e17 None None] Network 7227165d-b534-4973-be59-efaecf3d309c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:14.375165 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.393755 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-140b985b-ee60-48c8-ad5d-a7933ae25106 None None] Network 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:14.460181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event updated for resources: {'Subnet': ['ID=53f6918b-1bdd-4d18-925b-df707da819cf,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:14.469433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Checking segment: {'id': 'b3d60bfc-9506-4713-8311-5d159b02c1f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9f39a229-1929-4388-8162-9c2a4c522b85'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:14.469933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Network hostable DHCP agents. Network: 9f39a229-1929-4388-8162-9c2a4c522b85, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:14.488371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.489855 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b2d2d31d-b1a7-4057-bc01-9e9ab47f91dc tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.490487 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b2d2d31d-b1a7-4057-bc01-9e9ab47f91dc tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.534395 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-17a4fc35-68bd-4b28-b684-534dc65eaf7d None None] Provisioning complete for port a6ad88e6-de35-45f2-bac8-b5f03e83b49a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:14.534692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-17a4fc35-68bd-4b28-b684-534dc65eaf7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.550768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Network 9f39a229-1929-4388-8162-9c2a4c522b85 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:14.602333 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.643884 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d', 'network_id': '97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d', 'project_id': '2f42fc032abf4f45b58e3cf6a9e11be4', 'fixed_ips': [{'subnet_id': '3961604e-9cee-4ec8-b98d-27c764f6f7dd'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:14.644360 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 9f39a229-1929-4388-8162-9c2a4c522b85) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:14.644759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.648785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:14.649248 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:14.650072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.673020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Network 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:14.673960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05042073-d7e2-4cfd-a9b4-6ce51607e12e None None] Network 9f39a229-1929-4388-8162-9c2a4c522b85 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:14.699300 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:14.708031 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:14.730364 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-503352ad-0389-440b-b350-6baae7d0a2a0 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1425 time: 1.5516565 Dec 10 14:25:14.730562 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b2d2d31d-b1a7-4057-bc01-9e9ab47f91dc tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.731918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53420) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:14.740730 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Pushing event updated for resources: {'Port': ['ID=01814436-81dc-492c-b230-07ed49056ef1,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:14.803349 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.841181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b2d2d31d-b1a7-4057-bc01-9e9ab47f91dc tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.872218 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbdee15a-d9c3-4c6f-b3ac-7e46ef5b91b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:14.874479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbdee15a-d9c3-4c6f-b3ac-7e46ef5b91b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:14.874632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:14.876213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbdee15a-d9c3-4c6f-b3ac-7e46ef5b91b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:14.881318 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53422) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:14.882180 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bbdee15a-d9c3-4c6f-b3ac-7e46ef5b91b5 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2051 time: 0.1478631 Dec 10 14:25:14.964780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Attempting to bind port 01814436-81dc-492c-b230-07ed49056ef1 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:14.965198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Attempting to bind port 01814436-81dc-492c-b230-07ed49056ef1 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '5b1a4aea-89c6-4b5a-976b-a83dcb3e9567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '2d3a78f5-ce1f-4d70-a49e-78fdf44089ca'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:14.965586 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Attempting to bind port 01814436-81dc-492c-b230-07ed49056ef1 on network 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:14.969941 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.015505 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:15.015889 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Checking segment: {'id': '5b1a4aea-89c6-4b5a-976b-a83dcb3e9567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '2d3a78f5-ce1f-4d70-a49e-78fdf44089ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:15.016312 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.016391 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b2d2d31d-b1a7-4057-bc01-9e9ab47f91dc tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.016679 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Bound using segment: {'id': '5b1a4aea-89c6-4b5a-976b-a83dcb3e9567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '2d3a78f5-ce1f-4d70-a49e-78fdf44089ca'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:15.017164 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Bound port: 01814436-81dc-492c-b230-07ed49056ef1, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5b1a4aea-89c6-4b5a-976b-a83dcb3e9567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '2d3a78f5-ce1f-4d70-a49e-78fdf44089ca'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:15.017704 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b2d2d31d-b1a7-4057-bc01-9e9ab47f91dc tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 1.1076982 Dec 10 14:25:15.020508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53424) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:15.020643 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.025497 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:15.026494 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-9f39a229-1929-4388-8162-9c2a4c522b85', 'network_id': '9f39a229-1929-4388-8162-9c2a4c522b85', 'project_id': '2f42fc032abf4f45b58e3cf6a9e11be4', 'fixed_ips': [{'subnet_id': '53f6918b-1bdd-4d18-925b-df707da819cf'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:15.027331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.070419 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-05fa4bba-e8ff-464d-aad9-31652b5a52ab tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Deleting subnet 3961604e-9cee-4ec8-b98d-27c764f6f7dd {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:25:15.073206 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=fe01b7dd-35e5-4b1e-83e4-8169a725877d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:15.093432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Allocated IP 172.20.0.2 (97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d/3961604e-9cee-4ec8-b98d-27c764f6f7dd/76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:15.129976 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.254207 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.256775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.260457 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9a589ff7-dd68-4cbc-86be-315d98441a86 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/floatingips/d55e5ecc-5d33-4955-b3db-2663f683892e HTTP/1.1" status: 204 len: 168 time: 2.2713494 Dec 10 14:25:15.262546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53428) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:15.299110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.304095 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-503eee9c-eff9-4896-8c3b-36a9657a66ec tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] delete failed (client error): The resource could not be found. Dec 10 14:25:15.308732 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-503eee9c-eff9-4896-8c3b-36a9657a66ec tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/floatingips/d55e5ecc-5d33-4955-b3db-2663f683892e HTTP/1.1" status: 404 len: 345 time: 0.0425329 Dec 10 14:25:15.313550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53432) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:15.418740 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-be791e7c-8d35-4edf-9db2-fa36b4dbe055 None None] Provisioning complete for port a6ad88e6-de35-45f2-bac8-b5f03e83b49a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:15.419107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-be791e7c-8d35-4edf-9db2-fa36b4dbe055 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.425045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] For port 01814436-81dc-492c-b230-07ed49056ef1, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:15.451493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Allocated IP 172.20.0.1 (7227165d-b534-4973-be59-efaecf3d309c/f39cba28-0ea0-4d08-8bc7-c4185041907e/48b4e3f9-4f36-41f4-b749-ead3849f1533) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:15.482060 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-626eb5f4-e58f-40d8-abae-2833b9be05a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:15.487987 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a6ad88e6-de35-45f2-bac8-b5f03e83b49a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:15.488127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-626eb5f4-e58f-40d8-abae-2833b9be05a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:15.494159 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-626eb5f4-e58f-40d8-abae-2833b9be05a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:15.495867 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-626eb5f4-e58f-40d8-abae-2833b9be05a3 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "GET /v2.0/ports?network_id=826f4ffe-6ffa-44c2-a055-d6d8b94c119d HTTP/1.1" status: 200 len: 2358 time: 0.1851525 Dec 10 14:25:15.505909 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53434) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:15.509407 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] For port 01814436-81dc-492c-b230-07ed49056ef1, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=01814436-81dc-492c-b230-07ed49056ef1,segment=NetworkSegment(5b1a4aea-89c6-4b5a-976b-a83dcb3e9567),segment_id=5b1a4aea-89c6-4b5a-976b-a83dcb3e9567)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:15.579512 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.581692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Allocated IP 172.20.0.18 (9f39a229-1929-4388-8162-9c2a4c522b85/53f6918b-1bdd-4d18-925b-df707da819cf/f2326f4d-807b-4db3-86c8-fc3414aefcd0) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:15.581925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.601104 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.620723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.627748 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9d1bdf0-1dde-4251-ad0c-1a3e8fc82fb2 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:15.633822 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e9d1bdf0-1dde-4251-ad0c-1a3e8fc82fb2 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "GET /v2.0/subnets/acea17da-7f1b-4834-9b60-5d797c3b126f HTTP/1.1" status: 200 len: 797 time: 0.1216078 Dec 10 14:25:15.634048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53436) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:15.639225 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'port': {'network_id': '826f4ffe-6ffa-44c2-a055-d6d8b94c119d', 'name': 'tempest-FloatingIPTestJSON-493909010', 'fixed_ips': [{'ip_address': '172.20.0.14'}, {'ip_address': '172.20.0.12'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:15.701151 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.753048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Allocated IP 172.26.2.93 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/3b9d60a7-d82e-44b0-adb7-0182f862306b) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:15.755768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Pushing event updated for resources: {'Port': ['ID=a663845a-05c8-469b-8dab-4019deca8e38,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:15.786600 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a88adaeb-60e8-4f78-bbe7-f15b3e315065 None None] Pushing event updated for resources: {'Port': ['ID=01814436-81dc-492c-b230-07ed49056ef1,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:15.814947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a6ad88e6-de35-45f2-bac8-b5f03e83b49a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:15.814947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.819609 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.831487 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.864710 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.919126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-05fa4bba-e8ff-464d-aad9-31652b5a52ab tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.921801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.996058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:15.999865 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-05fa4bba-e8ff-464d-aad9-31652b5a52ab tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.040682 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Network 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:16.049755 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.054400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:16.056198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Pushing event updated for resources: {'Port': ['ID=76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:16.058655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:16.124181 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Floating IP ad3314b1-ea4f-4095-a06e-17939408ca6a associated. External IP: 172.26.2.170, port: 0e283c53-d685-420d-9540-2d89bb5ea30d. Dec 10 14:25:16.132331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Attempting to bind port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:16.132867 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Attempting to bind port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '45f2c3cb-962f-4a19-944b-814b20ddece2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:16.133050 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Attempting to bind port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc on network 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:16.139089 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:16.143376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Checking segment: {'id': '45f2c3cb-962f-4a19-944b-814b20ddece2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:16.143376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.143376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Bound using segment: {'id': '45f2c3cb-962f-4a19-944b-814b20ddece2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:16.143376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Bound port: 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '45f2c3cb-962f-4a19-944b-814b20ddece2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:16.143376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.154728 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Made reservation on behalf of c2a7c581de164ccf910afaf96add3a69 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:16.164877 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.177335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.206934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:16.211674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:16.216339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:16.219496 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event updated for resources: {'Port': ['ID=3b9d60a7-d82e-44b0-adb7-0182f862306b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:16.231018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-05fa4bba-e8ff-464d-aad9-31652b5a52ab tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.232337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Network 9f39a229-1929-4388-8162-9c2a4c522b85 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:16.243109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:16.247127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:16.250291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Pushing event updated for resources: {'Port': ['ID=f2326f4d-807b-4db3-86c8-fc3414aefcd0,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:16.256774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.334454 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Attempting to bind port f2326f4d-807b-4db3-86c8-fc3414aefcd0 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:16.334752 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Attempting to bind port f2326f4d-807b-4db3-86c8-fc3414aefcd0 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'b3d60bfc-9506-4713-8311-5d159b02c1f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9f39a229-1929-4388-8162-9c2a4c522b85'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:16.335120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Attempting to bind port f2326f4d-807b-4db3-86c8-fc3414aefcd0 on network 9f39a229-1929-4388-8162-9c2a4c522b85 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:16.346241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:16.346644 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Checking segment: {'id': 'b3d60bfc-9506-4713-8311-5d159b02c1f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9f39a229-1929-4388-8162-9c2a4c522b85'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:16.347632 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.347632 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Bound using segment: {'id': 'b3d60bfc-9506-4713-8311-5d159b02c1f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9f39a229-1929-4388-8162-9c2a4c522b85'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:16.347892 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Bound port: f2326f4d-807b-4db3-86c8-fc3414aefcd0, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b3d60bfc-9506-4713-8311-5d159b02c1f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9f39a229-1929-4388-8162-9c2a4c522b85'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:16.348282 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.379546 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network 7227165d-b534-4973-be59-efaecf3d309c is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:16.424657 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] For port f2326f4d-807b-4db3-86c8-fc3414aefcd0, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:16.435990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] For port f2326f4d-807b-4db3-86c8-fc3414aefcd0, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f2326f4d-807b-4db3-86c8-fc3414aefcd0,segment=NetworkSegment(b3d60bfc-9506-4713-8311-5d159b02c1f5),segment_id=b3d60bfc-9506-4713-8311-5d159b02c1f5)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:16.514205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.586954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c66c0d0-71c2-440e-baa5-2c01e7b20dde None None] Pushing event updated for resources: {'Port': ['ID=f2326f4d-807b-4db3-86c8-fc3414aefcd0,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:16.738177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:16.754848 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:16.806477 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Port': ['ID=48b4e3f9-4f36-41f4-b749-ead3849f1533,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:16.823383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.861430 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] device_id is not set on port d90da5ba-c379-42d8-8a4e-ddb3ae06b67c yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:25:16.894109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] For port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:16.913520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] For port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc,segment=NetworkSegment(45f2c3cb-962f-4a19-944b-814b20ddece2),segment_id=45f2c3cb-962f-4a19-944b-814b20ddece2)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:16.945436 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.984724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:16.991507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.063502 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-05fa4bba-e8ff-464d-aad9-31652b5a52ab tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.084909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9dc7864-c09d-400b-9ac3-025b7e4f5029 None None] Network 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:17.300289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05fa4bba-e8ff-464d-aad9-31652b5a52ab tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Subnet': ['ID=3961604e-9cee-4ec8-b98d-27c764f6f7dd,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:17.300289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-05fa4bba-e8ff-464d-aad9-31652b5a52ab tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.300289 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-05fa4bba-e8ff-464d-aad9-31652b5a52ab tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/subnets/3961604e-9cee-4ec8-b98d-27c764f6f7dd HTTP/1.1" status: 204 len: 168 time: 2.3019428 Dec 10 14:25:17.300687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-71fd7ef6-0ff7-429e-8e3f-12847aa42a9e None None] Provisioning complete for port 01814436-81dc-492c-b230-07ed49056ef1 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:17.300687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-71fd7ef6-0ff7-429e-8e3f-12847aa42a9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.300687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43256055-c740-4e48-9ce8-86b06bb786a1 None None] Pushing event updated for resources: {'Port': ['ID=76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:17.301271 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.301271 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53446) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:17.303121 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.358231 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-71fd7ef6-0ff7-429e-8e3f-12847aa42a9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.392084 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Router 43cfa4d1-b60d-4556-8238-383470614599 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:17.408355 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-71fd7ef6-0ff7-429e-8e3f-12847aa42a9e None None] For port 01814436-81dc-492c-b230-07ed49056ef1, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=01814436-81dc-492c-b230-07ed49056ef1,segment=NetworkSegment(5b1a4aea-89c6-4b5a-976b-a83dcb3e9567),segment_id=5b1a4aea-89c6-4b5a-976b-a83dcb3e9567)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:17.425346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-053df7f3-7bc8-4fba-a44d-e01ebbdc9b76 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Deleting subnet 53f6918b-1bdd-4d18-925b-df707da819cf {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:25:17.429525 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-053df7f3-7bc8-4fba-a44d-e01ebbdc9b76 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.482328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-71fd7ef6-0ff7-429e-8e3f-12847aa42a9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.632839 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71fd7ef6-0ff7-429e-8e3f-12847aa42a9e None None] Pushing event updated for resources: {'Port': ['ID=01814436-81dc-492c-b230-07ed49056ef1,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:17.635549 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.650509 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ae7bf123-33fa-4dd0-935f-871ed0ec248a None None] Provisioning complete for port 48b4e3f9-4f36-41f4-b749-ead3849f1533 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:17.650886 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf123-33fa-4dd0-935f-871ed0ec248a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.683351 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-053df7f3-7bc8-4fba-a44d-e01ebbdc9b76 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.765258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ae7bf123-33fa-4dd0-935f-871ed0ec248a None None] Port 48b4e3f9-4f36-41f4-b749-ead3849f1533 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:17.766794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f2326f4d-807b-4db3-86c8-fc3414aefcd0 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:17.849564 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port f2326f4d-807b-4db3-86c8-fc3414aefcd0 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:17.849942 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.905516 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-053df7f3-7bc8-4fba-a44d-e01ebbdc9b76 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.926476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c4e397c9-e5f3-4e40-aa1e-a5008128d7d4 None None] Provisioning complete for port 01814436-81dc-492c-b230-07ed49056ef1 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:17.927119 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c4e397c9-e5f3-4e40-aa1e-a5008128d7d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:17.975210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Router 9c159cd1-1a8d-43e9-a827-a6ec0c3324bf is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:25:18.006771 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.083383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:18.096513 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92acaf91-a7ce-453f-be0e-1dac38a75f7b None None] Sync routers for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:18.110076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:25:18.110420 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:25:18.114331 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92acaf91-a7ce-453f-be0e-1dac38a75f7b None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:18.120879 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-92acaf91-a7ce-453f-be0e-1dac38a75f7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:18.129637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-053df7f3-7bc8-4fba-a44d-e01ebbdc9b76 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.148948 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-92acaf91-a7ce-453f-be0e-1dac38a75f7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:18.156675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.20.0.14 (826f4ffe-6ffa-44c2-a055-d6d8b94c119d/acea17da-7f1b-4834-9b60-5d797c3b126f/d90da5ba-c379-42d8-8a4e-ddb3ae06b67c) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:18.164399 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92acaf91-a7ce-453f-be0e-1dac38a75f7b None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:18.165766 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-92acaf91-a7ce-453f-be0e-1dac38a75f7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:18.169455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.20.0.12 (826f4ffe-6ffa-44c2-a055-d6d8b94c119d/acea17da-7f1b-4834-9b60-5d797c3b126f/d90da5ba-c379-42d8-8a4e-ddb3ae06b67c) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:18.175639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.186337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053df7f3-7bc8-4fba-a44d-e01ebbdc9b76 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Subnet': ['ID=53f6918b-1bdd-4d18-925b-df707da819cf,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:18.194704 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-053df7f3-7bc8-4fba-a44d-e01ebbdc9b76 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.199074 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-053df7f3-7bc8-4fba-a44d-e01ebbdc9b76 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/subnets/53f6918b-1bdd-4d18-925b-df707da819cf HTTP/1.1" status: 204 len: 168 time: 0.9049592 Dec 10 14:25:18.200134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:18.208686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.211235 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef713d9b-a473-4c84-8d67-a139c119fa62 None None] Sync routers for ids ['9c159cd1-1a8d-43e9-a827-a6ec0c3324bf'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:18.221519 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53452) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:18.226148 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8b125740-fb35-4b86-8eb1-9cd24f29454a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "PUT /v2.0/routers/9c159cd1-1a8d-43e9-a827-a6ec0c3324bf HTTP/1.1" status: 200 len: 879 time: 3.2042589 Dec 10 14:25:18.226786 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53454) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:18.232240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef713d9b-a473-4c84-8d67-a139c119fa62 None None] Routers {'9c159cd1-1a8d-43e9-a827-a6ec0c3324bf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:18.233290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53456) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:18.238005 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f012bc9a-6554-4d6e-9270-25625156c3de tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 989 time: 6.5237091 Dec 10 14:25:18.238686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ef713d9b-a473-4c84-8d67-a139c119fa62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9c159cd1-1a8d-43e9-a827-a6ec0c3324bf'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:18.247144 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-92acaf91-a7ce-453f-be0e-1dac38a75f7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:18.251978 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92acaf91-a7ce-453f-be0e-1dac38a75f7b None None] The sync data for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:18.290890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ef713d9b-a473-4c84-8d67-a139c119fa62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:18.300571 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef713d9b-a473-4c84-8d67-a139c119fa62 None None] Routers {'9c159cd1-1a8d-43e9-a827-a6ec0c3324bf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:18.301480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ef713d9b-a473-4c84-8d67-a139c119fa62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9c159cd1-1a8d-43e9-a827-a6ec0c3324bf'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:18.352718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ef713d9b-a473-4c84-8d67-a139c119fa62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:18.353373 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef713d9b-a473-4c84-8d67-a139c119fa62 None None] The sync data for ids ['9c159cd1-1a8d-43e9-a827-a6ec0c3324bf'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:18.369128 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bc0e010-715d-4135-a19d-bf6e7e7aa152 None None] Network 9f39a229-1929-4388-8162-9c2a4c522b85 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:18.420107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63979704-270a-46c3-9e83-881a9c1f2b28 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:18.421881 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-63979704-270a-46c3-9e83-881a9c1f2b28 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1823356 Dec 10 14:25:18.429694 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cb0cc38a-a62c-4dae-ae99-09555266899b tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] 10.222.0.57 "GET /v2.0/floatingips/ad3314b1-ea4f-4095-a06e-17939408ca6a HTTP/1.1" status: 200 len: 984 time: 0.2016571 Dec 10 14:25:18.434469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53460) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:18.436507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53462) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:18.491325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e65b7c2e-d1e9-4ecb-8e65-ed2144a3b95a None None] Provisioning complete for port f2326f4d-807b-4db3-86c8-fc3414aefcd0 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:18.492127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e65b7c2e-d1e9-4ecb-8e65-ed2144a3b95a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.609278 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.620193 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.655733 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98165278-7e36-4889-a799-9a68ecb69e53 None None] DHCP port deletion for 9f39a229-1929-4388-8162-9c2a4c522b85 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:18.663214 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e65b7c2e-d1e9-4ecb-8e65-ed2144a3b95a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.675052 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bb7290ab-7bd8-4548-a438-4ddf6c949562 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/routers/9c159cd1-1a8d-43e9-a827-a6ec0c3324bf HTTP/1.1" status: 200 len: 920 time: 0.4379463 Dec 10 14:25:18.676170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53466) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:18.696116 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.710954 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a682e706-12de-42d3-9c87-25a68105c8a4 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] 10.222.0.57 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 3823 time: 0.2730379 Dec 10 14:25:18.711589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53470) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:18.723448 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.774465 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e65b7c2e-d1e9-4ecb-8e65-ed2144a3b95a None None] For port f2326f4d-807b-4db3-86c8-fc3414aefcd0, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f2326f4d-807b-4db3-86c8-fc3414aefcd0,segment=NetworkSegment(b3d60bfc-9506-4713-8311-5d159b02c1f5),segment_id=b3d60bfc-9506-4713-8311-5d159b02c1f5)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:18.793993 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-98165278-7e36-4889-a799-9a68ecb69e53 None None] Deleting port f2326f4d-807b-4db3-86c8-fc3414aefcd0 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:18.794351 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98165278-7e36-4889-a799-9a68ecb69e53 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.797343 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c98fbf8-1c1a-4b8b-b2d4-7b8a40934277 None None] Network 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:18.852561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Port': ['ID=48b4e3f9-4f36-41f4-b749-ead3849f1533,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:18.863290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bcefeeb-a8d1-472c-8e6b-ac233c77a91b tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:18.865546 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8bcefeeb-a8d1-472c-8e6b-ac233c77a91b tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=9c159cd1-1a8d-43e9-a827-a6ec0c3324bf&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1789353 Dec 10 14:25:18.871261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53472) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:18.876035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.972141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:18.973255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Deleting port a663845a-05c8-469b-8dab-4019deca8e38 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:18.973376 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.026983 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e65b7c2e-d1e9-4ecb-8e65-ed2144a3b95a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.058980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.059317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.071328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Calling delete_port for a663845a-05c8-469b-8dab-4019deca8e38 owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:19.073936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Deleting port f2326f4d-807b-4db3-86c8-fc3414aefcd0 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:19.074305 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.084850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f8b5a86-d3d7-4b08-a66c-31b6818f91f8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:19.088482 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0f8b5a86-d3d7-4b08-a66c-31b6818f91f8 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 881 time: 0.2076173 Dec 10 14:25:19.098022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53474) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:19.167518 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-98165278-7e36-4889-a799-9a68ecb69e53 None None] For port f2326f4d-807b-4db3-86c8-fc3414aefcd0, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f2326f4d-807b-4db3-86c8-fc3414aefcd0,segment=NetworkSegment(b3d60bfc-9506-4713-8311-5d159b02c1f5),segment_id=b3d60bfc-9506-4713-8311-5d159b02c1f5)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:19.167824 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98165278-7e36-4889-a799-9a68ecb69e53 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.168628 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f9762a8f-ffe9-4e80-b6a0-1a44c9543216 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=9c159cd1-1a8d-43e9-a827-a6ec0c3324bf HTTP/1.1" status: 200 len: 205 time: 0.0671706 Dec 10 14:25:19.173756 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53476) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:19.179722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:25:19.180084 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:25:19.186101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e65b7c2e-d1e9-4ecb-8e65-ed2144a3b95a None None] Pushing event updated for resources: {'Port': ['ID=f2326f4d-807b-4db3-86c8-fc3414aefcd0,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:19.192532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-98165278-7e36-4889-a799-9a68ecb69e53 None None] Calling delete_port for f2326f4d-807b-4db3-86c8-fc3414aefcd0 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:19.193846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network 7227165d-b534-4973-be59-efaecf3d309c is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:19.195913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] For port f2326f4d-807b-4db3-86c8-fc3414aefcd0, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f2326f4d-807b-4db3-86c8-fc3414aefcd0,segment=NetworkSegment(b3d60bfc-9506-4713-8311-5d159b02c1f5),segment_id=b3d60bfc-9506-4713-8311-5d159b02c1f5)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:19.196275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.199063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:19.207061 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-767546a9-2fca-4ee0-8ff7-6aec58ecd2d8 None None] Provisioning complete for port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:19.207416 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-767546a9-2fca-4ee0-8ff7-6aec58ecd2d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.219640 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Calling delete_port for f2326f4d-807b-4db3-86c8-fc3414aefcd0 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:19.263045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.360813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-767546a9-2fca-4ee0-8ff7-6aec58ecd2d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.404238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc6a8ab8-3f73-4000-bcd4-ee46b372209e None None] DHCP port deletion for 97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:19.405566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:19.411149 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-767546a9-2fca-4ee0-8ff7-6aec58ecd2d8 None None] For port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc,segment=NetworkSegment(45f2c3cb-962f-4a19-944b-814b20ddece2),segment_id=45f2c3cb-962f-4a19-944b-814b20ddece2)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:19.413582 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.421483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:19.439875 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98165278-7e36-4889-a799-9a68ecb69e53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.462619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:19.489844 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98165278-7e36-4889-a799-9a68ecb69e53 None None] Pushing event deleted for resources: {'Port': ['ID=f2326f4d-807b-4db3-86c8-fc3414aefcd0,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:19.500868 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98165278-7e36-4889-a799-9a68ecb69e53 None None] No DVR routers for this DVR port f2326f4d-807b-4db3-86c8-fc3414aefcd0 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:19.506250 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-767546a9-2fca-4ee0-8ff7-6aec58ecd2d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.529448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=d90da5ba-c379-42d8-8a4e-ddb3ae06b67c,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:19.546675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:19.547331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.558019 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.582134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.585888 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.593846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Port': ['ID=f2326f4d-807b-4db3-86c8-fc3414aefcd0,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:19.604596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] No DVR routers for this DVR port f2326f4d-807b-4db3-86c8-fc3414aefcd0 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:19.608762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-fc6a8ab8-3f73-4000-bcd4-ee46b372209e None None] Deleting port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:19.609560 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc6a8ab8-3f73-4000-bcd4-ee46b372209e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.626207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event deleted for resources: {'Port': ['ID=a663845a-05c8-469b-8dab-4019deca8e38,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:19.634657 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ff8e4bfe-478c-4796-ada8-fa43db6c7457 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1009 time: 3.9970686 Dec 10 14:25:19.634949 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53480) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:19.639586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': 'd90da5ba-c379-42d8-8a4e-ddb3ae06b67c', 'fixed_ip_address': '172.20.0.14'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:19.691579 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-53296aa7-df6d-46c2-859d-25b76f8dd062 None None] Provisioning complete for port 48b4e3f9-4f36-41f4-b749-ead3849f1533 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:19.692018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-53296aa7-df6d-46c2-859d-25b76f8dd062 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.695215 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Router b333eb0a-7e57-4b46-9fbb-8afa1bec2007 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:25:19.713297 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.733670 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-53296aa7-df6d-46c2-859d-25b76f8dd062 None None] Port 48b4e3f9-4f36-41f4-b749-ead3849f1533 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:19.741849 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.742253 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Floating IP ad3314b1-ea4f-4095-a06e-17939408ca6a disassociated (deleted). External IP: 172.26.2.170, port: 0e283c53-d685-420d-9540-2d89bb5ea30d. Dec 10 14:25:19.749275 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-767546a9-2fca-4ee0-8ff7-6aec58ecd2d8 None None] Pushing event updated for resources: {'Port': ['ID=76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:19.758245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fc6a8ab8-3f73-4000-bcd4-ee46b372209e None None] For port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc,segment=NetworkSegment(45f2c3cb-962f-4a19-944b-814b20ddece2),segment_id=45f2c3cb-962f-4a19-944b-814b20ddece2)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:19.758711 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc6a8ab8-3f73-4000-bcd4-ee46b372209e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.773816 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-fc6a8ab8-3f73-4000-bcd4-ee46b372209e None None] Calling delete_port for 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:19.774013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9f39a229-1929-4388-8162-9c2a4c522b85']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:19.789876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.796604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Deleting port 3b9d60a7-d82e-44b0-adb7-0182f862306b {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:19.796944 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.810873 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Port f2326f4d-807b-4db3-86c8-fc3414aefcd0 update to ACTIVE by agent not found {{(pid=103812) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 10 14:25:19.811819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 01814436-81dc-492c-b230-07ed49056ef1 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:19.821312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b3d60bfc-9506-4713-8311-5d159b02c1f5') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:19.821627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b3d60bfc-9506-4713-8311-5d159b02c1f5') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:19.860282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.879043 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.890358 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Releasing vlan 357 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:19.895605 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:19.902419 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7340ac1f-8432-4dff-be5f-f1ed3fbb1289 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "PUT /v2.0/routers/b333eb0a-7e57-4b46-9fbb-8afa1bec2007/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9447987 Dec 10 14:25:19.905931 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15bf511a-ac82-4535-8875-329960a648e8 None None] Sync routers for ids ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:19.910228 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53486) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:19.925304 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15bf511a-ac82-4535-8875-329960a648e8 None None] Routers {'b333eb0a-7e57-4b46-9fbb-8afa1bec2007'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:19.926634 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-15bf511a-ac82-4535-8875-329960a648e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:19.979912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 01814436-81dc-492c-b230-07ed49056ef1 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:19.980176 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-15bf511a-ac82-4535-8875-329960a648e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:19.980616 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.980874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:19.992870 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15bf511a-ac82-4535-8875-329960a648e8 None None] Routers {'b333eb0a-7e57-4b46-9fbb-8afa1bec2007'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:19.993841 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-15bf511a-ac82-4535-8875-329960a648e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:19.999701 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Calling delete_port for 3b9d60a7-d82e-44b0-adb7-0182f862306b owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:20.059103 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-15bf511a-ac82-4535-8875-329960a648e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:20.060615 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15bf511a-ac82-4535-8875-329960a648e8 None None] The sync data for ids ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:20.075677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc6a8ab8-3f73-4000-bcd4-ee46b372209e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.110519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc6a8ab8-3f73-4000-bcd4-ee46b372209e None None] Pushing event deleted for resources: {'Port': ['ID=76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:20.114351 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc6a8ab8-3f73-4000-bcd4-ee46b372209e None None] No DVR routers for this DVR port 76396c4d-babb-4ac6-9f4c-1f3bc8bb3afc on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:20.236040 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 01814436-81dc-492c-b230-07ed49056ef1 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:20.295931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 01814436-81dc-492c-b230-07ed49056ef1 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:20.296460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.440829 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f2326f4d-807b-4db3-86c8-fc3414aefcd0 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:25:20.461712 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: f2326f4d-807b-4db3-86c8-fc3414aefcd0 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:25:20.463140 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f2326f4d-807b-4db3-86c8-fc3414aefcd0 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:25:20.483983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.493060 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.496318 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/networks/9f39a229-1929-4388-8162-9c2a4c522b85 HTTP/1.1" status: 204 len: 168 time: 2.0627697 Dec 10 14:25:20.498982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53488) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:20.505627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.517376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeded16b-4801-4bcd-b3bc-a6c055bda7e4 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Network': ['ID=9f39a229-1929-4388-8162-9c2a4c522b85,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:20.581562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Router 43cfa4d1-b60d-4556-8238-383470614599 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:20.651738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.745739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.26.2.233 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/3aec4e6a-2e73-46b2-a654-4d50ff145aa1) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:20.797281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.825568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:20.834870 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-6a95d09d-a23d-4b88-bd31-765743bc7f81 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:25:20.838774 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6a95d09d-a23d-4b88-bd31-765743bc7f81 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "PUT /v2.0/routers/b333eb0a-7e57-4b46-9fbb-8afa1bec2007/add_router_interface HTTP/1.1" status: 400 len: 438 time: 0.9246645 Dec 10 14:25:20.839261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '45f2c3cb-962f-4a19-944b-814b20ddece2') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:20.839558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '45f2c3cb-962f-4a19-944b-814b20ddece2') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:20.842621 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53494) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:20.850845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:20.860163 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.864058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-475a9824-8f6d-4325-8fe6-dffdbaa25084 None None] Sync routers for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:20.876322 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-475a9824-8f6d-4325-8fe6-dffdbaa25084 None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:20.877192 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-475a9824-8f6d-4325-8fe6-dffdbaa25084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:20.889882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.900336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.923137 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-475a9824-8f6d-4325-8fe6-dffdbaa25084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:20.926236 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event deleted for resources: {'Port': ['ID=3b9d60a7-d82e-44b0-adb7-0182f862306b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:20.934060 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-87cb131a-c6eb-4d5d-ba18-4c03f28225af tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "DELETE /v2.0/floatingips/ad3314b1-ea4f-4095-a06e-17939408ca6a HTTP/1.1" status: 204 len: 168 time: 2.1839221 Dec 10 14:25:20.938866 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53496) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:20.940180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-475a9824-8f6d-4325-8fe6-dffdbaa25084 None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:20.940811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-475a9824-8f6d-4325-8fe6-dffdbaa25084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:20.942680 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:20.969280 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.988789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Releasing vlan 373 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:20.989249 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:20.993252 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:20.995514 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-475a9824-8f6d-4325-8fe6-dffdbaa25084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:20.996005 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-475a9824-8f6d-4325-8fe6-dffdbaa25084 None None] The sync data for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:21.009015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.082824 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.125196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.128884 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.130660 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.234432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.260744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.260894 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.261448 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Fanout notify agent at l3_agent the message router_deleted on router 9c159cd1-1a8d-43e9-a827-a6ec0c3324bf {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:25:21.264533 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/networks/97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d HTTP/1.1" status: 204 len: 168 time: 0.7568121 Dec 10 14:25:21.269151 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.274452 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4607639c-0ed9-4498-b271-80354dd04813 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/9c159cd1-1a8d-43e9-a827-a6ec0c3324bf HTTP/1.1" status: 204 len: 168 time: 2.0948944 Dec 10 14:25:21.274452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53500) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:21.279033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53502) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:21.284154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ecfef4da-9ee3-4bbd-b87d-573de0a9012b tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-471792326', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:21.302626 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e761132d-1f12-45e4-b0e5-6852484a012e tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Network': ['ID=97c4c8c6-9cea-4a9b-b3d6-c9dd65f0497d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:21.334893 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.359044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.404939 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:21.412222 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.414015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:21.419202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:21.446142 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=3aec4e6a-2e73-46b2-a654-4d50ff145aa1,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:21.485527 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ecfef4da-9ee3-4bbd-b87d-573de0a9012b tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.486539 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ecfef4da-9ee3-4bbd-b87d-573de0a9012b tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.529383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.538398 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Allocated IP 172.26.2.254 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/6eb17a39-6102-4320-a095-d90f51c436df) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:21.612164 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.656050 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ecfef4da-9ee3-4bbd-b87d-573de0a9012b tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.675778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8942246a-531b-4dd4-9337-b2e7e8b5cfe5']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:21.720775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3ca7405d-1039-400f-ab70-5e9705038b3f') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:21.721078 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3ca7405d-1039-400f-ab70-5e9705038b3f') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:21.735904 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.750741 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ecfef4da-9ee3-4bbd-b87d-573de0a9012b tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.764394 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.802810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Releasing vlan 393 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:21.803116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:21.807576 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:21.815220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.920876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ecfef4da-9ee3-4bbd-b87d-573de0a9012b tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:21.922896 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ecfef4da-9ee3-4bbd-b87d-573de0a9012b tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.6421971 Dec 10 14:25:21.924867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53506) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:21.929254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': True}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:21.932981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Deleting port 48b4e3f9-4f36-41f4-b749-ead3849f1533 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:21.933327 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.020636 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.033017 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Calling delete_port for 48b4e3f9-4f36-41f4-b749-ead3849f1533 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:22.071218 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.082367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.114685 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.118188 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/networks/8942246a-531b-4dd4-9337-b2e7e8b5cfe5 HTTP/1.1" status: 204 len: 168 time: 0.8462090 Dec 10 14:25:22.120863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae212376-2552-4841-b3c6-2e9c73f45024 tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Network': ['ID=8942246a-531b-4dd4-9337-b2e7e8b5cfe5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:22.122439 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53512) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:22.135443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:22.141718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:22.147279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:22.156367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Pushing event updated for resources: {'Port': ['ID=6eb17a39-6102-4320-a095-d90f51c436df,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:22.242146 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.314082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.315047 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.396463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.424946 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Port': ['ID=48b4e3f9-4f36-41f4-b749-ead3849f1533,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:22.645261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.649020 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.725785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.777062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.811940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bc754a23-7197-4268-baee-89f45654324c']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:22.827053 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '038c7e92-60f5-4c0a-96d9-d22408fc1131') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:22.827355 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '038c7e92-60f5-4c0a-96d9-d22408fc1131') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:22.842505 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.860497 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.869245 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Releasing vlan 356 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:22.869683 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:22.874967 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:23.014190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.069025 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.085391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.092085 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] 10.222.0.57 "DELETE /v2.0/networks/bc754a23-7197-4268-baee-89f45654324c HTTP/1.1" status: 204 len: 168 time: 0.9662929 Dec 10 14:25:23.151605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-932be202-2ba1-44cc-b903-e818efefef3f tempest-BulkNetworkOpsTest-2116014303 tempest-BulkNetworkOpsTest-2116014303-project] Pushing event deleted for resources: {'Network': ['ID=bc754a23-7197-4268-baee-89f45654324c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:23.173362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Router b333eb0a-7e57-4b46-9fbb-8afa1bec2007 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:23.226415 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.252280 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.289016 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:23.298494 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d5a3c05e-c58b-4a20-ae33-33ca5d5fe662 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "PUT /v2.0/routers/b333eb0a-7e57-4b46-9fbb-8afa1bec2007/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4549110 Dec 10 14:25:23.301449 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b2f81d8-e3ad-41b0-8d32-5047ac752de9 None None] Sync routers for ids ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:23.304331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53522) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:23.314712 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b2f81d8-e3ad-41b0-8d32-5047ac752de9 None None] Routers {'b333eb0a-7e57-4b46-9fbb-8afa1bec2007'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:23.315420 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b2f81d8-e3ad-41b0-8d32-5047ac752de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:23.349751 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b2f81d8-e3ad-41b0-8d32-5047ac752de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:23.359617 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b2f81d8-e3ad-41b0-8d32-5047ac752de9 None None] Routers {'b333eb0a-7e57-4b46-9fbb-8afa1bec2007'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:23.360152 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b2f81d8-e3ad-41b0-8d32-5047ac752de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:23.368402 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-a1c7169f-7136-4a5e-a289-60f52f6f4162 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] delete failed (client error): The resource could not be found. Dec 10 14:25:23.371097 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a1c7169f-7136-4a5e-a289-60f52f6f4162 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "DELETE /v2.0/routers/tempest-non_exist_router-1520675047 HTTP/1.1" status: 404 len: 335 time: 0.0653050 Dec 10 14:25:23.371738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.373677 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53524) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:23.378544 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-6be1adc8-1479-42d1-b4fc-b72281542d37 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Request body: {'router': {'external_gateway_info': {'network_id': 'b333eb0a-7e57-4b46-9fbb-8afa1bec2007'}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:23.396909 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b2f81d8-e3ad-41b0-8d32-5047ac752de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:23.397589 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b2f81d8-e3ad-41b0-8d32-5047ac752de9 None None] The sync data for ids ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:23.407924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.421572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Allocated IP 172.26.2.38 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/62ab0a43-fa17-4f4b-a615-bc2e4fc18872) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:23.484296 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.484689 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.583760 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=3aec4e6a-2e73-46b2-a654-4d50ff145aa1,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:23.602068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.648784 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.657097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Pushing event updated for resources: {'Port': ['ID=6eb17a39-6102-4320-a095-d90f51c436df,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:23.660855 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6be1adc8-1479-42d1-b4fc-b72281542d37 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.664580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.709735 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53528) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:23.737739 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP cf47aa53-1662-4cde-aa2f-903b24ad1e82 associated. External IP: 172.26.2.233, port: d90da5ba-c379-42d8-8a4e-ddb3ae06b67c. Dec 10 14:25:23.751978 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-6be1adc8-1479-42d1-b4fc-b72281542d37 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] update failed (client error): The resource could not be found. Dec 10 14:25:23.756609 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6be1adc8-1479-42d1-b4fc-b72281542d37 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "PUT /v2.0/routers/b333eb0a-7e57-4b46-9fbb-8afa1bec2007 HTTP/1.1" status: 404 len: 339 time: 0.3785050 Dec 10 14:25:23.756987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53532) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:23.794063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.800781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:23.804501 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f767cf53-5660-489e-882e-88661a032059 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.8626640 Dec 10 14:25:23.805447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53534) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:23.873243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:23.878966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:23.884460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:23.913293 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event updated for resources: {'Port': ['ID=62ab0a43-fa17-4f4b-a615-bc2e4fc18872,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:23.979780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:24.071010 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-588a93bd-02bb-4810-90a0-4060a159515f admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=2f42fc032abf4f45b58e3cf6a9e11be4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3577235 Dec 10 14:25:24.071651 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53540) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:24.129221 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:24.135010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.148844 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.203011 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aa699321-a432-4809-bfa7-43fc80c53cd2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.281738 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:24.292885 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aa699321-a432-4809-bfa7-43fc80c53cd2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.294969 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69de7bf7-73f7-4d41-9f32-3459e438d99d None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:24.318642 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69de7bf7-73f7-4d41-9f32-3459e438d99d None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:24.320287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-69de7bf7-73f7-4d41-9f32-3459e438d99d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:24.359531 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.378924 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-69de7bf7-73f7-4d41-9f32-3459e438d99d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:24.396088 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69de7bf7-73f7-4d41-9f32-3459e438d99d None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:24.401048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-69de7bf7-73f7-4d41-9f32-3459e438d99d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:24.435349 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-69de7bf7-73f7-4d41-9f32-3459e438d99d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:24.436267 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69de7bf7-73f7-4d41-9f32-3459e438d99d None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:24.451300 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.487360 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0a217230-3537-4bcd-82f3-30ee91896897 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 4.8489113 Dec 10 14:25:24.487580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53546) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:24.491892 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f0ca0a8f-8e84-429f-a1cf-d046ffa92a01 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'port_id': 'd90da5ba-c379-42d8-8a4e-ddb3ae06b67c', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:24.494094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.545429 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Allocated IP 172.20.0.1 (5cb05196-50ab-470a-b82c-465f1679670b/0ab3f6eb-2c96-49a5-975e-9c2eec17c607/baca3390-321b-4fa3-8f35-cc5b637c3796) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:24.561899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aa699321-a432-4809-bfa7-43fc80c53cd2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.564453 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aa699321-a432-4809-bfa7-43fc80c53cd2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.568021 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-aa699321-a432-4809-bfa7-43fc80c53cd2 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/814b6c95-2f80-49ad-a21d-33fc40e35159 HTTP/1.1" status: 204 len: 168 time: 0.4932430 Dec 10 14:25:24.589756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa699321-a432-4809-bfa7-43fc80c53cd2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=814b6c95-2f80-49ad-a21d-33fc40e35159,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:24.707585 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Allocated IP 172.26.2.124 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/b1b6628b-2f87-4702-adf7-379b55753b62) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:24.760518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.858245 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0ca0a8f-8e84-429f-a1cf-d046ffa92a01 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.863214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.933973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.966775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.990965 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:24.995996 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network 5cb05196-50ab-470a-b82c-465f1679670b is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:24.999597 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.002163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:25.008745 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:25.046934 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Port': ['ID=baca3390-321b-4fa3-8f35-cc5b637c3796,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:25.100492 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:25.107626 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:25.113363 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:25.142816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.148240 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Pushing event updated for resources: {'Port': ['ID=b1b6628b-2f87-4702-adf7-379b55753b62,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:25.311707 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0811f971-6789-4a17-b9df-307bc46034d0 None None] Provisioning complete for port baca3390-321b-4fa3-8f35-cc5b637c3796 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:25.312763 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0811f971-6789-4a17-b9df-307bc46034d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.317141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.355253 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0811f971-6789-4a17-b9df-307bc46034d0 None None] Port baca3390-321b-4fa3-8f35-cc5b637c3796 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:25.416378 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.474047 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Router d4cf29e3-727f-46f3-aee1-35bb59b2268c is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:25:25.532518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.603209 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0ca0a8f-8e84-429f-a1cf-d046ffa92a01 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.667056 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:25.672630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.677929 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4855615b-12a2-458c-a4f8-42a1320dafa6 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "PUT /v2.0/routers/d4cf29e3-727f-46f3-aee1-35bb59b2268c HTTP/1.1" status: 200 len: 913 time: 3.7513258 Dec 10 14:25:25.681295 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53574) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:25.681525 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4eb2b27a-0ccf-4aa3-bc25-71f4e0bf2b15 None None] Sync routers for ids ['d4cf29e3-727f-46f3-aee1-35bb59b2268c'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:25.698471 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4eb2b27a-0ccf-4aa3-bc25-71f4e0bf2b15 None None] Routers {'d4cf29e3-727f-46f3-aee1-35bb59b2268c'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:25.699875 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4eb2b27a-0ccf-4aa3-bc25-71f4e0bf2b15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d4cf29e3-727f-46f3-aee1-35bb59b2268c'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:25.721176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0ca0a8f-8e84-429f-a1cf-d046ffa92a01 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.745221 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4eb2b27a-0ccf-4aa3-bc25-71f4e0bf2b15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:25.756534 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4eb2b27a-0ccf-4aa3-bc25-71f4e0bf2b15 None None] Routers {'d4cf29e3-727f-46f3-aee1-35bb59b2268c'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:25.757472 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4eb2b27a-0ccf-4aa3-bc25-71f4e0bf2b15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d4cf29e3-727f-46f3-aee1-35bb59b2268c'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:25.794842 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4eb2b27a-0ccf-4aa3-bc25-71f4e0bf2b15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:25.795974 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4eb2b27a-0ccf-4aa3-bc25-71f4e0bf2b15 None None] The sync data for ids ['d4cf29e3-727f-46f3-aee1-35bb59b2268c'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:25.817263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53576) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:25.832571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.880286 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.886166 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a1332a31-3141-40e5-9d43-221cf3321c21 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/routers/d4cf29e3-727f-46f3-aee1-35bb59b2268c HTTP/1.1" status: 200 len: 919 time: 0.2036595 Dec 10 14:25:25.886741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53580) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:25.898400 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:25.985531 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1930947648'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:25.997595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.001511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event updated for resources: {'Port': ['ID=baca3390-321b-4fa3-8f35-cc5b637c3796,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:26.009777 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-963462a7-0f15-49bb-b6e7-de9488b55d91 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:26.010742 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-963462a7-0f15-49bb-b6e7-de9488b55d91 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=d4cf29e3-727f-46f3-aee1-35bb59b2268c&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1227939 Dec 10 14:25:26.011587 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.015869 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53582) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:26.068112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f0ca0a8f-8e84-429f-a1cf-d046ffa92a01 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:26.126798 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:26.127900 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Pushing event updated for resources: {'Port': ['ID=b1b6628b-2f87-4702-adf7-379b55753b62,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:26.130946 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.149400 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.153634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.177491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Network 5cb05196-50ab-470a-b82c-465f1679670b is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:26.178870 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:26.188215 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4af8770e-363a-48ca-9ba7-2313f8058769 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:26.189663 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4af8770e-363a-48ca-9ba7-2313f8058769 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 881 time: 0.1728127 Dec 10 14:25:26.219292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53584) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:26.255233 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0ca0a8f-8e84-429f-a1cf-d046ffa92a01 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:26.260327 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0ca0a8f-8e84-429f-a1cf-d046ffa92a01 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.270636 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ef28561-0742-4de9-bc76-29abe9afa1a7 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:26.294300 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ef28561-0742-4de9-bc76-29abe9afa1a7 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:26.295189 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0ef28561-0742-4de9-bc76-29abe9afa1a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:26.338884 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0ef28561-0742-4de9-bc76-29abe9afa1a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:26.351750 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ef28561-0742-4de9-bc76-29abe9afa1a7 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:26.352783 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0ef28561-0742-4de9-bc76-29abe9afa1a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:26.369931 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f0ca0a8f-8e84-429f-a1cf-d046ffa92a01 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/floatingips/cf47aa53-1662-4cde-aa2f-903b24ad1e82 HTTP/1.1" status: 200 len: 978 time: 1.8787191 Dec 10 14:25:26.370912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53588) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:26.378749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.401740 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0ef28561-0742-4de9-bc76-29abe9afa1a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:26.402956 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ef28561-0742-4de9-bc76-29abe9afa1a7 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:26.441813 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.487187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e5126b01-b874-4417-a7b4-483c2a5cf256 None None] Provisioning complete for port baca3390-321b-4fa3-8f35-cc5b637c3796 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:26.487796 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e5126b01-b874-4417-a7b4-483c2a5cf256 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.514973 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 379, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:26.536613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e5126b01-b874-4417-a7b4-483c2a5cf256 None None] Port baca3390-321b-4fa3-8f35-cc5b637c3796 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:26.540738 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ad7facc8-a096-49a5-b569-3841ca31a295,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:26.546193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.547238 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment 58bcc0c4-9e6d-488e-bce3-f832de1cf6fc of type vlan for network 357dc108-37ad-4356-90e3-4bbd945fbb62 Dec 10 14:25:26.618505 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.654540 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port 3aec4e6a-2e73-46b2-a654-4d50ff145aa1 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:26.654882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.680622 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.681853 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8604622b-329b-4a9e-b552-023dbe411159 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.8762183 Dec 10 14:25:26.684713 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-07b18799-0b61-4782-93fb-c355a688a5a7 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=d4cf29e3-727f-46f3-aee1-35bb59b2268c HTTP/1.1" status: 200 len: 205 time: 0.4637294 Dec 10 14:25:26.686330 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53594) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:26.695182 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53596) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:26.740785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.746589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:26.747174 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:26.807252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Router b333eb0a-7e57-4b46-9fbb-8afa1bec2007 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:26.811407 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-434b440a-32f7-47f3-8f47-2cfd5b829f78 tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] 10.222.0.57 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 4777 time: 0.1240387 Dec 10 14:25:26.814960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53598) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:26.894334 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0480abda-86e8-4611-a7db-37a10e90f584 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 690 time: 0.0779653 Dec 10 14:25:26.897136 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53600) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:27.073337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:27.084141 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-134af87b-11d7-47d5-b99b-a1bfb8656b57 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "PUT /v2.0/routers/b333eb0a-7e57-4b46-9fbb-8afa1bec2007/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3232317 Dec 10 14:25:27.084234 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53602) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:27.085272 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3d587ef-e44d-4a22-8813-ef7773ba6a35 None None] Sync routers for ids ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:27.096759 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3d587ef-e44d-4a22-8813-ef7773ba6a35 None None] Routers {'b333eb0a-7e57-4b46-9fbb-8afa1bec2007'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:27.097371 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d3d587ef-e44d-4a22-8813-ef7773ba6a35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:27.127648 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.3078511 Dec 10 14:25:27.130377 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d3d587ef-e44d-4a22-8813-ef7773ba6a35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:27.140276 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3d587ef-e44d-4a22-8813-ef7773ba6a35 None None] Routers {'b333eb0a-7e57-4b46-9fbb-8afa1bec2007'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:27.141066 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d3d587ef-e44d-4a22-8813-ef7773ba6a35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:27.148935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24670722-5286-4661-a211-644c07ee630d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=357dc108-37ad-4356-90e3-4bbd945fbb62,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:27.155111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.155441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.162174 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 357dc108-37ad-4356-90e3-4bbd945fbb62 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:27.170781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.176535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for 3aec4e6a-2e73-46b2-a654-4d50ff145aa1 owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:27.188287 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d3d587ef-e44d-4a22-8813-ef7773ba6a35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:27.188287 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3d587ef-e44d-4a22-8813-ef7773ba6a35 None None] The sync data for ids ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:27.242047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Deleting port b1b6628b-2f87-4702-adf7-379b55753b62 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:27.242406 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.248023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1433c3f3-8891-40c5-9ebd-bf44b1a05a81 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.260078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53604) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:27.266148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': '357dc108-37ad-4356-90e3-4bbd945fbb62', 'cidr': '172.20.255.240/28', 'ip_version': 4, 'gateway_ip': '172.20.255.241'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:27.342843 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.482494 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-1433c3f3-8891-40c5-9ebd-bf44b1a05a81 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 10 14:25:27.484142 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1433c3f3-8891-40c5-9ebd-bf44b1a05a81 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "DELETE /v2.0/routers/b333eb0a-7e57-4b46-9fbb-8afa1bec2007 HTTP/1.1" status: 409 len: 329 time: 0.3989697 Dec 10 14:25:27.486470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.486710 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.486829 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53608) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:27.496622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.505180 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Calling delete_port for b1b6628b-2f87-4702-adf7-379b55753b62 owned by network:floatingip {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:27.585911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:27.590446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.590712 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=3aec4e6a-2e73-46b2-a654-4d50ff145aa1,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:27.716265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Deleting port 62ab0a43-fa17-4f4b-a615-bc2e4fc18872 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:27.716603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.788755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.791141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.791474 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP cf47aa53-1662-4cde-aa2f-903b24ad1e82 disassociated (deleted). External IP: 172.26.2.233, port: d90da5ba-c379-42d8-8a4e-ddb3ae06b67c. Dec 10 14:25:27.827490 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Pushing event deleted for resources: {'Port': ['ID=b1b6628b-2f87-4702-adf7-379b55753b62,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:27.922129 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks [] for floatingip, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.925398 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.926927 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-caf52055-d753-4e17-b89e-0a8dc71a1013 tempest-FloatingIPAdminTestJSON-454522517 tempest-FloatingIPAdminTestJSON-454522517-project] 10.222.0.57 "DELETE /v2.0/floatingips/0ade65f2-729e-4db5-8273-c01287d9fa80 HTTP/1.1" status: 204 len: 168 time: 1.0285859 Dec 10 14:25:27.929630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53614) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:27.966468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:27.991681 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Calling delete_port for 62ab0a43-fa17-4f4b-a615-bc2e4fc18872 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:28.087408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Deleting port 6eb17a39-6102-4320-a095-d90f51c436df {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:28.087754 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.100839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.204568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=97be32d5-2672-4281-b1a7-9566e2dbf48c,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:28.224077 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.224410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.241511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Calling delete_port for 6eb17a39-6102-4320-a095-d90f51c436df owned by network:floatingip {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:28.243385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': '58bcc0c4-9e6d-488e-bce3-f832de1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '357dc108-37ad-4356-90e3-4bbd945fbb62'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:28.243745 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: 357dc108-37ad-4356-90e3-4bbd945fbb62, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:28.259781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:28.352171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.386407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 357dc108-37ad-4356-90e3-4bbd945fbb62 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:28.472865 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.474891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 357dc108-37ad-4356-90e3-4bbd945fbb62) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:28.476310 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.484705 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c16801d9-e2e6-404d-a1e2-84e9638575bd None None] Network 357dc108-37ad-4356-90e3-4bbd945fbb62 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:28.508177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:28.508571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.511485 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Pushing event deleted for resources: {'Port': ['ID=6eb17a39-6102-4320-a095-d90f51c436df,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:28.521005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event deleted for resources: {'Port': ['ID=62ab0a43-fa17-4f4b-a615-bc2e4fc18872,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:28.582713 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.586907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.586907 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a6b4573d-a734-4b34-8ca9-005a8766d71a tempest-FloatingIPAdminTestJSON-422794072 tempest-FloatingIPAdminTestJSON-422794072-project-admin] 10.222.0.57 "DELETE /v2.0/floatingips/bed5b756-43ad-46fc-a77a-251802b16c79 HTTP/1.1" status: 204 len: 168 time: 0.6562073 Dec 10 14:25:28.590829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53618) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:28.620362 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-357dc108-37ad-4356-90e3-4bbd945fbb62', 'network_id': '357dc108-37ad-4356-90e3-4bbd945fbb62', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': '97be32d5-2672-4281-b1a7-9566e2dbf48c'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:28.621545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.625986 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f53b68f9-3a9c-49ad-80a5-2301ab439ab2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 816 time: 1.3648071 Dec 10 14:25:28.629605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53620) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:28.638001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1610586893'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:28.725921 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-60e216de-fb85-45cb-a401-1e401d8c5c9f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Deleting port 0e283c53-d685-420d-9540-2d89bb5ea30d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:28.726227 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-60e216de-fb85-45cb-a401-1e401d8c5c9f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.794228 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:28.797818 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.804186 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Allocated IP 172.20.255.242 (357dc108-37ad-4356-90e3-4bbd945fbb62/97be32d5-2672-4281-b1a7-9566e2dbf48c/18ed8287-5c50-47b2-9269-4d49db12c7e7) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:28.810157 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:28.828004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f35779-7f43-4756-9dcd-a60e3e009b02 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:28.853617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 393, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:28.854436 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f35779-7f43-4756-9dcd-a60e3e009b02 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:28.855994 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f9f35779-7f43-4756-9dcd-a60e3e009b02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:28.857194 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.874656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-60e216de-fb85-45cb-a401-1e401d8c5c9f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.877719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.877719 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment 911f4ced-1d2d-4a01-b38b-778978fafb9a of type vlan for network 84024f34-a33f-481f-86bf-3e9ad911dc0a Dec 10 14:25:28.901982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-60e216de-fb85-45cb-a401-1e401d8c5c9f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Calling delete_port for 0e283c53-d685-420d-9540-2d89bb5ea30d owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:28.931347 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f772cf90-8c1d-4a73-9d8c-3a9aacc51b4d tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/floatingips/cf47aa53-1662-4cde-aa2f-903b24ad1e82 HTTP/1.1" status: 204 len: 168 time: 2.5587623 Dec 10 14:25:28.936464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53626) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:28.937012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:28.948027 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f9f35779-7f43-4756-9dcd-a60e3e009b02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:28.969271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f35779-7f43-4756-9dcd-a60e3e009b02 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:28.969628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f9f35779-7f43-4756-9dcd-a60e3e009b02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:29.008049 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.012336 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f9f35779-7f43-4756-9dcd-a60e3e009b02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:29.012987 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f35779-7f43-4756-9dcd-a60e3e009b02 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:29.035222 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.038246 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.095788 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.110872 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b49389ed-ffe4-4347-ac6a-7b88f4b8d02c tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port d90da5ba-c379-42d8-8a4e-ddb3ae06b67c {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:29.111215 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b49389ed-ffe4-4347-ac6a-7b88f4b8d02c tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.175824 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Deleting port baca3390-321b-4fa3-8f35-cc5b637c3796 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:29.176167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.185727 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.192061 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:29.192061 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.194842 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.217318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.217809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Fanout notify agent at l3_agent the message router_deleted on router d4cf29e3-727f-46f3-aee1-35bb59b2268c {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:25:29.226655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.230750 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-05c3aa92-1170-45b4-8c42-f6d42e852794 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/d4cf29e3-727f-46f3-aee1-35bb59b2268c HTTP/1.1" status: 204 len: 168 time: 2.5311060 Dec 10 14:25:29.230870 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Network 357dc108-37ad-4356-90e3-4bbd945fbb62 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:29.232756 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53628) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:29.235901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:29.238582 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:29.241766 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7561f737-7a3d-45ca-83f1-2db1c6066455 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-2097657123', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:29.272093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Pushing event updated for resources: {'Port': ['ID=18ed8287-5c50-47b2-9269-4d49db12c7e7,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:29.298756 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.300957 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=84024f34-a33f-481f-86bf-3e9ad911dc0a,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:29.310101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Attempting to bind port 18ed8287-5c50-47b2-9269-4d49db12c7e7 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:29.310695 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Attempting to bind port 18ed8287-5c50-47b2-9269-4d49db12c7e7 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '58bcc0c4-9e6d-488e-bce3-f832de1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '357dc108-37ad-4356-90e3-4bbd945fbb62'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:29.311235 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Attempting to bind port 18ed8287-5c50-47b2-9269-4d49db12c7e7 on network 357dc108-37ad-4356-90e3-4bbd945fbb62 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:29.314712 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Calling delete_port for baca3390-321b-4fa3-8f35-cc5b637c3796 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:29.316469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b49389ed-ffe4-4347-ac6a-7b88f4b8d02c tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.316703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 84024f34-a33f-481f-86bf-3e9ad911dc0a details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:29.330133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b49389ed-ffe4-4347-ac6a-7b88f4b8d02c tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for d90da5ba-c379-42d8-8a4e-ddb3ae06b67c owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:29.342009 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:29.342391 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Checking segment: {'id': '58bcc0c4-9e6d-488e-bce3-f832de1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '357dc108-37ad-4356-90e3-4bbd945fbb62'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:29.345714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.345714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Bound using segment: {'id': '58bcc0c4-9e6d-488e-bce3-f832de1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '357dc108-37ad-4356-90e3-4bbd945fbb62'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:29.345714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Bound port: 18ed8287-5c50-47b2-9269-4d49db12c7e7, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '58bcc0c4-9e6d-488e-bce3-f832de1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '357dc108-37ad-4356-90e3-4bbd945fbb62'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:29.345966 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0f37d8f0-564c-435d-8c13-24318f2f2d8d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.7132261 Dec 10 14:25:29.346046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.346675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53630) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:29.351748 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': '84024f34-a33f-481f-86bf-3e9ad911dc0a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': True, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:29.398758 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-60e216de-fb85-45cb-a401-1e401d8c5c9f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.437748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7561f737-7a3d-45ca-83f1-2db1c6066455 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.438767 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7561f737-7a3d-45ca-83f1-2db1c6066455 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.463790 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] For port 18ed8287-5c50-47b2-9269-4d49db12c7e7, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:29.467444 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] For port 18ed8287-5c50-47b2-9269-4d49db12c7e7, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=18ed8287-5c50-47b2-9269-4d49db12c7e7,segment=NetworkSegment(58bcc0c4-9e6d-488e-bce3-f832de1cf6fc),segment_id=58bcc0c4-9e6d-488e-bce3-f832de1cf6fc)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:29.532011 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.559597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7561f737-7a3d-45ca-83f1-2db1c6066455 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.625140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.659478 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7561f737-7a3d-45ca-83f1-2db1c6066455 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.688903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Port': ['ID=baca3390-321b-4fa3-8f35-cc5b637c3796,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:29.739477 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7aa38f4-b91e-4f70-be98-5db3296a35c7 None None] Pushing event updated for resources: {'Port': ['ID=18ed8287-5c50-47b2-9269-4d49db12c7e7,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:29.790733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60e216de-fb85-45cb-a401-1e401d8c5c9f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event deleted for resources: {'Port': ['ID=0e283c53-d685-420d-9540-2d89bb5ea30d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:29.847215 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.878217 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7561f737-7a3d-45ca-83f1-2db1c6066455 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:29.881809 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7561f737-7a3d-45ca-83f1-2db1c6066455 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.6482205 Dec 10 14:25:29.959790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53638) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:29.965940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': False}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:30.012639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-60e216de-fb85-45cb-a401-1e401d8c5c9f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.016224 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-60e216de-fb85-45cb-a401-1e401d8c5c9f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "DELETE /v2.0/ports/0e283c53-d685-420d-9540-2d89bb5ea30d HTTP/1.1" status: 204 len: 168 time: 1.4242887 Dec 10 14:25:30.028542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53640) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:30.187914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dc62df6-e924-42ab-af7d-00fcdaa553db tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:30.190509 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4dc62df6-e924-42ab-af7d-00fcdaa553db tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "GET /v2.0/ports?device_id=43cfa4d1-b60d-4556-8238-383470614599 HTTP/1.1" status: 200 len: 913 time: 0.1603730 Dec 10 14:25:30.192329 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:30.197354 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.206982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53642) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:30.215830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Router b333eb0a-7e57-4b46-9fbb-8afa1bec2007 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:30.253772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b49389ed-ffe4-4347-ac6a-7b88f4b8d02c tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.308660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 18ed8287-5c50-47b2-9269-4d49db12c7e7 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:30.325321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b49389ed-ffe4-4347-ac6a-7b88f4b8d02c tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=d90da5ba-c379-42d8-8a4e-ddb3ae06b67c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:30.375813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 18ed8287-5c50-47b2-9269-4d49db12c7e7 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:30.376191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.447674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b49389ed-ffe4-4347-ac6a-7b88f4b8d02c tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.457037 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b49389ed-ffe4-4347-ac6a-7b88f4b8d02c tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/ports/d90da5ba-c379-42d8-8a4e-ddb3ae06b67c HTTP/1.1" status: 204 len: 168 time: 1.5162673 Dec 10 14:25:30.458650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53644) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:30.461947 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:30.473233 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.508946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 18ed8287-5c50-47b2-9269-4d49db12c7e7, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=18ed8287-5c50-47b2-9269-4d49db12c7e7,segment=NetworkSegment(58bcc0c4-9e6d-488e-bce3-f832de1cf6fc),segment_id=58bcc0c4-9e6d-488e-bce3-f832de1cf6fc)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:30.518929 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:30.521619 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.533011 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43b5c57b-d97a-4a54-ad04-ebb726b6db3f None None] Sync routers for ids ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:30.534681 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fe017342-7ada-44c2-a546-8994ab23f134 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "PUT /v2.0/routers/b333eb0a-7e57-4b46-9fbb-8afa1bec2007/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0466158 Dec 10 14:25:30.537767 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53646) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:30.546118 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43b5c57b-d97a-4a54-ad04-ebb726b6db3f None None] Routers {'b333eb0a-7e57-4b46-9fbb-8afa1bec2007'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:30.547617 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-43b5c57b-d97a-4a54-ad04-ebb726b6db3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:30.581725 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-43b5c57b-d97a-4a54-ad04-ebb726b6db3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:30.588116 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-410290e0-5565-470a-92bb-e92396fef085 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] show failed (client error): The resource could not be found. Dec 10 14:25:30.588836 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-410290e0-5565-470a-92bb-e92396fef085 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "GET /v2.0/routers/tempest-non_exist_router-318378809 HTTP/1.1" status: 404 len: 334 time: 0.0491986 Dec 10 14:25:30.591424 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43b5c57b-d97a-4a54-ad04-ebb726b6db3f None None] Routers {'b333eb0a-7e57-4b46-9fbb-8afa1bec2007'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:30.592242 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-43b5c57b-d97a-4a54-ad04-ebb726b6db3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:30.595558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.598831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53648) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:30.608261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d56da177-8538-4877-a6d0-c5a41f847a94 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Request body: {'router': {'name': 'new_name'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:30.644937 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-43b5c57b-d97a-4a54-ad04-ebb726b6db3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:30.645651 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43b5c57b-d97a-4a54-ad04-ebb726b6db3f None None] The sync data for ids ['b333eb0a-7e57-4b46-9fbb-8afa1bec2007'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:30.657125 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.661637 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-d56da177-8538-4877-a6d0-c5a41f847a94 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] update failed (client error): The resource could not be found. Dec 10 14:25:30.666949 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d56da177-8538-4877-a6d0-c5a41f847a94 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "PUT /v2.0/routers/tempest-non_exist_router-1103442569 HTTP/1.1" status: 404 len: 335 time: 0.0668228 Dec 10 14:25:30.674596 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=18ed8287-5c50-47b2-9269-4d49db12c7e7,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:30.676210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53652) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:30.746657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.832596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-15fa620a-fc29-475e-ac9d-415ddd2bb9cb tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Deleting subnet 6bf30801-611a-4d65-8217-e69f96f2373c {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:25:30.840016 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15fa620a-fc29-475e-ac9d-415ddd2bb9cb tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.843573 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=c6e1c79a-9957-495f-96fb-c42c91a0eaa3,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:30.901869 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15fa620a-fc29-475e-ac9d-415ddd2bb9cb tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:30.939012 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': '911f4ced-1d2d-4a01-b38b-778978fafb9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': '84024f34-a33f-481f-86bf-3e9ad911dc0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:30.939392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: 84024f34-a33f-481f-86bf-3e9ad911dc0a, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:30.970490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.029898 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.048234 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15fa620a-fc29-475e-ac9d-415ddd2bb9cb tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.102626 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 84024f34-a33f-481f-86bf-3e9ad911dc0a is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:31.103867 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ec238ed-c7b2-4b24-b865-771fe9c7ab60 None None] Network 357dc108-37ad-4356-90e3-4bbd945fbb62 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:31.187171 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 84024f34-a33f-481f-86bf-3e9ad911dc0a) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:31.195445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:31.196059 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.206965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17310060-8710-456b-b673-0b9e4067e6dd None None] Network 84024f34-a33f-481f-86bf-3e9ad911dc0a requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:31.217021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.26.2.72 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/cdf89cb9-9e7c-479d-a9b6-c0a42c1f258c) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:31.272532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15fa620a-fc29-475e-ac9d-415ddd2bb9cb tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.273848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-4fdb7771-815c-4b49-b191-270cf3a32765 None None] Provisioning complete for port 18ed8287-5c50-47b2-9269-4d49db12c7e7 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:31.274225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4fdb7771-815c-4b49-b191-270cf3a32765 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.320492 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9575d015-c4e7-402e-a83e-9e2156fe18af tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 873 time: 1.9687631 Dec 10 14:25:31.320492 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15fa620a-fc29-475e-ac9d-415ddd2bb9cb tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Subnet': ['ID=6bf30801-611a-4d65-8217-e69f96f2373c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:31.325543 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15fa620a-fc29-475e-ac9d-415ddd2bb9cb tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.325719 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53658) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:31.326596 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-15fa620a-fc29-475e-ac9d-415ddd2bb9cb tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "DELETE /v2.0/subnets/6bf30801-611a-4d65-8217-e69f96f2373c HTTP/1.1" status: 204 len: 168 time: 0.6428940 Dec 10 14:25:31.327892 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53660) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:31.328014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.376957 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70d42a1b-2dad-49c0-89aa-653b993fff5e None None] Network 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:31.380765 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-63d6c07a-d386-444d-9834-1107cfd11e98 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Deleting subnet f39cba28-0ea0-4d08-8bc7-c4185041907e {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:25:31.392014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63d6c07a-d386-444d-9834-1107cfd11e98 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.440700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.453943 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-84024f34-a33f-481f-86bf-3e9ad911dc0a', 'network_id': '84024f34-a33f-481f-86bf-3e9ad911dc0a', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': 'c6e1c79a-9957-495f-96fb-c42c91a0eaa3'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:31.454969 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.455183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63d6c07a-d386-444d-9834-1107cfd11e98 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.472924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.481534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.598304 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.609643 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.670825 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Allocated IP 172.20.0.2 (84024f34-a33f-481f-86bf-3e9ad911dc0a/c6e1c79a-9957-495f-96fb-c42c91a0eaa3/dd6bb5fe-94ce-4c30-bb76-a766784d7003) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:31.683081 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:31.692209 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:31.694776 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:31.699384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63d6c07a-d386-444d-9834-1107cfd11e98 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.761909 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=cdf89cb9-9e7c-479d-a9b6-c0a42c1f258c,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:31.772154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81ee5ee7-5135-4afe-93f3-bc2f39199feb None None] Provisioning complete for port 18ed8287-5c50-47b2-9269-4d49db12c7e7 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:31.772520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81ee5ee7-5135-4afe-93f3-bc2f39199feb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.791012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Allocated IP 172.26.2.2 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/57fcabc3-0b2d-4f5f-9597-9da431b4f7c4) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:31.814129 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8654de6-cac7-4b6e-983d-d1e5e7d6807f None None] DHCP port deletion for 2d3a78f5-ce1f-4d70-a49e-78fdf44089ca request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:31.826565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.910384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63d6c07a-d386-444d-9834-1107cfd11e98 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.934006 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63d6c07a-d386-444d-9834-1107cfd11e98 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.941676 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-63d6c07a-d386-444d-9834-1107cfd11e98 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "DELETE /v2.0/subnets/f39cba28-0ea0-4d08-8bc7-c4185041907e HTTP/1.1" status: 204 len: 168 time: 0.6125977 Dec 10 14:25:31.947721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53666) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:31.960029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:31.962716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16ba54f1-f0cc-413c-ae47-ebd602696b72 None None] Network 7227165d-b534-4973-be59-efaecf3d309c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:31.964688 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63d6c07a-d386-444d-9834-1107cfd11e98 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Subnet': ['ID=f39cba28-0ea0-4d08-8bc7-c4185041907e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:31.976596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.025213 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.032087 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e8654de6-cac7-4b6e-983d-d1e5e7d6807f None None] Deleting port 01814436-81dc-492c-b230-07ed49056ef1 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:32.032454 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e8654de6-cac7-4b6e-983d-d1e5e7d6807f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.095753 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.109678 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.126114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.144707 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Network 84024f34-a33f-481f-86bf-3e9ad911dc0a is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:32.157561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:32.167352 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:32.175260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Pushing event updated for resources: {'Port': ['ID=dd6bb5fe-94ce-4c30-bb76-a766784d7003,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:32.178803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e8654de6-cac7-4b6e-983d-d1e5e7d6807f None None] For port 01814436-81dc-492c-b230-07ed49056ef1, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=01814436-81dc-492c-b230-07ed49056ef1,segment=NetworkSegment(5b1a4aea-89c6-4b5a-976b-a83dcb3e9567),segment_id=5b1a4aea-89c6-4b5a-976b-a83dcb3e9567)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:32.179216 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e8654de6-cac7-4b6e-983d-d1e5e7d6807f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.212564 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e8654de6-cac7-4b6e-983d-d1e5e7d6807f None None] Calling delete_port for 01814436-81dc-492c-b230-07ed49056ef1 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:32.233626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.292525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Attempting to bind port dd6bb5fe-94ce-4c30-bb76-a766784d7003 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:32.293338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Attempting to bind port dd6bb5fe-94ce-4c30-bb76-a766784d7003 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '911f4ced-1d2d-4a01-b38b-778978fafb9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': '84024f34-a33f-481f-86bf-3e9ad911dc0a'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:32.293739 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Attempting to bind port dd6bb5fe-94ce-4c30-bb76-a766784d7003 on network 84024f34-a33f-481f-86bf-3e9ad911dc0a {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:32.298573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 18ed8287-5c50-47b2-9269-4d49db12c7e7 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:32.336123 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:32.336507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Checking segment: {'id': '911f4ced-1d2d-4a01-b38b-778978fafb9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': '84024f34-a33f-481f-86bf-3e9ad911dc0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:32.336911 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.337683 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Bound using segment: {'id': '911f4ced-1d2d-4a01-b38b-778978fafb9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': '84024f34-a33f-481f-86bf-3e9ad911dc0a'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:32.337800 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Bound port: dd6bb5fe-94ce-4c30-bb76-a766784d7003, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '911f4ced-1d2d-4a01-b38b-778978fafb9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': '84024f34-a33f-481f-86bf-3e9ad911dc0a'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:32.338192 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.345737 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=c6e1c79a-9957-495f-96fb-c42c91a0eaa3,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:32.356805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.368285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8aa2cc79-4511-40b0-a8c7-b81ca2883544 None None] DHCP port deletion for 7227165d-b534-4973-be59-efaecf3d309c request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:32.419775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.465783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.482104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 18ed8287-5c50-47b2-9269-4d49db12c7e7 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:32.482479 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.487363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Deleting port 4b329c76-1d1a-4d3d-96ed-51b3b3843f11 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:32.487705 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.497969 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=cdf89cb9-9e7c-479d-a9b6-c0a42c1f258c,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:32.506403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] For port dd6bb5fe-94ce-4c30-bb76-a766784d7003, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:32.514275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.514814 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.519800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['84024f34-a33f-481f-86bf-3e9ad911dc0a']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:32.526263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Deleting port 01814436-81dc-492c-b230-07ed49056ef1 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:32.526263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.530621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] For port dd6bb5fe-94ce-4c30-bb76-a766784d7003, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=dd6bb5fe-94ce-4c30-bb76-a766784d7003,segment=NetworkSegment(911f4ced-1d2d-4a01-b38b-778978fafb9a),segment_id=911f4ced-1d2d-4a01-b38b-778978fafb9a)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:32.533653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e8654de6-cac7-4b6e-983d-d1e5e7d6807f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.544364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8aa2cc79-4511-40b0-a8c7-b81ca2883544 None None] Deleting port a6ad88e6-de35-45f2-bac8-b5f03e83b49a {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:32.544726 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8aa2cc79-4511-40b0-a8c7-b81ca2883544 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.575919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8654de6-cac7-4b6e-983d-d1e5e7d6807f None None] Pushing event deleted for resources: {'Port': ['ID=01814436-81dc-492c-b230-07ed49056ef1,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:32.609491 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '911f4ced-1d2d-4a01-b38b-778978fafb9a') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:32.610030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '911f4ced-1d2d-4a01-b38b-778978fafb9a') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:32.614742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8654de6-cac7-4b6e-983d-d1e5e7d6807f None None] No DVR routers for this DVR port 01814436-81dc-492c-b230-07ed49056ef1 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:32.618451 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.622194 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fbfc2bdd-1356-4aa9-9158-a5e87ea9b379 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.1613920 Dec 10 14:25:32.627917 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53672) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:32.630393 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'port': {'network_id': '826f4ffe-6ffa-44c2-a055-d6d8b94c119d', 'name': 'tempest-FloatingIPTestJSON-51406909'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:32.642426 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-097bdba6-e3ee-4e7f-94ae-b0680c02e2c6 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2929142 Dec 10 14:25:32.672401 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.674081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:32.684858 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.687313 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8aa2cc79-4511-40b0-a8c7-b81ca2883544 None None] For port a6ad88e6-de35-45f2-bac8-b5f03e83b49a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a6ad88e6-de35-45f2-bac8-b5f03e83b49a,segment=NetworkSegment(58a8d89d-1ce9-45fc-a09d-dc7a2195428b),segment_id=58a8d89d-1ce9-45fc-a09d-dc7a2195428b)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:32.687819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8aa2cc79-4511-40b0-a8c7-b81ca2883544 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.690164 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:32.711702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:32.741012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8aa2cc79-4511-40b0-a8c7-b81ca2883544 None None] Calling delete_port for a6ad88e6-de35-45f2-bac8-b5f03e83b49a owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:32.754551 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Pushing event updated for resources: {'Port': ['ID=57fcabc3-0b2d-4f5f-9597-9da431b4f7c4,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:32.762186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] For port 01814436-81dc-492c-b230-07ed49056ef1, host dv-neutron-821401-2-hyperv, got binding levels [] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:32.762186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.773224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.821919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 393 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:32.822328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.826243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Calling delete_port for 01814436-81dc-492c-b230-07ed49056ef1 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:32.828993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:32.833446 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:32.841581 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.ipam_backend_mixin [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Port 01814436-81dc-492c-b230-07ed49056ef1 was not found and therefore no delete operation was performed {{(pid=103811) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 10 14:25:32.894845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.896799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Calling delete_port for 4b329c76-1d1a-4d3d-96ed-51b3b3843f11 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:32.898899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Made reservation on behalf of c2a7c581de164ccf910afaf96add3a69 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:32.904623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:32.947989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] device_id is not set on port ce4d8dfb-05be-4f4b-8e3b-166bc3e562af yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:25:32.948506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 01814436-81dc-492c-b230-07ed49056ef1 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:25:32.990040 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] No DVR routers for this DVR port 01814436-81dc-492c-b230-07ed49056ef1 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:32.994567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Port': ['ID=01814436-81dc-492c-b230-07ed49056ef1,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:33.021830 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 01814436-81dc-492c-b230-07ed49056ef1 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:25:33.022171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 01814436-81dc-492c-b230-07ed49056ef1 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:25:33.025689 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385e9f87-c029-43f7-8b14-bd60fbe647a3 None None] Pushing event updated for resources: {'Port': ['ID=dd6bb5fe-94ce-4c30-bb76-a766784d7003,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:33.063670 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-900027a8-a53c-41fe-b657-e868baa4deea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:33.068228 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-900027a8-a53c-41fe-b657-e868baa4deea service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1098 time: 0.3436494 Dec 10 14:25:33.070018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afcfbc3e-f128-4ddf-b2da-deb153cc3fd9 None None] Network 84024f34-a33f-481f-86bf-3e9ad911dc0a requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:33.095376 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.api [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:25:33.095376 dv-neutron-821401-2-hyperv neutron-server[103811]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:25:33.095376 dv-neutron-821401-2-hyperv neutron-server[103811]: [parameters: {'id': '84024f34-a33f-481f-86bf-3e9ad911dc0a'}] Dec 10 14:25:33.095376 dv-neutron-821401-2-hyperv neutron-server[103811]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103811) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:25:33.095850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG oslo_db.api [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:25:33.115460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-758326d5-1fbb-48cb-a061-a49948f3d2a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.130545 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.20.0.11 (826f4ffe-6ffa-44c2-a055-d6d8b94c119d/acea17da-7f1b-4834-9b60-5d797c3b126f/ce4d8dfb-05be-4f4b-8e3b-166bc3e562af) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:33.170659 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8aa2cc79-4511-40b0-a8c7-b81ca2883544 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.210808 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aa2cc79-4511-40b0-a8c7-b81ca2883544 None None] No DVR routers for this DVR port a6ad88e6-de35-45f2-bac8-b5f03e83b49a on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:33.215900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa2cc79-4511-40b0-a8c7-b81ca2883544 None None] Pushing event deleted for resources: {'Port': ['ID=a6ad88e6-de35-45f2-bac8-b5f03e83b49a,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:33.238469 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcdfa055-1bbe-4314-91c2-8d3b1b021d1a None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:25:33.328372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.435157 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.440781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fcdfa055-1bbe-4314-91c2-8d3b1b021d1a None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:25:33.484102 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:33.489484 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:33.493410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:33.525331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=ce4d8dfb-05be-4f4b-8e3b-166bc3e562af,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:33.536923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.548881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:33.550647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.598219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2d3a78f5-ce1f-4d70-a49e-78fdf44089ca']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:33.600172 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.639512 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5b1a4aea-89c6-4b5a-976b-a83dcb3e9567') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:33.640193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5b1a4aea-89c6-4b5a-976b-a83dcb3e9567') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:33.663734 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f2c18435-cc68-4923-bc73-52091060e7bf tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 1.0393438 Dec 10 14:25:33.666553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53680) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:33.672168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-20f8979b-4c6e-4611-a52e-564d8fdd2d3b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'port_id': 'ce4d8dfb-05be-4f4b-8e3b-166bc3e562af'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:33.709604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.715097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20f8979b-4c6e-4611-a52e-564d8fdd2d3b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.727488 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-df5d1c8f-99b5-4449-b038-88516cbf8e6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:33.729003 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-df5d1c8f-99b5-4449-b038-88516cbf8e6b service neutron] 10.222.0.39 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 912 time: 0.6050370 Dec 10 14:25:33.818913 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.855785 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c50e182a-1166-46f0-a938-d480b16b4692 None None] DHCP port deletion for 826f4ffe-6ffa-44c2-a055-d6d8b94c119d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:33.867187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Releasing vlan 384 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:33.867594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.871078 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port cdf89cb9-9e7c-479d-a9b6-c0a42c1f258c triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:33.871466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:33.872592 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:33.913204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port cdf89cb9-9e7c-479d-a9b6-c0a42c1f258c cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:33.926735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:33.928426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.962452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:33.973378 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port d40064eb-9d6a-4b06-a016-b2dfb0b21ba2 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:33.973784 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:33.979712 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-5deaaa89-af66-4624-9750-906f881e6e43 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 1000 time: 0.2366486 Dec 10 14:25:33.989628 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.065694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port 7613d4bb-4ff6-4d1c-94a9-405493ee29a5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.066103 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.082507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port dd6bb5fe-94ce-4c30-bb76-a766784d7003 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:34.082859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.088815 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.105743 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port 7613d4bb-4ff6-4d1c-94a9-405493ee29a5 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:34.109470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.112661 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "DELETE /v2.0/networks/2d3a78f5-ce1f-4d70-a49e-78fdf44089ca HTTP/1.1" status: 204 len: 168 time: 2.1659598 Dec 10 14:25:34.115428 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53684) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:34.119651 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port 57fcabc3-0b2d-4f5f-9597-9da431b4f7c4 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.120053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.154562 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port 57fcabc3-0b2d-4f5f-9597-9da431b4f7c4 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:34.166433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port e3f2dcc9-5f5e-4b71-be81-94e249ea20e2 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.166997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.187893 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.200368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b3fbd4-ba62-4f8b-8337-c6a6f637c5e2 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Network': ['ID=2d3a78f5-ce1f-4d70-a49e-78fdf44089ca,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:34.202984 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-ed18de68-457f-4b15-bf19-53515fd95795 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:34.204448 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-ed18de68-457f-4b15-bf19-53515fd95795 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 200 len: 850 time: 0.2158182 Dec 10 14:25:34.216391 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port e3f2dcc9-5f5e-4b71-be81-94e249ea20e2 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:34.226924 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port be184c7a-d36c-4620-8632-abcb07e7c70e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.227492 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.253752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event deleted for resources: {'Port': ['ID=4b329c76-1d1a-4d3d-96ed-51b3b3843f11,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:34.268126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port be184c7a-d36c-4620-8632-abcb07e7c70e cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:34.276473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a6ad88e6-de35-45f2-bac8-b5f03e83b49a no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:25:34.285265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port dd6bb5fe-94ce-4c30-bb76-a766784d7003, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=dd6bb5fe-94ce-4c30-bb76-a766784d7003,segment=NetworkSegment(911f4ced-1d2d-4a01-b38b-778978fafb9a),segment_id=911f4ced-1d2d-4a01-b38b-778978fafb9a)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:34.286107 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.310505 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.311442 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.315080 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: a6ad88e6-de35-45f2-bac8-b5f03e83b49a {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:25:34.315586 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a6ad88e6-de35-45f2-bac8-b5f03e83b49a not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:25:34.359900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:34.367021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for dd6bb5fe-94ce-4c30-bb76-a766784d7003 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:34.374037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port 75de2cec-62f6-4af4-b128-88ca88f2ae1b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.374650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.396617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.430788 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-a5b80d8b-2274-468a-8c70-2bb2f5edce5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:34.432322 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-a5b80d8b-2274-468a-8c70-2bb2f5edce5a service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=1cc2d855-81bd-4d95-a565-455c7130be80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1993697 Dec 10 14:25:34.471293 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port 75de2cec-62f6-4af4-b128-88ca88f2ae1b cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:34.497804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port 89bb69a3-59a1-4bb9-a0ba-5d64500adf8f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.498181 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.572206 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port 89bb69a3-59a1-4bb9-a0ba-5d64500adf8f cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:34.582881 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port 3e34a057-7219-452b-8317-f70e57f89f17 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.583254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.587227 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.592798 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20f8979b-4c6e-4611-a52e-564d8fdd2d3b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.615699 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7227165d-b534-4973-be59-efaecf3d309c']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:34.626026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '58a8d89d-1ce9-45fc-a09d-dc7a2195428b') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:34.626453 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '58a8d89d-1ce9-45fc-a09d-dc7a2195428b') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:34.636464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.641364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.645280 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20f8979b-4c6e-4611-a52e-564d8fdd2d3b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.654465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.680138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port ce4d8dfb-05be-4f4b-8e3b-166bc3e562af triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.680509 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.690547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.701706 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Releasing vlan 365 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:34.702109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:34.705808 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:34.720562 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port ce4d8dfb-05be-4f4b-8e3b-166bc3e562af cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:34.730504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port a98b7c4e-6b43-4945-87ef-560059ea48ae triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.730958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.772649 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-5495aa47-9b8c-4a6a-a839-88c90f473efa service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2989979 Dec 10 14:25:34.781069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.810961 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-20f8979b-4c6e-4611-a52e-564d8fdd2d3b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP 2548cfb6-fc4d-4b2a-b776-7b24a53dd742 associated. External IP: 172.26.2.72, port: ce4d8dfb-05be-4f4b-8e3b-166bc3e562af. Dec 10 14:25:34.829057 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port b49a1f0f-6a2c-4141-8c6d-206654b5efc9 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.829353 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.864936 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port b49a1f0f-6a2c-4141-8c6d-206654b5efc9 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:34.876274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port f4d181cd-97c1-4460-a212-39807e75d9f6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.876674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.879790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.911528 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.916232 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:34.922882 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "DELETE /v2.0/networks/7227165d-b534-4973-be59-efaecf3d309c HTTP/1.1" status: 204 len: 168 time: 0.8038590 Dec 10 14:25:34.924830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53690) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:34.938479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2820864-f03b-436f-960f-fca2c0a51954 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Network': ['ID=7227165d-b534-4973-be59-efaecf3d309c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:34.978442 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=dd6bb5fe-94ce-4c30-bb76-a766784d7003,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:34.984820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Provisioning complete for port 4cd3dc5b-2842-490d-b8c8-d5f38ff8da7a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:34.985197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.015273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port dd6bb5fe-94ce-4c30-bb76-a766784d7003 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:35.082342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20f8979b-4c6e-4611-a52e-564d8fdd2d3b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:35.171811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f2da80d3-4ffe-4aa3-b8ab-8a9a8b46d061 None None] Port 4cd3dc5b-2842-490d-b8c8-d5f38ff8da7a cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:35.203600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20f8979b-4c6e-4611-a52e-564d8fdd2d3b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:35.209909 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20f8979b-4c6e-4611-a52e-564d8fdd2d3b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.221448 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8590c4a4-6864-499e-a0d3-b66f913c9c0d None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:35.242621 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-20f8979b-4c6e-4611-a52e-564d8fdd2d3b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/floatingips/2548cfb6-fc4d-4b2a-b776-7b24a53dd742 HTTP/1.1" status: 200 len: 976 time: 1.5749378 Dec 10 14:25:35.245311 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53694) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:35.247805 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8590c4a4-6864-499e-a0d3-b66f913c9c0d None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:35.249327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-8590c4a4-6864-499e-a0d3-b66f913c9c0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:35.253303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d07f365d-a059-431d-a4cf-8bf43e1ba6f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.303454 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-8590c4a4-6864-499e-a0d3-b66f913c9c0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:35.324958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-28d38f83-f80e-415e-ad3c-82e27d581a31 None None] Provisioning complete for port ce4d8dfb-05be-4f4b-8e3b-166bc3e562af triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:35.324958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-28d38f83-f80e-415e-ad3c-82e27d581a31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.324958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8590c4a4-6864-499e-a0d3-b66f913c9c0d None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:35.324958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-8590c4a4-6864-499e-a0d3-b66f913c9c0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:35.356376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port ce4d8dfb-05be-4f4b-8e3b-166bc3e562af {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:35.356962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.379405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-8590c4a4-6864-499e-a0d3-b66f913c9c0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:35.381874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8590c4a4-6864-499e-a0d3-b66f913c9c0d None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:35.421605 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70023a82-8f12-4a1a-8eae-0b0b5f05abe4 req-859bfbec-0bf1-4911-9da9-93933e41f903 service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6369858 Dec 10 14:25:35.422801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-28d38f83-f80e-415e-ad3c-82e27d581a31 None None] Port ce4d8dfb-05be-4f4b-8e3b-166bc3e562af cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:35.430032 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-e45f3bfa-d767-4292-afc1-b452d872b743 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Deleting subnet 0ab3f6eb-2c96-49a5-975e-9c2eec17c607 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:25:35.448592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e45f3bfa-d767-4292-afc1-b452d872b743 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.478228 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.524398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['84024f34-a33f-481f-86bf-3e9ad911dc0a']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:35.528488 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e45f3bfa-d767-4292-afc1-b452d872b743 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.599890 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '911f4ced-1d2d-4a01-b38b-778978fafb9a') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:35.600117 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '911f4ced-1d2d-4a01-b38b-778978fafb9a') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:35.615693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Router ee140fc3-bca4-46fe-bf3a-093c3952ba52 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:25:35.630650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.664475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.767780 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 393 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:35.768187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:35.771211 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:35.812063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.853981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e45f3bfa-d767-4292-afc1-b452d872b743 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.857882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Router 43cfa4d1-b60d-4556-8238-383470614599 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:35.980727 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:35.986965 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.988191 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d3b60206-b6cc-43d1-8125-e18bfb49069c tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "PUT /v2.0/routers/ee140fc3-bca4-46fe-bf3a-093c3952ba52 HTTP/1.1" status: 200 len: 914 time: 6.0266678 Dec 10 14:25:35.991805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53702) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:35.992926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:35.995147 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3006af5-c83b-400e-a2d6-08440a0281e4 None None] Sync routers for ids ['ee140fc3-bca4-46fe-bf3a-093c3952ba52'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:36.007613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.014614 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/84024f34-a33f-481f-86bf-3e9ad911dc0a HTTP/1.1" status: 204 len: 168 time: 4.6808815 Dec 10 14:25:36.018394 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3006af5-c83b-400e-a2d6-08440a0281e4 None None] Routers {'ee140fc3-bca4-46fe-bf3a-093c3952ba52'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:36.019041 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a3006af5-c83b-400e-a2d6-08440a0281e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ee140fc3-bca4-46fe-bf3a-093c3952ba52'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:36.024988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53704) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:36.031219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1812060145'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:36.037604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d36d439b-ddbc-4346-a091-24a03013c80f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=84024f34-a33f-481f-86bf-3e9ad911dc0a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:36.064040 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a3006af5-c83b-400e-a2d6-08440a0281e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:36.075457 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3006af5-c83b-400e-a2d6-08440a0281e4 None None] Routers {'ee140fc3-bca4-46fe-bf3a-093c3952ba52'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:36.076112 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a3006af5-c83b-400e-a2d6-08440a0281e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ee140fc3-bca4-46fe-bf3a-093c3952ba52'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:36.100708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:36.106027 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b45f9943-f89a-4355-bf0f-cb62ddfec678 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "PUT /v2.0/routers/43cfa4d1-b60d-4556-8238-383470614599/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.8884768 Dec 10 14:25:36.108422 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53706) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:36.123434 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a3006af5-c83b-400e-a2d6-08440a0281e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:36.124370 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3006af5-c83b-400e-a2d6-08440a0281e4 None None] The sync data for ids ['ee140fc3-bca4-46fe-bf3a-093c3952ba52'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:36.135683 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59c2145c-f241-4f1a-a1f2-adb92a406741 None None] Sync routers for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:36.162286 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e45f3bfa-d767-4292-afc1-b452d872b743 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.167950 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59c2145c-f241-4f1a-a1f2-adb92a406741 None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:36.168930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-59c2145c-f241-4f1a-a1f2-adb92a406741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:36.169532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.169905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.170233 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP 2548cfb6-fc4d-4b2a-b776-7b24a53dd742 disassociated. External IP: 172.26.2.72, port: ce4d8dfb-05be-4f4b-8e3b-166bc3e562af. Dec 10 14:25:36.171428 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for ce4d8dfb-05be-4f4b-8e3b-166bc3e562af owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:36.195402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:36.199642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.206459 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e45f3bfa-d767-4292-afc1-b452d872b743 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Subnet': ['ID=0ab3f6eb-2c96-49a5-975e-9c2eec17c607,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:36.219251 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-59c2145c-f241-4f1a-a1f2-adb92a406741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:36.221129 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e45f3bfa-d767-4292-afc1-b452d872b743 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.229800 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e45f3bfa-d767-4292-afc1-b452d872b743 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "DELETE /v2.0/subnets/0ab3f6eb-2c96-49a5-975e-9c2eec17c607 HTTP/1.1" status: 204 len: 168 time: 1.2776802 Dec 10 14:25:36.230665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3fdefa5-1798-4c34-83ff-a5f21e91320c None None] Network 5cb05196-50ab-470a-b82c-465f1679670b requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:36.230748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53708) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:36.272029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59c2145c-f241-4f1a-a1f2-adb92a406741 None None] Routers {'43cfa4d1-b60d-4556-8238-383470614599'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:36.272654 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-59c2145c-f241-4f1a-a1f2-adb92a406741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['43cfa4d1-b60d-4556-8238-383470614599'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:36.309885 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.316583 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-59c2145c-f241-4f1a-a1f2-adb92a406741 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:36.317238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59c2145c-f241-4f1a-a1f2-adb92a406741 None None] The sync data for ids ['43cfa4d1-b60d-4556-8238-383470614599'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:36.415078 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.432502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.446655 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b4294110-e9db-4719-9f1b-a0bfcf04a5df tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/routers/ee140fc3-bca4-46fe-bf3a-093c3952ba52 HTTP/1.1" status: 200 len: 920 time: 0.4523349 Dec 10 14:25:36.453365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53712) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:36.488400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7d5b07a-d5f7-4c67-8bf6-56fa16b9b1b0 None None] DHCP port deletion for 5cb05196-50ab-470a-b82c-465f1679670b request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:36.499828 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.507391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 352, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:36.526792 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.526792 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment aa9e6931-7180-43be-98bc-1d901afdfae2 of type vlan for network 80ed8bcc-d9fb-4550-905e-9a7504be053d Dec 10 14:25:36.546623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b7d5b07a-d5f7-4c67-8bf6-56fa16b9b1b0 None None] Deleting port 6dc4c83f-ff68-477c-9142-8f39a51b7434 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:36.547091 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7d5b07a-d5f7-4c67-8bf6-56fa16b9b1b0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.554476 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=ce4d8dfb-05be-4f4b-8e3b-166bc3e562af,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:36.566335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfa971ea-0939-4adb-8b03-7c3520dc7372 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:36.567986 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cfa971ea-0939-4adb-8b03-7c3520dc7372 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=ee140fc3-bca4-46fe-bf3a-093c3952ba52&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 943 time: 0.1135657 Dec 10 14:25:36.572246 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53714) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:36.615982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Deleting port 6dc4c83f-ff68-477c-9142-8f39a51b7434 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:36.616318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.621983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.636123 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b7d5b07a-d5f7-4c67-8bf6-56fa16b9b1b0 None None] For port 6dc4c83f-ff68-477c-9142-8f39a51b7434, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6dc4c83f-ff68-477c-9142-8f39a51b7434,segment=NetworkSegment(49c83a4f-e933-447b-901a-02f0bc8ab550),segment_id=49c83a4f-e933-447b-901a-02f0bc8ab550)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:36.636934 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7d5b07a-d5f7-4c67-8bf6-56fa16b9b1b0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.653285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b7d5b07a-d5f7-4c67-8bf6-56fa16b9b1b0 None None] Calling delete_port for 6dc4c83f-ff68-477c-9142-8f39a51b7434 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:36.677578 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.704801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80abfd69-b81f-4f6d-bda7-00fe21f1c488 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:36.708902 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-80abfd69-b81f-4f6d-bda7-00fe21f1c488 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 881 time: 0.1332910 Dec 10 14:25:36.709201 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53718) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:36.713978 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] For port 6dc4c83f-ff68-477c-9142-8f39a51b7434, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6dc4c83f-ff68-477c-9142-8f39a51b7434,segment=NetworkSegment(49c83a4f-e933-447b-901a-02f0bc8ab550),segment_id=49c83a4f-e933-447b-901a-02f0bc8ab550)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:36.714849 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.748227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ddc2a27-8709-4b0e-89af-356971286e29 None None] DHCP port deletion for 826f4ffe-6ffa-44c2-a055-d6d8b94c119d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:36.759186 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f89ef7dc-da70-4171-b911-27e2933507c0 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=ee140fc3-bca4-46fe-bf3a-093c3952ba52 HTTP/1.1" status: 200 len: 205 time: 0.0475719 Dec 10 14:25:36.760128 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Calling delete_port for 6dc4c83f-ff68-477c-9142-8f39a51b7434 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:36.761883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53722) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:36.826001 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7d5b07a-d5f7-4c67-8bf6-56fa16b9b1b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.856386 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d5b07a-d5f7-4c67-8bf6-56fa16b9b1b0 None None] Pushing event deleted for resources: {'Port': ['ID=6dc4c83f-ff68-477c-9142-8f39a51b7434,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:36.867058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7d5b07a-d5f7-4c67-8bf6-56fa16b9b1b0 None None] No DVR routers for this DVR port 6dc4c83f-ff68-477c-9142-8f39a51b7434 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:36.885530 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:36.933474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.939301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:36.939829 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:36.993605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:37.005913 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e185d3d3-6b1e-4022-8e5c-9dab4e17b468 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:37.017636 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e185d3d3-6b1e-4022-8e5c-9dab4e17b468 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:37.018286 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-e185d3d3-6b1e-4022-8e5c-9dab4e17b468 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:37.055609 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.055819 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-e185d3d3-6b1e-4022-8e5c-9dab4e17b468 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:37.059325 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.065268 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7b20c4e5-cfec-49ae-a33a-2b258cbfa8ba tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/ports/ce4d8dfb-05be-4f4b-8e3b-166bc3e562af HTTP/1.1" status: 204 len: 168 time: 1.8163471 Dec 10 14:25:37.066426 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53724) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:37.066560 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e185d3d3-6b1e-4022-8e5c-9dab4e17b468 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:37.067104 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-e185d3d3-6b1e-4022-8e5c-9dab4e17b468 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:37.098864 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-e185d3d3-6b1e-4022-8e5c-9dab4e17b468 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:37.099524 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e185d3d3-6b1e-4022-8e5c-9dab4e17b468 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:37.108489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=80ed8bcc-d9fb-4550-905e-9a7504be053d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:37.118990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 80ed8bcc-d9fb-4550-905e-9a7504be053d details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:37.149469 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b38eb5b4-73c4-4db8-b3af-bdc48e9bb6cc tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.1219559 Dec 10 14:25:37.153007 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53726) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:37.158235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': '80ed8bcc-d9fb-4550-905e-9a7504be053d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:37.165447 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.179597 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-66ea846e-6247-416a-b969-d61ad82030e4 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "GET /v2.0/floatingips/2548cfb6-fc4d-4b2a-b776-7b24a53dd742 HTTP/1.1" status: 200 len: 687 time: 0.1112895 Dec 10 14:25:37.200503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53728) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:37.214764 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Port': ['ID=6dc4c83f-ff68-477c-9142-8f39a51b7434,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:37.249535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Deleting port 7613d4bb-4ff6-4d1c-94a9-405493ee29a5 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:37.249873 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.256223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] No DVR routers for this DVR port 6dc4c83f-ff68-477c-9142-8f39a51b7434 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:37.311755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:37.315555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.380028 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing IP validity checks on allocation pools {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 10 14:25:37.380581 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 10 14:25:37.541733 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.563775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.631899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=ce685e7c-4ca1-4eb0-bf8f-eecb2b704f72,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:37.641185 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': 'aa9e6931-7180-43be-98bc-1d901afdfae2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '80ed8bcc-d9fb-4550-905e-9a7504be053d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:37.641583 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: 80ed8bcc-d9fb-4550-905e-9a7504be053d, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:37.705951 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 80ed8bcc-d9fb-4550-905e-9a7504be053d is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:37.748967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.755841 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.780066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 80ed8bcc-d9fb-4550-905e-9a7504be053d) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:37.785916 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:37.786047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.789184 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90752a60-e366-461c-bca7-5294ccd11272 None None] Network 80ed8bcc-d9fb-4550-905e-9a7504be053d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:37.792821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.802234 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5cb05196-50ab-470a-b82c-465f1679670b']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:37.817606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Calling delete_port for 7613d4bb-4ff6-4d1c-94a9-405493ee29a5 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:37.826409 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '49c83a4f-e933-447b-901a-02f0bc8ab550') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:37.826718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '49c83a4f-e933-447b-901a-02f0bc8ab550') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:37.848670 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.874951 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:25:37.906255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.915911 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-360378aa-396a-4d91-be4c-ac6f23443ff6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 792 time: 0.7616701 Dec 10 14:25:37.918945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53736) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:37.927941 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-80ed8bcc-d9fb-4550-905e-9a7504be053d', 'network_id': '80ed8bcc-d9fb-4550-905e-9a7504be053d', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': 'ce685e7c-4ca1-4eb0-bf8f-eecb2b704f72'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:37.928890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.933721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port cdf89cb9-9e7c-479d-a9b6-c0a42c1f258c {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:37.934072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.951785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Releasing vlan 366 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:37.952206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:37.955261 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:38.041142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.080810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Allocated IP 172.20.0.3 (80ed8bcc-d9fb-4550-905e-9a7504be053d/ce685e7c-4ca1-4eb0-bf8f-eecb2b704f72/832999ed-8c9d-48c4-bf5c-b1bd92fe911a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:38.123716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.138028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Deleting port 57fcabc3-0b2d-4f5f-9597-9da431b4f7c4 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:38.138362 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.158918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.159252 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.195078 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.205226 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for cdf89cb9-9e7c-479d-a9b6-c0a42c1f258c owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:38.210228 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.213312 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "DELETE /v2.0/networks/5cb05196-50ab-470a-b82c-465f1679670b HTTP/1.1" status: 204 len: 168 time: 1.9845273 Dec 10 14:25:38.216677 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53738) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:38.218686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6dc4c83f-ff68-477c-9142-8f39a51b7434 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:25:38.243985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 6dc4c83f-ff68-477c-9142-8f39a51b7434 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:25:38.244254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6dc4c83f-ff68-477c-9142-8f39a51b7434 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:25:38.247977 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-baee5ba4-72cb-423b-b8e6-4274f25e7d6e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "GET /v2.0/ports?device_id=b333eb0a-7e57-4b46-9fbb-8afa1bec2007 HTTP/1.1" status: 200 len: 205 time: 0.0271513 Dec 10 14:25:38.247977 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53740) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:38.261570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad451dc-87aa-4f32-aea7-2dd78ed6204e tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Pushing event deleted for resources: {'Network': ['ID=5cb05196-50ab-470a-b82c-465f1679670b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:38.325066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74777176-93a4-43d1-a0e9-a099fedaf473 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.499159 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.499159 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Calling delete_port for 57fcabc3-0b2d-4f5f-9597-9da431b4f7c4 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:38.499471 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74777176-93a4-43d1-a0e9-a099fedaf473 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.499471 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74777176-93a4-43d1-a0e9-a099fedaf473 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.524755 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.562215 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event deleted for resources: {'Port': ['ID=7613d4bb-4ff6-4d1c-94a9-405493ee29a5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:38.626760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7970fbb9-e03c-4203-a048-33b487be6e25 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:38.643694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.652531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.654229 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74777176-93a4-43d1-a0e9-a099fedaf473 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.654684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-74777176-93a4-43d1-a0e9-a099fedaf473 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Fanout notify agent at l3_agent the message router_deleted on router b333eb0a-7e57-4b46-9fbb-8afa1bec2007 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:25:38.664174 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-74777176-93a4-43d1-a0e9-a099fedaf473 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.667496 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-74777176-93a4-43d1-a0e9-a099fedaf473 tempest-RoutersNegativeTest-94061798 tempest-RoutersNegativeTest-94061798-project] 10.222.0.57 "DELETE /v2.0/routers/b333eb0a-7e57-4b46-9fbb-8afa1bec2007 HTTP/1.1" status: 204 len: 168 time: 0.4168267 Dec 10 14:25:38.685905 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=cdf89cb9-9e7c-479d-a9b6-c0a42c1f258c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:38.702131 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dd000e5-1e71-4e64-8547-39be5a742bb6 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:38.712914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.746422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.793077 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.800015 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Network 80ed8bcc-d9fb-4550-905e-9a7504be053d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:38.803054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.805448 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:38.809680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:38.816653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Pushing event updated for resources: {'Port': ['ID=832999ed-8c9d-48c4-bf5c-b1bd92fe911a,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:38.855811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.865968 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.868161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.873546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event deleted for resources: {'Port': ['ID=57fcabc3-0b2d-4f5f-9597-9da431b4f7c4,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:38.898811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Attempting to bind port 832999ed-8c9d-48c4-bf5c-b1bd92fe911a on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:38.899303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Attempting to bind port 832999ed-8c9d-48c4-bf5c-b1bd92fe911a by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'aa9e6931-7180-43be-98bc-1d901afdfae2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '80ed8bcc-d9fb-4550-905e-9a7504be053d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:38.899876 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Attempting to bind port 832999ed-8c9d-48c4-bf5c-b1bd92fe911a on network 80ed8bcc-d9fb-4550-905e-9a7504be053d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:38.902244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=ce685e7c-4ca1-4eb0-bf8f-eecb2b704f72,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:38.909836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-faf8df9c-ab69-4c4a-a5ad-76d7b45e5aa7 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:38.919883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.922530 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.923732 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-82de18a0-e453-4469-8ba2-2a4e58454c1b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/floatingips/2548cfb6-fc4d-4b2a-b776-7b24a53dd742 HTTP/1.1" status: 204 len: 168 time: 1.7207716 Dec 10 14:25:38.930532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:38.930963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Checking segment: {'id': 'aa9e6931-7180-43be-98bc-1d901afdfae2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '80ed8bcc-d9fb-4550-905e-9a7504be053d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:38.931793 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.932476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Bound using segment: {'id': 'aa9e6931-7180-43be-98bc-1d901afdfae2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '80ed8bcc-d9fb-4550-905e-9a7504be053d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:38.934013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Bound port: 832999ed-8c9d-48c4-bf5c-b1bd92fe911a, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aa9e6931-7180-43be-98bc-1d901afdfae2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '80ed8bcc-d9fb-4550-905e-9a7504be053d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:38.934355 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:38.935277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53748) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:38.965603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': '8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:38.994629 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.038184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.041729 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] For port 832999ed-8c9d-48c4-bf5c-b1bd92fe911a, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:39.051760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] For port 832999ed-8c9d-48c4-bf5c-b1bd92fe911a, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=832999ed-8c9d-48c4-bf5c-b1bd92fe911a,segment=NetworkSegment(aa9e6931-7180-43be-98bc-1d901afdfae2),segment_id=aa9e6931-7180-43be-98bc-1d901afdfae2)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:39.067447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['80ed8bcc-d9fb-4550-905e-9a7504be053d']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:39.078305 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aa9e6931-7180-43be-98bc-1d901afdfae2') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:39.078604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aa9e6931-7180-43be-98bc-1d901afdfae2') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:39.086418 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.089681 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Fanout notify agent at l3_agent the message router_deleted on router 43cfa4d1-b60d-4556-8238-383470614599 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:25:39.092244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.132638 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.134442 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7112fd14-4377-49ce-ab96-cc1d5d7f182f tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "DELETE /v2.0/routers/43cfa4d1-b60d-4556-8238-383470614599 HTTP/1.1" status: 204 len: 168 time: 3.0249927 Dec 10 14:25:39.138023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53752) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:39.139729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.141041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.145445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.189456 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.194026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.216159 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 352 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:39.230895 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:39.237388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1e8269-dd0b-4fa9-924f-054aa2c8e2ad None None] Pushing event updated for resources: {'Port': ['ID=832999ed-8c9d-48c4-bf5c-b1bd92fe911a,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:39.266183 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35e2875d-850f-4001-9253-884c7b01cd03 None None] Network 80ed8bcc-d9fb-4550-905e-9a7504be053d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:39.286038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-779fde0d-6da5-4831-93b2-555555c7460d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Deleting subnet 98872e2d-7886-464c-ba29-a756a514943a {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:25:39.301180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.304951 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Fanout notify agent at l3_agent the message router_deleted on router ee140fc3-bca4-46fe-bf3a-093c3952ba52 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:25:39.317147 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.318944 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-78f30ae6-f351-4988-85ac-a19a91728ca2 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/ee140fc3-bca4-46fe-bf3a-093c3952ba52 HTTP/1.1" status: 204 len: 168 time: 2.5561750 Dec 10 14:25:39.325578 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53756) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:39.334240 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-779fde0d-6da5-4831-93b2-555555c7460d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.341677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-931546308', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:39.385541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-779fde0d-6da5-4831-93b2-555555c7460d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.395963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53758) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:39.401363 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9497455f-75f7-4b2e-81f7-84497a13e88c None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:25:39.440975 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:25:39.440975 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:25:39.440975 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': '80ed8bcc-d9fb-4550-905e-9a7504be053d'}] Dec 10 14:25:39.440975 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:25:39.441503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:25:39.466357 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.467654 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.500224 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-779fde0d-6da5-4831-93b2-555555c7460d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.504094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.538664 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.551580 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9497455f-75f7-4b2e-81f7-84497a13e88c None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:25:39.609109 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-76af53e8-c806-494f-b4b9-4730e27b416a admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=d3343b3b6d35425bb712248f00332c2c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2116632 Dec 10 14:25:39.609990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53762) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:39.664901 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.26.2.9 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/ffd5e0b3-98a0-4430-b60c-d3683623e008) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:39.733573 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-779fde0d-6da5-4831-93b2-555555c7460d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.773138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-779fde0d-6da5-4831-93b2-555555c7460d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event deleted for resources: {'Subnet': ['ID=98872e2d-7886-464c-ba29-a756a514943a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:39.775171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a136ca46-25ad-4a05-9e61-439977ff0a0f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.775298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-779fde0d-6da5-4831-93b2-555555c7460d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.778612 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-779fde0d-6da5-4831-93b2-555555c7460d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "DELETE /v2.0/subnets/98872e2d-7886-464c-ba29-a756a514943a HTTP/1.1" status: 204 len: 168 time: 0.6365032 Dec 10 14:25:39.781178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53766) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:39.821823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.836317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a136ca46-25ad-4a05-9e61-439977ff0a0f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.863981 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-874ef9ed-8dc5-4fd4-8d4f-78efaf929993 None None] Network cddc1f75-fded-4d66-be87-4ea9449263df requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:39.901004 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.905517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:39.945014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.030292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Deleting port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:40.030292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.030481 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78a42cb8-aaf5-4efd-bff6-02b30465dac4 None None] DHCP port deletion for cddc1f75-fded-4d66-be87-4ea9449263df request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:40.033620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a136ca46-25ad-4a05-9e61-439977ff0a0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.036220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a136ca46-25ad-4a05-9e61-439977ff0a0f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.037366 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a136ca46-25ad-4a05-9e61-439977ff0a0f admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/2af44980-7143-4ee5-a786-f41850ee0e98 HTTP/1.1" status: 204 len: 168 time: 0.4265573 Dec 10 14:25:40.047104 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a136ca46-25ad-4a05-9e61-439977ff0a0f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2af44980-7143-4ee5-a786-f41850ee0e98,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:40.094291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-78a42cb8-aaf5-4efd-bff6-02b30465dac4 None None] Deleting port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:40.094687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-78a42cb8-aaf5-4efd-bff6-02b30465dac4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.117496 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.131148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] For port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b,segment=NetworkSegment(bab6f12a-9611-429f-a6c5-65d7001e80de),segment_id=bab6f12a-9611-429f-a6c5-65d7001e80de)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:40.131651 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.160283 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.174521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:40.182380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.185220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:40.192125 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:40.197148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Calling delete_port for 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:40.234512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port 832999ed-8c9d-48c4-bf5c-b1bd92fe911a {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:40.235238 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.264045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-78a42cb8-aaf5-4efd-bff6-02b30465dac4 None None] For port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b,segment=NetworkSegment(bab6f12a-9611-429f-a6c5-65d7001e80de),segment_id=bab6f12a-9611-429f-a6c5-65d7001e80de)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:40.265549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-78a42cb8-aaf5-4efd-bff6-02b30465dac4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.298366 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-78a42cb8-aaf5-4efd-bff6-02b30465dac4 None None] Calling delete_port for 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:40.313095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=ffd5e0b3-98a0-4430-b60c-d3683623e008,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:40.319655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:25:40.384950 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Allocated IP 172.26.2.94 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/15d7a872-93a0-4468-a6c9-4454d576cb03) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:40.407851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b0b5f3-a7be-479e-bc76-2124a5fe58de req-8de18ca9-fa6a-4854-a15e-c10de88b40d1 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:40.409776 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-56b0b5f3-a7be-479e-bc76-2124a5fe58de req-8de18ca9-fa6a-4854-a15e-c10de88b40d1 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.0855100 Dec 10 14:25:40.461797 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port 832999ed-8c9d-48c4-bf5c-b1bd92fe911a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=832999ed-8c9d-48c4-bf5c-b1bd92fe911a,segment=NetworkSegment(aa9e6931-7180-43be-98bc-1d901afdfae2),segment_id=aa9e6931-7180-43be-98bc-1d901afdfae2)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:40.462479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.464485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.498098 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for 832999ed-8c9d-48c4-bf5c-b1bd92fe911a owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:40.515716 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-56b0b5f3-a7be-479e-bc76-2124a5fe58de req-a17a97c6-d25b-4d0e-864a-13a01258aa7f tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0982678 Dec 10 14:25:40.548769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.555049 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.582313 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-78a42cb8-aaf5-4efd-bff6-02b30465dac4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.616490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78a42cb8-aaf5-4efd-bff6-02b30465dac4 None None] Pushing event deleted for resources: {'Port': ['ID=3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:40.636753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78a42cb8-aaf5-4efd-bff6-02b30465dac4 None None] No DVR routers for this DVR port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:40.712430 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.752307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:40.755549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:40.761508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:40.795774 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66a87387-a945-436f-aae3-0a332e4d3e17 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:40.796065 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event updated for resources: {'Port': ['ID=15d7a872-93a0-4468-a6c9-4454d576cb03,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:40.934066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-02a8713f-e810-4fd1-86bd-b178f62816fe None None] Provisioning complete for port 15d7a872-93a0-4468-a6c9-4454d576cb03 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:40.937337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-02a8713f-e810-4fd1-86bd-b178f62816fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:40.976030 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event deleted for resources: {'Port': ['ID=3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:40.988907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] No DVR routers for this DVR port 3afbe269-e001-4e5c-ba8d-d37ba0e2aa2b on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:41.017703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-02a8713f-e810-4fd1-86bd-b178f62816fe None None] Port 15d7a872-93a0-4468-a6c9-4454d576cb03 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:41.152673 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.209359 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cddc1f75-fded-4d66-be87-4ea9449263df']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:41.225574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bab6f12a-9611-429f-a6c5-65d7001e80de') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:41.225878 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bab6f12a-9611-429f-a6c5-65d7001e80de') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:41.243246 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.267403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.282163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.312260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Releasing vlan 398 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:41.312260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:41.316772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port 832999ed-8c9d-48c4-bf5c-b1bd92fe911a on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:41.318926 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=832999ed-8c9d-48c4-bf5c-b1bd92fe911a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:41.331768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a41b2df-43f5-4225-9b23-7b1e1714d0aa req-6c150c40-bdbb-457e-9a49-7ef2df2f080c tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:41.333972 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1a41b2df-43f5-4225-9b23-7b1e1714d0aa req-6c150c40-bdbb-457e-9a49-7ef2df2f080c tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 946 time: 0.1595972 Dec 10 14:25:41.352335 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6bccd00-0f29-4aad-a406-5b01e2b13767 req-eb002fe5-76e7-43c5-a508-fa10e2caea62 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:41.353866 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d6bccd00-0f29-4aad-a406-5b01e2b13767 req-eb002fe5-76e7-43c5-a508-fa10e2caea62 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1264725 Dec 10 14:25:41.424244 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53804) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:41.440185 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1a41b2df-43f5-4225-9b23-7b1e1714d0aa req-22ad6eab-9a45-42d3-af18-61a1984bc21a tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0853472 Dec 10 14:25:41.446468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.480066 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d6bccd00-0f29-4aad-a406-5b01e2b13767 req-0e264544-56ca-4260-aad0-d57229acb5cc tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1171203 Dec 10 14:25:41.480547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['80ed8bcc-d9fb-4550-905e-9a7504be053d']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:41.493695 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aa9e6931-7180-43be-98bc-1d901afdfae2') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:41.494003 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aa9e6931-7180-43be-98bc-1d901afdfae2') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:41.519232 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.521073 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.527415 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.535819 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "DELETE /v2.0/networks/cddc1f75-fded-4d66-be87-4ea9449263df HTTP/1.1" status: 204 len: 168 time: 1.7515633 Dec 10 14:25:41.541374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53812) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:41.572729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.595446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.629401 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Request body: {'network': {'name': 'tempest-TagsExtTest-test-network-1264477789'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:41.632577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aea979a-934f-41a4-a170-23ec3a4c80c9 tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event deleted for resources: {'Network': ['ID=cddc1f75-fded-4d66-be87-4ea9449263df,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:41.646388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 352 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:41.646796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:41.650135 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:41.805871 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Made reservation on behalf of 3477d1434b76476d8d2a87f0861257e6 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:41.809332 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.824548 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.851702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.868752 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.899537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Deleting port e3f2dcc9-5f5e-4b71-be81-94e249ea20e2 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:41.899880 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.944734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.959039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:41.962418 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/80ed8bcc-d9fb-4550-905e-9a7504be053d HTTP/1.1" status: 204 len: 168 time: 4.0421746 Dec 10 14:25:41.967469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53818) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:41.978072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1905249850'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:41.979313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b25fc26-4ba7-4f03-8cf5-65405b958aea tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=80ed8bcc-d9fb-4550-905e-9a7504be053d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:42.024437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.027221 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.041809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Calling delete_port for e3f2dcc9-5f5e-4b71-be81-94e249ea20e2 owned by network:floatingip {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:42.061916 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.167834 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.185537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:42.189649 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.215123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 370, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:42.217007 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Router 50ef5b56-4b09-4b0f-b8fe-09787638b535 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:25:42.221080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.257645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.257989 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment 6f560d51-1bf3-42a9-9711-ccd13eef4aa8 of type vlan for network f82bd24c-4a5b-4462-8ceb-3efb26395cb0 Dec 10 14:25:42.320226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.320440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] vlan segment allocate from pool success with {'vlan_id': 386, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:42.328722 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c5dd898e-4545-440a-8373-be195677f0e2,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:42.373718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.376186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.378653 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Added segment 5e06ec80-9ff0-4191-8d7d-ada7e7078368 of type vlan for network 7e45316e-5348-48a4-ba91-b71be829572c Dec 10 14:25:42.382470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Pushing event deleted for resources: {'Port': ['ID=e3f2dcc9-5f5e-4b71-be81-94e249ea20e2,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:42.397963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10f5254c-149e-49f9-8eec-62550610e8a4 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:42.436805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.456172 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks [] for floatingip, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.458921 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.460304 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4c6a9df1-9320-4235-ad9c-c88dc632336d tempest-FloatingIPAdminTestJSON-72377738 tempest-FloatingIPAdminTestJSON-72377738-project] 10.222.0.57 "DELETE /v2.0/floatingips/74436347-b957-4f2a-bbe9-6e1c83802a2f HTTP/1.1" status: 204 len: 168 time: 0.8931906 Dec 10 14:25:42.492963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.534109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.553261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:42.566491 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98095f36-ac8b-4d65-951f-6e0c35090c30 None None] Sync routers for ids ['50ef5b56-4b09-4b0f-b8fe-09787638b535'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:42.577748 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98095f36-ac8b-4d65-951f-6e0c35090c30 None None] Routers {'50ef5b56-4b09-4b0f-b8fe-09787638b535'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:42.578041 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=ffd5e0b3-98a0-4430-b60c-d3683623e008,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:42.578970 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-98095f36-ac8b-4d65-951f-6e0c35090c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['50ef5b56-4b09-4b0f-b8fe-09787638b535'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:42.599407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e79cff6-1dbc-4fd3-96db-d8ff0c102c87 req-ea34a5fe-cb53-4bb0-acd4-0b1f30129b2c tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:42.600949 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0e79cff6-1dbc-4fd3-96db-d8ff0c102c87 req-ea34a5fe-cb53-4bb0-acd4-0b1f30129b2c tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 946 time: 0.1131532 Dec 10 14:25:42.640284 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.640390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-98095f36-ac8b-4d65-951f-6e0c35090c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:42.652388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98095f36-ac8b-4d65-951f-6e0c35090c30 None None] Routers {'50ef5b56-4b09-4b0f-b8fe-09787638b535'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:42.654084 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-98095f36-ac8b-4d65-951f-6e0c35090c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['50ef5b56-4b09-4b0f-b8fe-09787638b535'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:42.668473 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0e79cff6-1dbc-4fd3-96db-d8ff0c102c87 req-d684f6a6-f629-4271-89e9-53196f7ffff9 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0595398 Dec 10 14:25:42.673585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.680628 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:42.681281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.693880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-98095f36-ac8b-4d65-951f-6e0c35090c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:42.694621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98095f36-ac8b-4d65-951f-6e0c35090c30 None None] The sync data for ids ['50ef5b56-4b09-4b0f-b8fe-09787638b535'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:42.710773 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.719358 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:42.719964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.726947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:42.731097 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7634ce27-06c0-4ab4-8072-566fa4f206b4 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 883 time: 3.4069924 Dec 10 14:25:42.743628 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53832) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:42.749986 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:42.773733 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP efcd9b24-6792-4105-904f-0dfec93fb6cc associated. External IP: 172.26.2.9, port: 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb. Dec 10 14:25:42.841756 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.8720863 Dec 10 14:25:42.859523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53834) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:42.868479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': 'f82bd24c-4a5b-4462-8ceb-3efb26395cb0', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:42.874264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e2f0f4-c44d-40ff-a868-7cf4898d5dcb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=f82bd24c-4a5b-4462-8ceb-3efb26395cb0,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:42.892404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network f82bd24c-4a5b-4462-8ceb-3efb26395cb0 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:42.969793 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.5409365 Dec 10 14:25:42.980944 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53838) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:42.989537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Request body: {'subnet': {'network_id': '7e45316e-5348-48a4-ba91-b71be829572c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:43.007657 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d168e845-57ad-4fa7-b04f-7b3568545fa5 req-9eec220a-89dc-45c2-8f1b-ec67e43d623c tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:43.009678 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d168e845-57ad-4fa7-b04f-7b3568545fa5 req-9eec220a-89dc-45c2-8f1b-ec67e43d623c tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2629163 Dec 10 14:25:43.025528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd993a3f-0b66-407b-988d-a47940ebd8bc tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Pushing event updated for resources: {'Network': ['ID=7e45316e-5348-48a4-ba91-b71be829572c,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:43.079528 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:43.153680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53840) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:43.195804 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d168e845-57ad-4fa7-b04f-7b3568545fa5 req-b8a84d5d-10d9-43b2-8a3a-c5505179fc3e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1654701 Dec 10 14:25:43.217448 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 7e45316e-5348-48a4-ba91-b71be829572c details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:43.223523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:43.237842 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-676994ad-64ae-4f78-a2e7-7a820af72cb6 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:43.250315 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-676994ad-64ae-4f78-a2e7-7a820af72cb6 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:43.250805 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-676994ad-64ae-4f78-a2e7-7a820af72cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:43.253786 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:43.258364 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.368310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.399110 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-676994ad-64ae-4f78-a2e7-7a820af72cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:43.408363 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-676994ad-64ae-4f78-a2e7-7a820af72cb6 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:43.409234 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-676994ad-64ae-4f78-a2e7-7a820af72cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:43.412601 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b29c13ce-cead-4ef9-89dc-59c376ef6435 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 4.4714506 Dec 10 14:25:43.414071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53844) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:43.419699 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-1598821892'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:43.431053 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.446556 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-676994ad-64ae-4f78-a2e7-7a820af72cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:43.447327 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-676994ad-64ae-4f78-a2e7-7a820af72cb6 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:43.458141 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a92c9b93-ccd2-4afd-943c-bf77482268fe admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=a7e7e6d5ec1249eab11dc6b13a869de7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3002560 Dec 10 14:25:43.458479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53846) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:43.485982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Made reservation on behalf of 3477d1434b76476d8d2a87f0861257e6 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:43.489467 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.545662 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.579677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-052a146f-5f15-4c9f-a567-7f5283edfdee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.597187 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Made reservation on behalf of c2a7c581de164ccf910afaf96add3a69 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:43.601114 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.614475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-052a146f-5f15-4c9f-a567-7f5283edfdee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.615092 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.660773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] vlan segment allocate from pool success with {'vlan_id': 396, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:43.686603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.688463 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Added segment 92dede0e-5309-4094-90c3-53a0a9b80ce1 of type vlan for network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 Dec 10 14:25:43.694614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=d31206a9-bbed-4429-9335-9ab9960519df,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:43.754125 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': '6f560d51-1bf3-42a9-9711-ccd13eef4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 370, 'network_id': 'f82bd24c-4a5b-4462-8ceb-3efb26395cb0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:43.754472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: f82bd24c-4a5b-4462-8ceb-3efb26395cb0, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:43.760011 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.775602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Deleting port 15d7a872-93a0-4468-a6c9-4454d576cb03 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:43.775998 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.821141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-052a146f-5f15-4c9f-a567-7f5283edfdee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.824054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-052a146f-5f15-4c9f-a567-7f5283edfdee admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.828025 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-052a146f-5f15-4c9f-a567-7f5283edfdee admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/7be49409-0100-44b7-9389-297ed321d57e HTTP/1.1" status: 204 len: 168 time: 0.3660684 Dec 10 14:25:43.843949 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.851129 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-052a146f-5f15-4c9f-a567-7f5283edfdee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7be49409-0100-44b7-9389-297ed321d57e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:43.872403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network f82bd24c-4a5b-4462-8ceb-3efb26395cb0 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:43.874743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.880411 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:43.884236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.924273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:43.950372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Calling delete_port for 15d7a872-93a0-4468-a6c9-4454d576cb03 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:43.960664 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Pushing event updated for resources: {'Subnet': ['ID=ec8ef166-737b-4e91-ad59-1413d9d87545,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:43.990534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Checking segment: {'id': '5e06ec80-9ff0-4191-8d7d-ada7e7078368', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7e45316e-5348-48a4-ba91-b71be829572c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:43.990898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Network hostable DHCP agents. Network: 7e45316e-5348-48a4-ba91-b71be829572c, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:44.003733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, f82bd24c-4a5b-4462-8ceb-3efb26395cb0) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:44.010115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:44.013674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.014964 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4da3cc4-c9da-4727-97f5-7d7dda8719a6 None None] Network f82bd24c-4a5b-4462-8ceb-3efb26395cb0 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:44.038953 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.6209564 Dec 10 14:25:44.041095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53854) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:44.054673 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'subnet': {'network_id': '9c3829d2-ad8b-4c9e-8fca-cff12849a398', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:44.077526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f3738c9-c696-497a-bd66-9a41d72d2b62 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Network': ['ID=9c3829d2-ad8b-4c9e-8fca-cff12849a398,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:44.124076 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e64e2e92-34ca-40ab-b63c-e951f513d462 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.2610095 Dec 10 14:25:44.124739 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53858) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:44.132337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:44.267476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-f82bd24c-4a5b-4462-8ceb-3efb26395cb0', 'network_id': 'f82bd24c-4a5b-4462-8ceb-3efb26395cb0', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': 'd31206a9-bbed-4429-9335-9ab9960519df'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:44.272087 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.281319 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.298221 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Made reservation on behalf of c2a7c581de164ccf910afaf96add3a69 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:44.301670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.413386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.426933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Allocated IP 172.20.0.1 (f82bd24c-4a5b-4462-8ceb-3efb26395cb0/d31206a9-bbed-4429-9335-9ab9960519df/91f35969-8544-40e5-8c9b-1c4f6983b5c6) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:44.516412 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-9b8f21e7-6be3-4838-9b14-f48d6f9255c3 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:44.518119 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-9b8f21e7-6be3-4838-9b14-f48d6f9255c3 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.39 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 946 time: 0.5301433 Dec 10 14:25:44.533361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d67bba62-1908-44b7-a9db-47a7773ef581 req-5c0892a9-6ea1-43d5-aa87-074d30634286 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:44.537939 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d67bba62-1908-44b7-a9db-47a7773ef581 req-5c0892a9-6ea1-43d5-aa87-074d30634286 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 946 time: 0.5287259 Dec 10 14:25:44.581507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beeb1c03-9d38-44a8-93b0-9e2f4136552b req-d1264160-6157-4ca2-bb4f-518554a82a42 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:44.583308 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-beeb1c03-9d38-44a8-93b0-9e2f4136552b req-d1264160-6157-4ca2-bb4f-518554a82a42 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 946 time: 0.1690836 Dec 10 14:25:44.593535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Network 7e45316e-5348-48a4-ba91-b71be829572c is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:44.600510 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.621402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 7e45316e-5348-48a4-ba91-b71be829572c) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:44.626561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:44.628495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.629313 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5e5102a-1df0-4889-8950-e93b4ac1eaa9 None None] Network 7e45316e-5348-48a4-ba91-b71be829572c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:44.683733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53864) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:44.689924 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.704519 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0154e81e-66fa-4828-91ac-217eb12ac403 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.711263 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.755070 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Network f82bd24c-4a5b-4462-8ceb-3efb26395cb0 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:44.763102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:44.767722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:44.769485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Pushing event updated for resources: {'Port': ['ID=91f35969-8544-40e5-8c9b-1c4f6983b5c6,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:44.781340 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d67bba62-1908-44b7-a9db-47a7773ef581 req-2a184ad7-9db3-40e1-ac73-01272d4b398c tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2074995 Dec 10 14:25:44.794109 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-beeb1c03-9d38-44a8-93b0-9e2f4136552b req-8a7194d9-a930-41af-ab66-a53df82ebe9b tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1940947 Dec 10 14:25:44.814706 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7ad8425b-1477-4671-a6b3-cb455dea07d0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8329525 Dec 10 14:25:44.826148 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-7e45316e-5348-48a4-ba91-b71be829572c', 'network_id': '7e45316e-5348-48a4-ba91-b71be829572c', 'project_id': '3477d1434b76476d8d2a87f0861257e6', 'fixed_ips': [{'subnet_id': 'ec8ef166-737b-4e91-ad59-1413d9d87545'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:44.826742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.827013 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53868) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:44.835221 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Subnet': ['ID=f812692c-cac5-411a-b257-d33ebcf6a597,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:44.838189 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Request body: {'port': {'network_id': '7e45316e-5348-48a4-ba91-b71be829572c', 'name': 'tempest-TagsExtTest-149862472'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:44.868623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Checking segment: {'id': '92dede0e-5309-4094-90c3-53a0a9b80ce1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '9c3829d2-ad8b-4c9e-8fca-cff12849a398'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:44.869107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network hostable DHCP agents. Network: 9c3829d2-ad8b-4c9e-8fca-cff12849a398, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:44.893967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.941314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Attempting to bind port 91f35969-8544-40e5-8c9b-1c4f6983b5c6 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:44.941627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Attempting to bind port 91f35969-8544-40e5-8c9b-1c4f6983b5c6 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6f560d51-1bf3-42a9-9711-ccd13eef4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 370, 'network_id': 'f82bd24c-4a5b-4462-8ceb-3efb26395cb0'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:44.941985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Attempting to bind port 91f35969-8544-40e5-8c9b-1c4f6983b5c6 on network f82bd24c-4a5b-4462-8ceb-3efb26395cb0 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:44.946755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.955417 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:44.955823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Checking segment: {'id': '6f560d51-1bf3-42a9-9711-ccd13eef4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 370, 'network_id': 'f82bd24c-4a5b-4462-8ceb-3efb26395cb0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:44.956189 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.956582 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Bound using segment: {'id': '6f560d51-1bf3-42a9-9711-ccd13eef4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 370, 'network_id': 'f82bd24c-4a5b-4462-8ceb-3efb26395cb0'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:44.957472 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Bound port: 91f35969-8544-40e5-8c9b-1c4f6983b5c6, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f560d51-1bf3-42a9-9711-ccd13eef4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 370, 'network_id': 'f82bd24c-4a5b-4462-8ceb-3efb26395cb0'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:44.957472 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.959901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Pushing event deleted for resources: {'Port': ['ID=15d7a872-93a0-4468-a6c9-4454d576cb03,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:44.976807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Deleting port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:44.977220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:44.985974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:44.995794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=d31206a9-bbed-4429-9335-9ab9960519df,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:45.015421 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0c29272-49d9-4ccb-98d4-c97097552dc0 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:45.084760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.098351 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 9c3829d2-ad8b-4c9e-8fca-cff12849a398) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:45.114544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Allocated IP 172.20.0.2 (7e45316e-5348-48a4-ba91-b71be829572c/ec8ef166-737b-4e91-ad59-1413d9d87545/b3286fb7-5f0c-4501-86c7-119c73fa8509) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:45.117504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3734f29-01d4-466e-b310-17e0a965d0d7 None None] Network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:45.119317 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:45.120457 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.125860 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7afe0d20-58e8-45c0-a6ea-406312e12ae3 req-fed5ec02-e731-4529-b9bc-c2c393ed8c15 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:45.127777 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7afe0d20-58e8-45c0-a6ea-406312e12ae3 req-fed5ec02-e731-4529-b9bc-c2c393ed8c15 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2412233 Dec 10 14:25:45.129989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f82bd24c-4a5b-4462-8ceb-3efb26395cb0']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:45.155665 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0154e81e-66fa-4828-91ac-217eb12ac403 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.155665 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f560d51-1bf3-42a9-9711-ccd13eef4aa8') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:45.155665 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f560d51-1bf3-42a9-9711-ccd13eef4aa8') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:45.165468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.183381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.190068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 370 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:45.191187 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.192387 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:45.195258 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:45.220273 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] For port 91f35969-8544-40e5-8c9b-1c4f6983b5c6, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:45.240050 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0154e81e-66fa-4828-91ac-217eb12ac403 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.292519 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0154e81e-66fa-4828-91ac-217eb12ac403 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=349d78d324b34841a0cf5bae6003e4d4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6070375 Dec 10 14:25:45.294951 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53872) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:45.296990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0154e81e-66fa-4828-91ac-217eb12ac403 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f6d13d15-5908-4694-846a-1a2b5a0627f6,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:45.305592 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] For port 91f35969-8544-40e5-8c9b-1c4f6983b5c6, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=91f35969-8544-40e5-8c9b-1c4f6983b5c6,segment=NetworkSegment(6f560d51-1bf3-42a9-9711-ccd13eef4aa8),segment_id=6f560d51-1bf3-42a9-9711-ccd13eef4aa8)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:45.338551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:25:45.338551 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:25:45.338551 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': 'f82bd24c-4a5b-4462-8ceb-3efb26395cb0'}] Dec 10 14:25:45.338551 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:25:45.341113 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Made reservation on behalf of 3477d1434b76476d8d2a87f0861257e6 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:45.341205 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:25:45.347439 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.353767 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-9c3829d2-ad8b-4c9e-8fca-cff12849a398', 'network_id': '9c3829d2-ad8b-4c9e-8fca-cff12849a398', 'project_id': 'c2a7c581de164ccf910afaf96add3a69', 'fixed_ips': [{'subnet_id': 'f812692c-cac5-411a-b257-d33ebcf6a597'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:45.355165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.361434 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] For port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:45.362052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.367665 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-811aed3e-6ded-4973-b684-dfaa6ed31978 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.401044 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c0a75641-d6cf-4d80-a45b-58e04c678563 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3584495 Dec 10 14:25:45.405663 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-811aed3e-6ded-4973-b684-dfaa6ed31978 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.408173 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53876) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:45.414718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-1632537690', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:45.419850 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.448851 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7afe0d20-58e8-45c0-a6ea-406312e12ae3 req-b9e25d35-85bf-4bc0-b00f-c77267edddc9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3002594 Dec 10 14:25:45.520046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.561741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.562822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.570236 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] device_id is not set on port fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:25:45.585722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-811aed3e-6ded-4973-b684-dfaa6ed31978 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.589068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-811aed3e-6ded-4973-b684-dfaa6ed31978 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.590573 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-811aed3e-6ded-4973-b684-dfaa6ed31978 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/f6d13d15-5908-4694-846a-1a2b5a0627f6 HTTP/1.1" status: 204 len: 168 time: 0.2944613 Dec 10 14:25:45.599841 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1eb7ae1-fc68-4866-bfd7-d4ecc41c2053 None None] Pushing event updated for resources: {'Port': ['ID=91f35969-8544-40e5-8c9b-1c4f6983b5c6,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:45.626950 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-811aed3e-6ded-4973-b684-dfaa6ed31978 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6d13d15-5908-4694-846a-1a2b5a0627f6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:45.666329 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-397ce506-2bfa-4dd3-aa0a-902786829b5f None None] Network f82bd24c-4a5b-4462-8ceb-3efb26395cb0 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:45.676427 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.794549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.829198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Network 7e45316e-5348-48a4-ba91-b71be829572c is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:45.835988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Allocated IP 172.20.0.2 (9c3829d2-ad8b-4c9e-8fca-cff12849a398/f812692c-cac5-411a-b257-d33ebcf6a597/514dfe42-d394-4cf0-b634-07ada4981db4) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:45.840142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:45.842921 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:45.862433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:45.907059 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Pushing event updated for resources: {'Port': ['ID=b3286fb7-5f0c-4501-86c7-119c73fa8509,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:45.994538 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Attempting to bind port b3286fb7-5f0c-4501-86c7-119c73fa8509 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:45.994538 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Attempting to bind port b3286fb7-5f0c-4501-86c7-119c73fa8509 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '5e06ec80-9ff0-4191-8d7d-ada7e7078368', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7e45316e-5348-48a4-ba91-b71be829572c'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:45.997146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Attempting to bind port b3286fb7-5f0c-4501-86c7-119c73fa8509 on network 7e45316e-5348-48a4-ba91-b71be829572c {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:46.013214 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:46.013820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Checking segment: {'id': '5e06ec80-9ff0-4191-8d7d-ada7e7078368', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7e45316e-5348-48a4-ba91-b71be829572c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:46.014339 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.014914 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Bound using segment: {'id': '5e06ec80-9ff0-4191-8d7d-ada7e7078368', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7e45316e-5348-48a4-ba91-b71be829572c'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:46.015622 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Bound port: b3286fb7-5f0c-4501-86c7-119c73fa8509, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5e06ec80-9ff0-4191-8d7d-ada7e7078368', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7e45316e-5348-48a4-ba91-b71be829572c'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:46.016220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.121385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.124357 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.164015 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] For port b3286fb7-5f0c-4501-86c7-119c73fa8509, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:46.170062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] For port b3286fb7-5f0c-4501-86c7-119c73fa8509, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b3286fb7-5f0c-4501-86c7-119c73fa8509,segment=NetworkSegment(5e06ec80-9ff0-4191-8d7d-ada7e7078368),segment_id=5e06ec80-9ff0-4191-8d7d-ada7e7078368)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:46.174182 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.224533 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.302601 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port 91f35969-8544-40e5-8c9b-1c4f6983b5c6 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:46.303169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.327808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03b9b1a6-7937-4427-b1ad-955107766eb9 req-8b657ace-69b4-4e5b-9649-e7c62489ead1 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:46.340274 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-03b9b1a6-7937-4427-b1ad-955107766eb9 req-8b657ace-69b4-4e5b-9649-e7c62489ead1 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 946 time: 0.5435703 Dec 10 14:25:46.355393 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.394950 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Router 50ef5b56-4b09-4b0f-b8fe-09787638b535 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:46.410199 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.412953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Allocated IP 172.20.0.7 (7e45316e-5348-48a4-ba91-b71be829572c/ec8ef166-737b-4e91-ad59-1413d9d87545/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:46.422608 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.422701 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.422952 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Floating IP 5f7a1c28-5e2b-40f5-bfbe-2878d2b822fe disassociated. External IP: 172.26.2.178, port: 353a2f0c-9bc6-4935-a721-c19b3e0bc0da. Dec 10 14:25:46.423316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Calling delete_port for 353a2f0c-9bc6-4935-a721-c19b3e0bc0da owned by compute:nova {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:46.446102 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port 91f35969-8544-40e5-8c9b-1c4f6983b5c6, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=91f35969-8544-40e5-8c9b-1c4f6983b5c6,segment=NetworkSegment(6f560d51-1bf3-42a9-9711-ccd13eef4aa8),segment_id=6f560d51-1bf3-42a9-9711-ccd13eef4aa8)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:46.446554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.446970 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:46.451126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a410fec-a9f1-49d9-9389-fe614c494992 None None] Pushing event updated for resources: {'Port': ['ID=b3286fb7-5f0c-4501-86c7-119c73fa8509,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:46.454465 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:46.457004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:46.469739 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for 91f35969-8544-40e5-8c9b-1c4f6983b5c6 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:46.535620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfacce1a-2e05-44e4-95a5-9be5f2797c43 req-9fa47856-3d01-4254-a6ca-b04cf24c401d tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:46.543152 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Pushing event updated for resources: {'Port': ['ID=514dfe42-d394-4cf0-b634-07ada4981db4,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:46.544995 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-bfacce1a-2e05-44e4-95a5-9be5f2797c43 req-9fa47856-3d01-4254-a6ca-b04cf24c401d tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 946 time: 0.6173029 Dec 10 14:25:46.551703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Attempting to bind port 514dfe42-d394-4cf0-b634-07ada4981db4 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:46.552078 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Attempting to bind port 514dfe42-d394-4cf0-b634-07ada4981db4 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '92dede0e-5309-4094-90c3-53a0a9b80ce1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '9c3829d2-ad8b-4c9e-8fca-cff12849a398'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:46.552438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Attempting to bind port 514dfe42-d394-4cf0-b634-07ada4981db4 on network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:46.565067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:46.565067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Checking segment: {'id': '92dede0e-5309-4094-90c3-53a0a9b80ce1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '9c3829d2-ad8b-4c9e-8fca-cff12849a398'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:46.565067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.565067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Bound using segment: {'id': '92dede0e-5309-4094-90c3-53a0a9b80ce1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '9c3829d2-ad8b-4c9e-8fca-cff12849a398'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:46.565067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Bound port: 514dfe42-d394-4cf0-b634-07ada4981db4, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '92dede0e-5309-4094-90c3-53a0a9b80ce1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '9c3829d2-ad8b-4c9e-8fca-cff12849a398'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:46.565598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.569495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53888) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:46.569983 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-03b9b1a6-7937-4427-b1ad-955107766eb9 req-1192fa5c-0f3a-468f-b27a-33bdb1d461ee tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2287667 Dec 10 14:25:46.641258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] For port 514dfe42-d394-4cf0-b634-07ada4981db4, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:46.645153 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] For port 514dfe42-d394-4cf0-b634-07ada4981db4, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=514dfe42-d394-4cf0-b634-07ada4981db4,segment=NetworkSegment(92dede0e-5309-4094-90c3-53a0a9b80ce1),segment_id=92dede0e-5309-4094-90c3-53a0a9b80ce1)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:46.703129 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc6a2234-dc34-4657-8738-016777af2029 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.717794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.804164 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac58be9-24ca-4c80-bcef-91b36343a916 None None] Pushing event updated for resources: {'Port': ['ID=514dfe42-d394-4cf0-b634-07ada4981db4,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:46.825159 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.844943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:46.854999 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:46.856529 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6d5365b0-d326-4a25-95b8-3f7f13e334ec tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "PUT /v2.0/routers/50ef5b56-4b09-4b0f-b8fe-09787638b535 HTTP/1.1" status: 200 len: 705 time: 4.1119034 Dec 10 14:25:46.857059 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8d2449d-1654-44af-b836-31d2369768fc None None] Sync routers for ids ['50ef5b56-4b09-4b0f-b8fe-09787638b535'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:46.870347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53890) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:46.883639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8d2449d-1654-44af-b836-31d2369768fc None None] Routers {'50ef5b56-4b09-4b0f-b8fe-09787638b535'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:46.884503 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c8d2449d-1654-44af-b836-31d2369768fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['50ef5b56-4b09-4b0f-b8fe-09787638b535'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:46.900033 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port 91f35969-8544-40e5-8c9b-1c4f6983b5c6 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:46.929973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=91f35969-8544-40e5-8c9b-1c4f6983b5c6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:46.936711 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c8d2449d-1654-44af-b836-31d2369768fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:46.936962 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-bfacce1a-2e05-44e4-95a5-9be5f2797c43 req-4bebfb59-9009-4e4b-9c4e-44508fd3d471 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups?id=f3a20060-d794-4212-9975-ddb1ce5af055&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3907559 Dec 10 14:25:46.963132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8d2449d-1654-44af-b836-31d2369768fc None None] Routers {'50ef5b56-4b09-4b0f-b8fe-09787638b535'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:46.964152 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c8d2449d-1654-44af-b836-31d2369768fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['50ef5b56-4b09-4b0f-b8fe-09787638b535'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:46.983490 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc227737-dffa-42c7-90fb-95469613b776 req-ae0e5a1c-3cf0-43c9-84fa-d97f7d92304b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:46.985246 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fc227737-dffa-42c7-90fb-95469613b776 req-ae0e5a1c-3cf0-43c9-84fa-d97f7d92304b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.3130920 Dec 10 14:25:47.011613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c8d2449d-1654-44af-b836-31d2369768fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:47.012483 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8d2449d-1654-44af-b836-31d2369768fc None None] The sync data for ids ['50ef5b56-4b09-4b0f-b8fe-09787638b535'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:47.083263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.094850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.111652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc6a2234-dc34-4657-8738-016777af2029 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.129587 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Pushing event deleted for resources: {'Port': ['ID=353a2f0c-9bc6-4935-a721-c19b3e0bc0da,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:47.153977 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fc227737-dffa-42c7-90fb-95469613b776 req-515a54d3-dde4-4e74-a22f-35ba179631d9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1591690 Dec 10 14:25:47.239550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.247542 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-419144e7-81c0-4c11-b503-9ddf1fe6fc81 tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/routers/50ef5b56-4b09-4b0f-b8fe-09787638b535 HTTP/1.1" status: 200 len: 740 time: 0.3659446 Dec 10 14:25:47.248397 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc6a2234-dc34-4657-8738-016777af2029 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.257946 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53892) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:47.318884 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Router 67c47c57-09e4-4303-97e1-a2215115ce2a has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:47.378941 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.381374 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-697ef13c-e809-40a7-85ef-402b7349e47f tempest-RoutersAdminTest-2099888224 tempest-RoutersAdminTest-2099888224-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=50ef5b56-4b09-4b0f-b8fe-09787638b535 HTTP/1.1" status: 200 len: 205 time: 0.1183572 Dec 10 14:25:47.382216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc6a2234-dc34-4657-8738-016777af2029 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=465ad9f3-d285-4e84-a92c-5c2197b363c9,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:47.385718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53894) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:47.416073 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f82bd24c-4a5b-4462-8ceb-3efb26395cb0']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:47.447632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.464102 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f560d51-1bf3-42a9-9711-ccd13eef4aa8') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:47.464480 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f560d51-1bf3-42a9-9711-ccd13eef4aa8') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:47.486874 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-43fa4b9d-7292-497c-98e5-025043bc62dd tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=50ef5b56-4b09-4b0f-b8fe-09787638b535 HTTP/1.1" status: 200 len: 205 time: 0.0894284 Dec 10 14:25:47.495742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53896) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:47.497128 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-78d62a3b-5501-483e-9dcb-e7f930f9c1d0 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:47.498931 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-78d62a3b-5501-483e-9dcb-e7f930f9c1d0 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.39 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 946 time: 0.4660935 Dec 10 14:25:47.504792 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cc6a2234-dc34-4657-8738-016777af2029 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=1aa83cdcf1964037a1c9d74a0179d6d8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8801935 Dec 10 14:25:47.510173 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53898) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:47.524406 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.547580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.578219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Network 7e45316e-5348-48a4-ba91-b71be829572c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:47.678454 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.695686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 370 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:47.696096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.701755 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Pushing event updated for resources: {'Port': ['ID=fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:47.705550 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:47.705703 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:47.710543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:47.724675 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:47.774277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-072507a0-9e9a-41c5-8880-1b05a1e02d14 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.852994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Deleting port 1a32ff1b-25aa-44f4-9af3-1128013f508d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:47.853250 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.864189 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.26.2.32 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/e8996883-538c-4dc5-867d-b29c37005f9c) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:47.883547 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] Sync routers for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:47.907780 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:47.908648 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:47.934050 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 353a2f0c-9bc6-4935-a721-c19b3e0bc0da no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:25:47.955385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.997952 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:47.997952 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/f82bd24c-4a5b-4462-8ceb-3efb26395cb0 HTTP/1.1" status: 204 len: 168 time: 3.8712730 Dec 10 14:25:47.998485 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53906) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:48.021354 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dea97dda-d762-45eb-a702-f59771813687 None None] Network 7e45316e-5348-48a4-ba91-b71be829572c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:48.025271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: 353a2f0c-9bc6-4935-a721-c19b3e0bc0da {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:25:48.026888 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 353a2f0c-9bc6-4935-a721-c19b3e0bc0da not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:25:48.038100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ac5d9ec-59cd-4235-a6bd-5c883dd5b513 req-57a312b8-6dd0-4b64-86b2-37721c15c73e tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:48.039998 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6ac5d9ec-59cd-4235-a6bd-5c883dd5b513 req-57a312b8-6dd0-4b64-86b2-37721c15c73e tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 946 time: 0.3847079 Dec 10 14:25:48.048096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-416974373'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:48.078811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0912a54-86f4-49c9-a93b-3255c7f61066 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=f82bd24c-4a5b-4462-8ceb-3efb26395cb0,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:48.161994 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6ac5d9ec-59cd-4235-a6bd-5c883dd5b513 req-d7541314-45f6-4fe4-814d-4b8f3a6c2e80 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups?id=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1057589 Dec 10 14:25:48.163413 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:48.358702 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c3af97e-d621-41a8-9d9c-7739fb494ec5 None None] Network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:48.362502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:48.365578 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-88f84349-9b45-46eb-85ba-a1940ff3d6e0 None None] Provisioning complete for port b3286fb7-5f0c-4501-86c7-119c73fa8509 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:48.365951 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-88f84349-9b45-46eb-85ba-a1940ff3d6e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.370970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.407710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] No DVR routers for this DVR port 353a2f0c-9bc6-4935-a721-c19b3e0bc0da on host hv-neutron-8214 {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:48.408068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.409224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0379bca3-1047-4da4-82bf-86d5805011d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.414298 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c9994b0c-5bdd-442a-b6a7-da039fbcd1fc req-4d9c6157-3a9c-4216-ad02-bbeed2579fa4 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 210 time: 0.3022707 Dec 10 14:25:48.419118 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-072507a0-9e9a-41c5-8880-1b05a1e02d14 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.425733 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.430067 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4922ad8e-b678-4ef3-b8ed-ba7f5f99171c req-a197204d-f75e-498e-adad-d3abd0b9851f tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.39 "DELETE /v2.0/ports/353a2f0c-9bc6-4935-a721-c19b3e0bc0da HTTP/1.1" status: 204 len: 173 time: 3.8900483 Dec 10 14:25:48.444474 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] For port 1a32ff1b-25aa-44f4-9af3-1128013f508d, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=1a32ff1b-25aa-44f4-9af3-1128013f508d,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:48.444887 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.459924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-072507a0-9e9a-41c5-8880-1b05a1e02d14 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.462713 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'name': 'network-vif-deleted', 'tag': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:25:48.465354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa8199f1-1aab-4ac8-869b-336378494ffb" -d '{"events": [{"server_uuid": "4a2c4f5f-1771-428d-b1b5-298cd362bc0e", "name": "network-vif-deleted", "tag": "353a2f0c-9bc6-4935-a721-c19b3e0bc0da"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:25:48.543733 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:14Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'd68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d', 'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'mac_address': 'fa:16:3e:92:7a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:12Z', 'updated_at': '2021-12-10T14:24:22Z', 'revision_number': 5, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'subnets': [{'id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:48.559288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c770c7-7b1e-4349-8b33-6eb068b4cf09 req-7aa18848-d834-4dbc-b164-6010219568a7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:48.567197 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-95c770c7-7b1e-4349-8b33-6eb068b4cf09 req-7aa18848-d834-4dbc-b164-6010219568a7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1815333 Dec 10 14:25:48.570656 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:25:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae602022-ffaf-4c97-84a8-0ce75b66a57f x-openstack-request-id: req-ae602022-ffaf-4c97-84a8-0ce75b66a57f {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:25:48.570959 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a2c4f5f-1771-428d-b1b5-298cd362bc0e", "name": "network-vif-deleted", "tag": "353a2f0c-9bc6-4935-a721-c19b3e0bc0da", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:25:48.572522 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-ae602022-ffaf-4c97-84a8-0ce75b66a57f {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:25:48.572522 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a2c4f5f-1771-428d-b1b5-298cd362bc0e', 'name': 'network-vif-deleted', 'tag': '353a2f0c-9bc6-4935-a721-c19b3e0bc0da', 'status': 'completed', 'code': 200} Dec 10 14:25:48.580334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0379bca3-1047-4da4-82bf-86d5805011d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.589867 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 514dfe42-d394-4cf0-b634-07ada4981db4 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:48.603492 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] Checking router: 67c47c57-09e4-4303-97e1-a2215115ce2a for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:25:48.616932 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:48.617539 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:48.638574 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-95c770c7-7b1e-4349-8b33-6eb068b4cf09 req-12f336b6-4ef7-4fb0-8ef3-6e4f027a7059 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0704391 Dec 10 14:25:48.667679 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:48.671616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.699643 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 391, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:48.710809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.711309 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment 13fbd8d4-2a1e-4eab-a8d6-8e67da050394 of type vlan for network 2e6064ab-419c-4cc1-b3c6-34a9bdf153e1 Dec 10 14:25:48.764744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.817544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 514dfe42-d394-4cf0-b634-07ada4981db4 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:48.817544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.846368 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.846616 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.847011 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Floating IP 287231e3-6f8f-425c-b76d-d645e0eb329e disassociated. External IP: 172.26.2.196, port: 1a32ff1b-25aa-44f4-9af3-1128013f508d. Dec 10 14:25:48.847264 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Calling delete_port for 1a32ff1b-25aa-44f4-9af3-1128013f508d owned by compute:nova {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:48.862881 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:48.891700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-072507a0-9e9a-41c5-8880-1b05a1e02d14 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.892248 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-072507a0-9e9a-41c5-8880-1b05a1e02d14 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Fanout notify agent at l3_agent the message router_deleted on router 50ef5b56-4b09-4b0f-b8fe-09787638b535 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:25:48.915032 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-072507a0-9e9a-41c5-8880-1b05a1e02d14 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.923537 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-072507a0-9e9a-41c5-8880-1b05a1e02d14 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/50ef5b56-4b09-4b0f-b8fe-09787638b535 HTTP/1.1" status: 204 len: 168 time: 1.4266715 Dec 10 14:25:48.931215 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9f081f2c-4219-4d2b-9fc6-8fb38c5de900 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 4.1027651 Dec 10 14:25:48.932629 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53912) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:48.932972 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53914) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:48.937735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.947334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:48.950228 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:48.964349 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-88f84349-9b45-46eb-85ba-a1940ff3d6e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.003551 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-b6aa8613-7f64-48f9-b25f-545e19962934 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Request body: {'router': {'name': 'tempest-TagsExtTest-router-1895937820', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:49.116065 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0379bca3-1047-4da4-82bf-86d5805011d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.119260 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0379bca3-1047-4da4-82bf-86d5805011d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.122455 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0379bca3-1047-4da4-82bf-86d5805011d8 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/465ad9f3-d285-4e84-a92c-5c2197b363c9 HTTP/1.1" status: 204 len: 168 time: 1.6033907 Dec 10 14:25:49.183210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-88f84349-9b45-46eb-85ba-a1940ff3d6e0 None None] For port b3286fb7-5f0c-4501-86c7-119c73fa8509, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b3286fb7-5f0c-4501-86c7-119c73fa8509,segment=NetworkSegment(5e06ec80-9ff0-4191-8d7d-ada7e7078368),segment_id=5e06ec80-9ff0-4191-8d7d-ada7e7078368)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:49.197669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.223475 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.232367 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0379bca3-1047-4da4-82bf-86d5805011d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=465ad9f3-d285-4e84-a92c-5c2197b363c9,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:49.239846 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e617b112-f48c-411d-b720-fb4abf9177fa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=50ef5b56-4b09-4b0f-b8fe-09787638b535 HTTP/1.1" status: 200 len: 205 time: 0.3049645 Dec 10 14:25:49.247068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53922) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:49.262195 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-88f84349-9b45-46eb-85ba-a1940ff3d6e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.283998 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Pushing event deleted for resources: {'Port': ['ID=1a32ff1b-25aa-44f4-9af3-1128013f508d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:49.283998 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.353669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:49.362248 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:49.369231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:49.392456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=2e6064ab-419c-4cc1-b3c6-34a9bdf153e1,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:49.403195 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-0c02b470-3d81-4c43-a832-b21526c287ba tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] delete failed (client error): The resource could not be found. Dec 10 14:25:49.404230 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0c02b470-3d81-4c43-a832-b21526c287ba tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/50ef5b56-4b09-4b0f-b8fe-09787638b535 HTTP/1.1" status: 404 len: 336 time: 0.1564372 Dec 10 14:25:49.418066 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1db4bfe4-8539-4a28-9ada-3203a155f85d tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.3768163 Dec 10 14:25:49.434933 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:14Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'd68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d', 'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'mac_address': 'fa:16:3e:92:7a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:12Z', 'updated_at': '2021-12-10T14:24:22Z', 'revision_number': 5, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'subnets': [{'id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:49.436102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41c7b085-c9f7-4300-ba97-bd26ac7b7376 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:49.462733 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53924) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:49.462733 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53926) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:49.477895 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89348377-bd2c-4224-aca4-e18da2cd9327 None None] The sync data for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv is: [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:14Z', 'revision_number': 4, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'd68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d', 'name': '', 'network_id': '90ab95ca-b6c7-4d4c-8815-86eb5dad26d0', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'mac_address': 'fa:16:3e:92:7a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:12Z', 'updated_at': '2021-12-10T14:24:22Z', 'revision_number': 5, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'subnets': [{'id': 'f95bfcc0-b514-425e-a401-25563b482fae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:49.478637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': '2e6064ab-419c-4cc1-b3c6-34a9bdf153e1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:49.516770 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 2e6064ab-419c-4cc1-b3c6-34a9bdf153e1 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:49.591075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=e8996883-538c-4dc5-867d-b29c37005f9c,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:49.596980 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f9b82174-12c2-4195-ae21-91f9320f519b tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=ee140fc3-bca4-46fe-bf3a-093c3952ba52 HTTP/1.1" status: 200 len: 205 time: 0.1340637 Dec 10 14:25:49.607293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53930) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:49.646424 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-bb877a9d-cdc6-488e-9ae6-f530ce530b6e None None] Provisioning complete for port b3286fb7-5f0c-4501-86c7-119c73fa8509 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:49.647072 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bb877a9d-cdc6-488e-9ae6-f530ce530b6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.655344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 514dfe42-d394-4cf0-b634-07ada4981db4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=514dfe42-d394-4cf0-b634-07ada4981db4,segment=NetworkSegment(92dede0e-5309-4094-90c3-53a0a9b80ce1),segment_id=92dede0e-5309-4094-90c3-53a0a9b80ce1)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:49.676523 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b2897349-a654-4e33-9cc9-0091aeb623f3 req-103841fe-2bc3-47c3-a755-429304ed0164 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 210 time: 0.2920392 Dec 10 14:25:49.759515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.762507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b3286fb7-5f0c-4501-86c7-119c73fa8509 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:49.813187 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9f3fa27d-cc73-4ad6-a1c2-e805791c3397 req-fef7a868-629c-4aaa-989b-c42d0b7c88b3 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/ports?device_id=4a2c4f5f-1771-428d-b1b5-298cd362bc0e HTTP/1.1" status: 200 len: 210 time: 0.1437292 Dec 10 14:25:49.842545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88f84349-9b45-46eb-85ba-a1940ff3d6e0 None None] Pushing event updated for resources: {'Port': ['ID=b3286fb7-5f0c-4501-86c7-119c73fa8509,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:49.851227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b6aa8613-7f64-48f9-b25f-545e19962934 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.852304 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b6aa8613-7f64-48f9-b25f-545e19962934 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:49.861671 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-9acdb75b-6e02-4f63-b067-4e580cff875a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] delete failed (client error): The resource could not be found. Dec 10 14:25:49.864588 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9acdb75b-6e02-4f63-b067-4e580cff875a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/ee140fc3-bca4-46fe-bf3a-093c3952ba52 HTTP/1.1" status: 404 len: 336 time: 0.2416341 Dec 10 14:25:49.876169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:49.877657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53936) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:49.907937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=514dfe42-d394-4cf0-b634-07ada4981db4,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:49.928482 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e9d8650d-be53-4d1a-a4b5-19d99972018a tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=d4cf29e3-727f-46f3-aee1-35bb59b2268c HTTP/1.1" status: 200 len: 205 time: 0.0485086 Dec 10 14:25:49.936521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53938) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:49.937766 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b3286fb7-5f0c-4501-86c7-119c73fa8509 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:49.938146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.046981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29cfd18a-6285-44ba-826f-c39778921781 req-3f74b84b-3a06-491f-b006-ea3f13745d44 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:50.048581 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-29cfd18a-6285-44ba-826f-c39778921781 req-3f74b84b-3a06-491f-b006-ea3f13745d44 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2483535 Dec 10 14:25:50.066513 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-bb877a9d-cdc6-488e-9ae6-f530ce530b6e None None] Provisioning complete for port fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:50.067102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bb877a9d-cdc6-488e-9ae6-f530ce530b6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.107803 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-45b73f4e-9f52-4167-baff-04923f89f895 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] delete failed (client error): The resource could not be found. Dec 10 14:25:50.108059 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b6aa8613-7f64-48f9-b25f-545e19962934 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.108867 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-45b73f4e-9f52-4167-baff-04923f89f895 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/d4cf29e3-727f-46f3-aee1-35bb59b2268c HTTP/1.1" status: 404 len: 336 time: 0.1752329 Dec 10 14:25:50.115835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53944) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:50.135500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-bb877a9d-cdc6-488e-9ae6-f530ce530b6e None None] Port fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:50.143623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23d24a05-103b-426e-a9fb-d85ae524fa64 None None] New status for floating IP 5f7a1c28-5e2b-40f5-bfbe-2878d2b822fe: DOWN {{(pid=103812) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:25:50.205684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.262188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-bb877a9d-cdc6-488e-9ae6-f530ce530b6e None None] Provisioning complete for port 514dfe42-d394-4cf0-b634-07ada4981db4 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:50.263278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bb877a9d-cdc6-488e-9ae6-f530ce530b6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.518312 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b6aa8613-7f64-48f9-b25f-545e19962934 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.544358 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b0e6e57b-4713-4e78-9218-8774121c476d tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=9c159cd1-1a8d-43e9-a827-a6ec0c3324bf HTTP/1.1" status: 200 len: 205 time: 0.4237695 Dec 10 14:25:50.549867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53952) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:50.562948 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 514dfe42-d394-4cf0-b634-07ada4981db4 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:50.602471 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-6e5365ae-2ea5-4192-b5bb-a5dc18c4abcd tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] delete failed (client error): The resource could not be found. Dec 10 14:25:50.606464 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6e5365ae-2ea5-4192-b5bb-a5dc18c4abcd tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/9c159cd1-1a8d-43e9-a827-a6ec0c3324bf HTTP/1.1" status: 404 len: 336 time: 0.0521045 Dec 10 14:25:50.608894 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53956) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:50.628651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:50.632554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.653189 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-18f91c16-8b80-4084-81a0-78f07dcc9fbe None None] Provisioning complete for port e8996883-538c-4dc5-867d-b29c37005f9c triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:50.657611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-18f91c16-8b80-4084-81a0-78f07dcc9fbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.661006 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-29cfd18a-6285-44ba-826f-c39778921781 req-37af9d31-046e-432c-8e43-7d89bef2c181 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5953517 Dec 10 14:25:50.685980 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ba0fddf5-54e4-4bfc-8093-4f1289f0e3cb tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=69343414-ca56-465a-9086-08c0e2e77d71 HTTP/1.1" status: 200 len: 205 time: 0.0675590 Dec 10 14:25:50.685980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53960) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:50.700925 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 514dfe42-d394-4cf0-b634-07ada4981db4 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:50.701395 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.755659 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:50.773398 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] Sync routers for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:50.774013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-18f91c16-8b80-4084-81a0-78f07dcc9fbe None None] Port e8996883-538c-4dc5-867d-b29c37005f9c cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:50.792393 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:50.793042 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:50.797147 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-18f91c16-8b80-4084-81a0-78f07dcc9fbe None None] Provisioning complete for port fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:50.797709 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-18f91c16-8b80-4084-81a0-78f07dcc9fbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.909352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b6aa8613-7f64-48f9-b25f-545e19962934 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:50.914552 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b6aa8613-7f64-48f9-b25f-545e19962934 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 1.9746578 Dec 10 14:25:50.926632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53970) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:50.928419 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-f5790d38-d582-44e9-a953-a8058909b9aa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] delete failed (client error): The resource could not be found. Dec 10 14:25:50.929449 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f5790d38-d582-44e9-a953-a8058909b9aa tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/69343414-ca56-465a-9086-08c0e2e77d71 HTTP/1.1" status: 404 len: 336 time: 0.2426181 Dec 10 14:25:50.948585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-275f4b95-b8e6-4425-a990-36ca40d4164a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Request body: {'subnetpool': {'name': 'tempest-TagsExtTest-Subnetpool-1018874851', 'prefixes': ['172.20.0.0/16']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:50.955164 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53972) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:50.972545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b3286fb7-5f0c-4501-86c7-119c73fa8509 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:25:50.988561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-18f91c16-8b80-4084-81a0-78f07dcc9fbe None None] Port fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:51.031755 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-57dda98f-913d-474a-b16f-c122b3c3e9dc req-ae36d372-42d9-4297-bf91-ea1e7322acc0 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 210 time: 0.1368876 Dec 10 14:25:51.066098 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:51.069450 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53974) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:51.080093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee21706f-6fca-4652-8002-2110cab4d35e None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:25:51.091931 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ec6a622e-d8c7-4c90-8ba6-10766f2dba3f tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "GET /v2.0/ports?device_id=e99cb024-b988-493b-b48c-026fe50ece49 HTTP/1.1" status: 200 len: 205 time: 0.1312196 Dec 10 14:25:51.092578 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53976) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:51.113105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] No DVR routers for this DVR port 1a32ff1b-25aa-44f4-9af3-1128013f508d on host hv-neutron-8214 {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:51.116118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.120559 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4e4fb525-79d7-4d79-8820-183ff6b36db4 req-a7a41b6b-f62a-443a-8aa2-c1f82781aff8 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.39 "DELETE /v2.0/ports/1a32ff1b-25aa-44f4-9af3-1128013f508d HTTP/1.1" status: 204 len: 173 time: 3.6077595 Dec 10 14:25:51.123324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'name': 'network-vif-deleted', 'tag': '1a32ff1b-25aa-44f4-9af3-1128013f508d'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:25:51.126797 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-90b70dd0-b427-4749-a445-dabb135290a1" -d '{"events": [{"server_uuid": "0eac01e5-2ef7-425a-8991-9164b917a3b5", "name": "network-vif-deleted", "tag": "1a32ff1b-25aa-44f4-9af3-1128013f508d"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:25:51.130379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.204561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:25:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7557d30b-6afc-41eb-93cd-c3b98a762c77 x-openstack-request-id: req-7557d30b-6afc-41eb-93cd-c3b98a762c77 {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:25:51.205272 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0eac01e5-2ef7-425a-8991-9164b917a3b5", "name": "network-vif-deleted", "tag": "1a32ff1b-25aa-44f4-9af3-1128013f508d", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:25:51.205783 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-7557d30b-6afc-41eb-93cd-c3b98a762c77 {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:25:51.206509 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0eac01e5-2ef7-425a-8991-9164b917a3b5', 'name': 'network-vif-deleted', 'tag': '1a32ff1b-25aa-44f4-9af3-1128013f508d', 'status': 'completed', 'code': 200} Dec 10 14:25:51.221909 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-ff461fe5-0f4f-4648-bba0-5a126cab0326 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] delete failed (client error): The resource could not be found. Dec 10 14:25:51.225958 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ff461fe5-0f4f-4648-bba0-5a126cab0326 tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/routers/e99cb024-b988-493b-b48c-026fe50ece49 HTTP/1.1" status: 404 len: 336 time: 0.1169322 Dec 10 14:25:51.225958 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53982) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:51.256454 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee21706f-6fca-4652-8002-2110cab4d35e None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:25:51.287282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7812ab8e-811f-4941-b007-2b45dae5625e tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.290426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b3286fb7-5f0c-4501-86c7-119c73fa8509 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:51.290426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.304457 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-3466f93c-1489-4fdb-bc95-239bdd8a25cf tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] DELETE failed (client error): The resource could not be found. Dec 10 14:25:51.305189 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3466f93c-1489-4fdb-bc95-239bdd8a25cf tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:25:51.309104 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3466f93c-1489-4fdb-bc95-239bdd8a25cf tempest-RoutersAdminTest-1679928388 tempest-RoutersAdminTest-1679928388-project] 10.222.0.57 "DELETE /v2.0/subnets/c533932d-616a-4e39-bbc4-1c22f04bd3bf HTTP/1.1" status: 404 len: 337 time: 0.0814700 Dec 10 14:25:51.319145 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7812ab8e-811f-4941-b007-2b45dae5625e tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.457238 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7812ab8e-811f-4941-b007-2b45dae5625e tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.464862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7812ab8e-811f-4941-b007-2b45dae5625e tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.470415 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7812ab8e-811f-4941-b007-2b45dae5625e tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "DELETE /v2.0/security-groups/f3a20060-d794-4212-9975-ddb1ce5af055 HTTP/1.1" status: 204 len: 168 time: 0.3623421 Dec 10 14:25:51.474682 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 53988) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:51.495884 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7812ab8e-811f-4941-b007-2b45dae5625e tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3a20060-d794-4212-9975-ddb1ce5af055,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:51.504288 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-fc6b7aa3-4219-4134-ae23-c7f84d0c2a24 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] show failed (client error): The resource could not be found. Dec 10 14:25:51.508041 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a0de3123-62f5-41a9-921c-6e2250a89def', 'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'mac_address': 'fa:16:3e:e1:ab:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_interface', 'standard_attr_id': 125, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:24Z', 'revision_number': 5, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'subnets': [{'id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:51.508815 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53990) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:51.526413 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fc6b7aa3-4219-4134-ae23-c7f84d0c2a24 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "GET /v2.0/security-groups/f3a20060-d794-4212-9975-ddb1ce5af055 HTTP/1.1" status: 404 len: 347 time: 0.0450428 Dec 10 14:25:51.562874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router a9d6ff8f-6f21-4d81-bd51-c184c2a50541 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:25:51.592489 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] Checking router: 6b7d9a03-a75e-4f11-8074-0360686c8ab9 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:25:51.604982 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:51.605689 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:51.622600 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.688591 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-275f4b95-b8e6-4425-a990-36ca40d4164a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for subnetpool, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.690111 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-275f4b95-b8e6-4425-a990-36ca40d4164a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 748 time: 0.7558618 Dec 10 14:25:51.692317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=e50fdcba-8d26-4f3c-ab15-d9579a0c9ea0,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:51.694350 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 53994) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:51.708827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-6142af4d-ccdd-43be-b8b8-d0ea05f653f0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545', 'tempest-TagsExtTest-Tag-1896956754') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:51.769945 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:51.795323 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:51.805795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e98728f7-7a3e-4f8d-872e-bed994b57678 None None] Sync routers for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:51.829661 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e98728f7-7a3e-4f8d-872e-bed994b57678 None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:51.830312 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e98728f7-7a3e-4f8d-872e-bed994b57678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:51.885990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e98728f7-7a3e-4f8d-872e-bed994b57678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:51.907368 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e98728f7-7a3e-4f8d-872e-bed994b57678 None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:51.908227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e98728f7-7a3e-4f8d-872e-bed994b57678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:51.920634 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:51.923330 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b79be56d-5435-477c-98ae-d4846a675676 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 6.5140853 Dec 10 14:25:51.926415 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54000) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:51.967974 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 1a32ff1b-25aa-44f4-9af3-1128013f508d no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:25:51.967974 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e98728f7-7a3e-4f8d-872e-bed994b57678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:51.968639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e98728f7-7a3e-4f8d-872e-bed994b57678 None None] The sync data for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:51.988964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': '13fbd8d4-2a1e-4eab-a8d6-8e67da050394', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '2e6064ab-419c-4cc1-b3c6-34a9bdf153e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:51.992337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: 2e6064ab-419c-4cc1-b3c6-34a9bdf153e1, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:51.999371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: 1a32ff1b-25aa-44f4-9af3-1128013f508d {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:25:51.999722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 1a32ff1b-25aa-44f4-9af3-1128013f508d not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:25:52.032192 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c1cbc3-a184-4040-af00-4d854c73a9e3 req-5cc05091-bfa5-40f9-a0f9-f632a2899cbc tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:52.037330 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-03c1cbc3-a184-4040-af00-4d854c73a9e3 req-5cc05091-bfa5-40f9-a0f9-f632a2899cbc tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1975253 Dec 10 14:25:52.146366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Deleting port b49a1f0f-6a2c-4141-8c6d-206654b5efc9 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:52.147820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:52.175800 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54008) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:52.224064 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7a265aff-1129-43c5-938b-4e2517af7808 req-f1c03497-d493-441a-acfc-55a66c910a18 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/ports?device_id=0eac01e5-2ef7-425a-8991-9164b917a3b5 HTTP/1.1" status: 200 len: 210 time: 0.0820444 Dec 10 14:25:52.230241 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a0de3123-62f5-41a9-921c-6e2250a89def', 'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'mac_address': 'fa:16:3e:e1:ab:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_interface', 'standard_attr_id': 125, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:24Z', 'revision_number': 5, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'subnets': [{'id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:52.264270 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 2e6064ab-419c-4cc1-b3c6-34a9bdf153e1 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:52.282545 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6be803c-a9fe-45b7-b111-8e598a0449ff None None] The sync data for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv is: [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:24:17Z', 'revision_number': 4, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a0de3123-62f5-41a9-921c-6e2250a89def', 'name': '', 'network_id': '8a88c7d6-baa3-4bff-a8db-78e7aa6fb066', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'mac_address': 'fa:16:3e:e1:ab:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_interface', 'standard_attr_id': 125, 'fixed_ips': [{'subnet_id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:15Z', 'updated_at': '2021-12-10T14:24:24Z', 'revision_number': 5, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'subnets': [{'id': 'f3e2204d-7027-4309-a5db-3d266a3ff37e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:52.336379 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-03c1cbc3-a184-4040-af00-4d854c73a9e3 req-7f24621d-741a-4eec-9176-8cfaffad2e30 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2545097 Dec 10 14:25:52.366667 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6142af4d-ccdd-43be-b8b8-d0ea05f653f0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags/tempest-TagsExtTest-Tag-1896956754 HTTP/1.1" status: 201 len: 201 time: 0.6629412 Dec 10 14:25:52.366667 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:52.366667 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:52.371180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54016) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:52.379744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-b9e05bfb-2c67-421a-9ebd-cb93022e72de tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2', 'tempest-TagsExtTest-Tag-491237549') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:52.412315 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Calling delete_port for b49a1f0f-6a2c-4141-8c6d-206654b5efc9 owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:52.420075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 2e6064ab-419c-4cc1-b3c6-34a9bdf153e1) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:52.430993 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e1b8db7-1068-44bd-84aa-11038fe03200 None None] Network 2e6064ab-419c-4cc1-b3c6-34a9bdf153e1 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:52.439621 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:52.439621 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:52.477489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54018) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:52.620057 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7bb1acb4-dc68-4ab4-a37b-8b91cd4a54a2 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.1508741 Dec 10 14:25:52.620858 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54022) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:52.661358 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b9e05bfb-2c67-421a-9ebd-cb93022e72de tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags/tempest-TagsExtTest-Tag-491237549 HTTP/1.1" status: 201 len: 201 time: 0.2904994 Dec 10 14:25:52.664502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54024) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:52.675004 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-5e59c6a8-2ef6-47b0-bf2a-478e1ba919ef tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc', 'tempest-TagsExtTest-Tag-91424850') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:52.751337 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d631b1d-6c4c-45b8-9a52-044493864c4a None None] New status for floating IP 287231e3-6f8f-425c-b76d-d645e0eb329e: DOWN {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:25:52.762639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:52.776105 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-2e6064ab-419c-4cc1-b3c6-34a9bdf153e1', 'network_id': '2e6064ab-419c-4cc1-b3c6-34a9bdf153e1', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': 'e50fdcba-8d26-4f3c-ab15-d9579a0c9ea0'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:52.777106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:52.779393 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1a8c1a3-7d30-4d98-9142-872e5de3574d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:52.796861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Pushing event deleted for resources: {'Port': ['ID=b49a1f0f-6a2c-4141-8c6d-206654b5efc9,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:52.826176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-939d1a85-0b29-48b7-a677-46f47cb20e23 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:52.829885 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-test-network-1163366500'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:52.871031 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:52.875091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:52.876495 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-28d12bef-5a22-4d50-9ef4-1cbdd9b17f78 tempest-ServersTestJSON-1619300083 tempest-ServersTestJSON-1619300083-project] 10.222.0.57 "DELETE /v2.0/floatingips/5f7a1c28-5e2b-40f5-bfbe-2878d2b822fe HTTP/1.1" status: 204 len: 168 time: 1.3664527 Dec 10 14:25:52.879630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54026) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:52.901552 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5e59c6a8-2ef6-47b0-bf2a-478e1ba919ef tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags/tempest-TagsExtTest-Tag-91424850 HTTP/1.1" status: 201 len: 201 time: 0.2352037 Dec 10 14:25:52.912209 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54028) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:52.919326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-21b1fc14-67a4-44cb-912a-6996cddf83a3 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59', 'tempest-TagsExtTest-Tag-1259735777') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:52.933357 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.014431 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Made reservation on behalf of bd535c3c1ede4dabbd4be542a3f2fbe1 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:53.017880 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.020874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.025715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Allocated IP 172.20.0.2 (2e6064ab-419c-4cc1-b3c6-34a9bdf153e1/e50fdcba-8d26-4f3c-ab15-d9579a0c9ea0/30816dae-9604-4052-a42a-da48d7e59fdb) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:53.057838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.145521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.217885 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.253387 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-21b1fc14-67a4-44cb-912a-6996cddf83a3 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags/tempest-TagsExtTest-Tag-1259735777 HTTP/1.1" status: 201 len: 201 time: 0.3382688 Dec 10 14:25:53.262012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54032) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:53.274633 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-1fe9078a-60be-498e-8879-ff89e706e6b1 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:53.292494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1a8c1a3-7d30-4d98-9142-872e5de3574d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.326668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.375146 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.381831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Network 2e6064ab-419c-4cc1-b3c6-34a9bdf153e1 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:53.384597 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:53.393325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:53.397282 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Pushing event updated for resources: {'Port': ['ID=30816dae-9604-4052-a42a-da48d7e59fdb,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:53.441056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1a8c1a3-7d30-4d98-9142-872e5de3574d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.441238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54038) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:53.458708 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1fe9078a-60be-498e-8879-ff89e706e6b1 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags HTTP/1.1" status: 200 len: 241 time: 0.1924529 Dec 10 14:25:53.460572 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.467991 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54040) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:53.472330 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Attempting to bind port 30816dae-9604-4052-a42a-da48d7e59fdb on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:53.477264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Attempting to bind port 30816dae-9604-4052-a42a-da48d7e59fdb by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '13fbd8d4-2a1e-4eab-a8d6-8e67da050394', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '2e6064ab-419c-4cc1-b3c6-34a9bdf153e1'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:53.477264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Attempting to bind port 30816dae-9604-4052-a42a-da48d7e59fdb on network 2e6064ab-419c-4cc1-b3c6-34a9bdf153e1 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:53.478997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:53.479386 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Checking segment: {'id': '13fbd8d4-2a1e-4eab-a8d6-8e67da050394', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '2e6064ab-419c-4cc1-b3c6-34a9bdf153e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:53.479795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.480192 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Bound using segment: {'id': '13fbd8d4-2a1e-4eab-a8d6-8e67da050394', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '2e6064ab-419c-4cc1-b3c6-34a9bdf153e1'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:53.481025 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Bound port: 30816dae-9604-4052-a42a-da48d7e59fdb, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '13fbd8d4-2a1e-4eab-a8d6-8e67da050394', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '2e6064ab-419c-4cc1-b3c6-34a9bdf153e1'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:53.481162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.488189 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-7dd9532a-0500-4a87-a64d-5aa86c653869 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545', 'tempest-TagsExtTest-Tag-1896956754') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:53.497948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.550430 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] For port 30816dae-9604-4052-a42a-da48d7e59fdb, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:53.553536 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] For port 30816dae-9604-4052-a42a-da48d7e59fdb, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=30816dae-9604-4052-a42a-da48d7e59fdb,segment=NetworkSegment(13fbd8d4-2a1e-4eab-a8d6-8e67da050394),segment_id=13fbd8d4-2a1e-4eab-a8d6-8e67da050394)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:53.572493 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a1a8c1a3-7d30-4d98-9142-872e5de3574d admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=4224626702f749608daa02edd9f2e1e1&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3949187 Dec 10 14:25:53.581185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54042) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:53.583460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.592032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=e50fdcba-8d26-4f3c-ab15-d9579a0c9ea0,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:53.606898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f41b717f-466b-46bd-a114-ecf992d8b96d req-1e2b5caa-a581-43a4-a142-cc5440ea4c3d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:53.608482 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f41b717f-466b-46bd-a114-ecf992d8b96d req-1e2b5caa-a581-43a4-a142-cc5440ea4c3d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1520190 Dec 10 14:25:53.613539 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a8c1a3-7d30-4d98-9142-872e5de3574d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39c90a47-280e-47ad-959f-669b52045af1,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:53.626914 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.634712 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-76d87d2f-c12d-4eef-8f95-6799f2f9ae78 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.676553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] vlan segment allocate from pool success with {'vlan_id': 350, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:53.711485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-722ac317-8055-4506-9ac4-03aa7e4b3c1d None None] Pushing event updated for resources: {'Port': ['ID=30816dae-9604-4052-a42a-da48d7e59fdb,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:53.739170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-76d87d2f-c12d-4eef-8f95-6799f2f9ae78 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.742460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=afabf5cf-66b3-4c78-8bc8-373c5880c23e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:53.742988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4009ec6-d1e2-457c-9e27-78954215fc66 None None] Network 2e6064ab-419c-4cc1-b3c6-34a9bdf153e1 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:53.746813 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.747055 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Added segment 01ac3344-f7ee-4634-9c6b-21ab9c23b8d4 of type vlan for network 5c0f5153-b96e-46db-aaab-a604f5138cfd Dec 10 14:25:53.766718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.773084 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.20.0.1 (9c3829d2-ad8b-4c9e-8fca-cff12849a398/f812692c-cac5-411a-b257-d33ebcf6a597/bc425151-c37a-4f55-b82a-4767b22938c1) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:53.796152 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-91e6ea17-48bf-427c-a85c-ba2431d40a63 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.812863 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f41b717f-466b-46bd-a114-ecf992d8b96d req-92787da9-6c93-4fe6-9078-943f4138568e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1913154 Dec 10 14:25:53.844387 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-91e6ea17-48bf-427c-a85c-ba2431d40a63 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.855743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2e6064ab-419c-4cc1-b3c6-34a9bdf153e1']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:53.855743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.888669 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfd6f9dc-faa9-414f-a508-46d40d306af1 None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:25:53.924305 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '13fbd8d4-2a1e-4eab-a8d6-8e67da050394') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:53.924707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '13fbd8d4-2a1e-4eab-a8d6-8e67da050394') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:53.940650 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7dd9532a-0500-4a87-a64d-5aa86c653869 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags/tempest-TagsExtTest-Tag-1896956754 HTTP/1.1" status: 204 len: 168 time: 0.4711988 Dec 10 14:25:53.942798 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.944311 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54046) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:53.948830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-e00e312e-97f9-4394-a455-fab20397adbf tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545', 'tempest-TagsExtTest-Tag-1896956754') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:53.975920 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.991956 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 391 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:53.992362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:53.995372 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:54.010861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfd6f9dc-faa9-414f-a508-46d40d306af1 None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:25:54.027605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-76d87d2f-c12d-4eef-8f95-6799f2f9ae78 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.030185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-76d87d2f-c12d-4eef-8f95-6799f2f9ae78 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.041057 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-76d87d2f-c12d-4eef-8f95-6799f2f9ae78 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "DELETE /v2.0/security-groups/59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5 HTTP/1.1" status: 204 len: 168 time: 0.5838673 Dec 10 14:25:54.041057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Deleting port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:54.041057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.041057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54048) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:54.075352 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.096893 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76d87d2f-c12d-4eef-8f95-6799f2f9ae78 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:54.103225 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-f9f5e952-0643-4940-acfc-503872ff0049 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] show failed (client error): The resource could not be found. Dec 10 14:25:54.104869 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f9f5e952-0643-4940-acfc-503872ff0049 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "GET /v2.0/security-groups/59bdb1a5-c5d8-43bc-bad3-4c48fc1dacd5 HTTP/1.1" status: 404 len: 347 time: 0.0646963 Dec 10 14:25:54.107816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54050) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:54.112071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-91e6ea17-48bf-427c-a85c-ba2431d40a63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.114651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-91e6ea17-48bf-427c-a85c-ba2431d40a63 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.118550 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-91e6ea17-48bf-427c-a85c-ba2431d40a63 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/39c90a47-280e-47ad-959f-669b52045af1 HTTP/1.1" status: 204 len: 168 time: 0.5322483 Dec 10 14:25:54.137696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e6ea17-48bf-427c-a85c-ba2431d40a63 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39c90a47-280e-47ad-959f-669b52045af1,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:54.171315 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] For port d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:54.171950 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.187043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Calling delete_port for d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:54.187469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:25:54.187469 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:25:54.187469 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': '2e6064ab-419c-4cc1-b3c6-34a9bdf153e1'}] Dec 10 14:25:54.187469 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:25:54.187864 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:25:54.188405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.211645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:54.212426 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.275314 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e00e312e-97f9-4394-a455-fab20397adbf tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags/tempest-TagsExtTest-Tag-1896956754 HTTP/1.1" status: 204 len: 168 time: 0.3299825 Dec 10 14:25:54.290831 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54056) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:54.300566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-e12df093-1ae0-4c61-833e-0e7e36eb7763 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:54.324331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.397998 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 799 time: 1.9194262 Dec 10 14:25:54.401520 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f394c7a2-6e44-4966-8a7b-21e9b925b45d req-d38fc5d8-959c-4ff6-965d-31889645d6b0 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:54.403119 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f394c7a2-6e44-4966-8a7b-21e9b925b45d req-d38fc5d8-959c-4ff6-965d-31889645d6b0 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1484225 Dec 10 14:25:54.445321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:54.455670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:54.471772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:54.503324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7e4e2de-1a1f-49fa-9970-be114db7a879 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Pushing event updated for resources: {'Network': ['ID=5c0f5153-b96e-46db-aaab-a604f5138cfd,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:54.517908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 5c0f5153-b96e-46db-aaab-a604f5138cfd details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:54.628810 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f394c7a2-6e44-4966-8a7b-21e9b925b45d req-0230925c-c4e7-4aef-813d-00a74e309f37 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2109907 Dec 10 14:25:54.639866 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e12df093-1ae0-4c61-833e-0e7e36eb7763 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags HTTP/1.1" status: 200 len: 205 time: 0.3429325 Dec 10 14:25:54.647418 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54064) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:54.648044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=bc425151-c37a-4f55-b82a-4767b22938c1,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:54.655795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Deleting port 89bb69a3-59a1-4bb9-a0ba-5d64500adf8f {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:54.656138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.674627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-7a9e4a95-9d11-4104-9417-593aa30842d9 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:54.688963 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892233e8-6da2-4124-bdc9-696b205051d6 req-12698913-1608-4272-909a-a18a64d1e820 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:54.691149 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-892233e8-6da2-4124-bdc9-696b205051d6 req-12698913-1608-4272-909a-a18a64d1e820 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1098 time: 0.2442508 Dec 10 14:25:54.694401 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.706561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.728885 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.773874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b7b0fdef-b7b4-439e-ac66-8d394625d37f None None] Provisioning complete for port bc425151-c37a-4f55-b82a-4767b22938c1 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:54.774266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b7b0fdef-b7b4-439e-ac66-8d394625d37f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.819938 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Pushing event deleted for resources: {'Port': ['ID=d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:54.825962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54066) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:54.830991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Request body: {'port': {'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd', 'binding:host_id': 'hv-neutron-8214', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1638008109'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:54.851515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b7b0fdef-b7b4-439e-ac66-8d394625d37f None None] Port bc425151-c37a-4f55-b82a-4767b22938c1 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:54.975990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:54.976445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.016099 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Calling delete_port for 89bb69a3-59a1-4bb9-a0ba-5d64500adf8f owned by network:floatingip {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:55.035467 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892233e8-6da2-4124-bdc9-696b205051d6 req-79d3c213-73e1-4ad3-a428-cac8d6c42bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:55.036906 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-892233e8-6da2-4124-bdc9-696b205051d6 req-79d3c213-73e1-4ad3-a428-cac8d6c42bf1 service neutron] 10.222.0.39 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 912 time: 0.3054116 Dec 10 14:25:55.136642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54068) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:55.212184 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7a9e4a95-9d11-4104-9417-593aa30842d9 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags HTTP/1.1" status: 200 len: 240 time: 0.5696244 Dec 10 14:25:55.217950 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54070) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:55.263615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-9000a1d3-4d49-4954-9a82-391a1b83125b tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2', 'tempest-TagsExtTest-Tag-491237549') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:55.294273 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1f73f6c5-a2fb-4c42-82b5-72c222995d22 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=605cf5d3d75a473d8c1129a632d22119&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1552205 Dec 10 14:25:55.298206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Made reservation on behalf of ea35a951bf5c4706970400d2939b7ccc for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:55.300547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.302399 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54072) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:55.333861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.466734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.471121 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9000a1d3-4d49-4954-9a82-391a1b83125b tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags/tempest-TagsExtTest-Tag-491237549 HTTP/1.1" status: 204 len: 168 time: 0.2474370 Dec 10 14:25:55.471121 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aa07053d-3bae-4350-b5e4-af982045e4a9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.473612 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port 30816dae-9604-4052-a42a-da48d7e59fdb {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:55.473960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.474412 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54074) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:55.482942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-df3871f1-2939-4117-a87b-c24cab155915 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2', 'tempest-TagsExtTest-Tag-491237549') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:55.542015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.582666 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aa07053d-3bae-4350-b5e4-af982045e4a9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.583780 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-892233e8-6da2-4124-bdc9-696b205051d6 req-1c120eaa-b7db-4440-902d-0ca3a8f43e67 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 1000 time: 0.5399625 Dec 10 14:25:55.586566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port 30816dae-9604-4052-a42a-da48d7e59fdb, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=30816dae-9604-4052-a42a-da48d7e59fdb,segment=NetworkSegment(13fbd8d4-2a1e-4eab-a8d6-8e67da050394),segment_id=13fbd8d4-2a1e-4eab-a8d6-8e67da050394)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:55.586930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.653497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for 30816dae-9604-4052-a42a-da48d7e59fdb owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:55.691407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.766866 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892233e8-6da2-4124-bdc9-696b205051d6 req-66435499-afa7-4b32-8a5d-f1de2fbb2d47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:55.768248 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-892233e8-6da2-4124-bdc9-696b205051d6 req-66435499-afa7-4b32-8a5d-f1de2fbb2d47 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 200 len: 850 time: 0.1769550 Dec 10 14:25:55.789643 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.801019 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] device_id is not set on port 118783be-b64b-400a-959d-5e8752a0ed69 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:25:55.892085 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aa07053d-3bae-4350-b5e4-af982045e4a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.894808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aa07053d-3bae-4350-b5e4-af982045e4a9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:55.898238 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-aa07053d-3bae-4350-b5e4-af982045e4a9 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/96cb080d-670d-4cb5-8b6f-9ad992d588fe HTTP/1.1" status: 204 len: 168 time: 0.5860879 Dec 10 14:25:55.923405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892233e8-6da2-4124-bdc9-696b205051d6 req-a470207d-464d-4766-ac83-0c8e4eca9a83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:55.924906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f29ef7-be5f-4df4-80e1-220597a5d86d req-2b4d79bb-9f95-4d87-9c76-32dc631c03ec tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:55.925047 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-892233e8-6da2-4124-bdc9-696b205051d6 req-a470207d-464d-4766-ac83-0c8e4eca9a83 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=1cc2d855-81bd-4d95-a565-455c7130be80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1470706 Dec 10 14:25:55.926488 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-59f29ef7-be5f-4df4-80e1-220597a5d86d req-2b4d79bb-9f95-4d87-9c76-32dc631c03ec tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2100050 Dec 10 14:25:55.959757 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-df3871f1-2939-4117-a87b-c24cab155915 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags/tempest-TagsExtTest-Tag-491237549 HTTP/1.1" status: 204 len: 168 time: 0.4769187 Dec 10 14:25:55.961921 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54080) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:55.966014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5fbbbe1f-3b56-4d06-b507-70d07a6a45b9,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:55.996107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-ec92a4e7-13a6-48a3-8c2e-c2c0c4a030ca tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:56.010886 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa07053d-3bae-4350-b5e4-af982045e4a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96cb080d-670d-4cb5-8b6f-9ad992d588fe,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:56.029146 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.031115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.061175 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Router 67c47c57-09e4-4303-97e1-a2215115ce2a has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:56.093771 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-59f29ef7-be5f-4df4-80e1-220597a5d86d req-7d1d4559-3c53-409e-b556-d625eb79036a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1354403 Dec 10 14:25:56.105217 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Pushing event deleted for resources: {'Port': ['ID=89bb69a3-59a1-4bb9-a0ba-5d64500adf8f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:56.127298 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1256fb0-4ef5-46a5-a291-ed6da2ea848e None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:56.194961 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=30816dae-9604-4052-a42a-da48d7e59fdb,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:56.231580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port 30816dae-9604-4052-a42a-da48d7e59fdb on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:25:56.271462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] device_id is not set on port 118783be-b64b-400a-959d-5e8752a0ed69 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:25:56.284901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.291501 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:56.296739 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bbd366f1-daab-4dc2-ba86-9f0455960711 admin admin] 10.222.0.57 "PUT /v2.0/routers/67c47c57-09e4-4303-97e1-a2215115ce2a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4158747 Dec 10 14:25:56.299239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54086) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:56.300553 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-892233e8-6da2-4124-bdc9-696b205051d6 req-a80e1e34-ec93-4b7b-849b-237cc9ffa397 service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3672523 Dec 10 14:25:56.303151 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] Sync routers for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:56.319289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:56.320058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:56.367361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.372632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks [] for floatingip, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.375549 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.384333 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-078e0df6-217f-4ebd-9984-3d61c8657ab4 tempest-ServersTestManualDisk-874486775 tempest-ServersTestManualDisk-874486775-project] 10.222.0.57 "DELETE /v2.0/floatingips/287231e3-6f8f-425c-b76d-d645e0eb329e HTTP/1.1" status: 204 len: 168 time: 2.2711842 Dec 10 14:25:56.387597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54088) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:56.388181 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ec92a4e7-13a6-48a3-8c2e-c2c0c4a030ca tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags HTTP/1.1" status: 200 len: 205 time: 0.4230053 Dec 10 14:25:56.426258 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54090) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:56.441177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.447112 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.474021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2e6064ab-419c-4cc1-b3c6-34a9bdf153e1']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:56.491502 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:56.493452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '13fbd8d4-2a1e-4eab-a8d6-8e67da050394') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:56.493452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '13fbd8d4-2a1e-4eab-a8d6-8e67da050394') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:56.504281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-ee29247c-dc2c-462c-8dd3-82df98de4aa6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:56.518825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.548943 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.565378 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-892233e8-6da2-4124-bdc9-696b205051d6 req-087bd56e-78b7-40bf-9ea5-a5194e1045bb service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2472208 Dec 10 14:25:56.567490 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.603198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 391 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:25:56.604388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:25:56.620998 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:25:56.683339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'Port': ['ID=118783be-b64b-400a-959d-5e8752a0ed69,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:56.727519 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.731026 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:25:54Z', 'revision_number': 5, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:56.731639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=bc425151-c37a-4f55-b82a-4767b22938c1,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:56.761611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] Checking router: 67c47c57-09e4-4303-97e1-a2215115ce2a for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:25:56.771433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] Routers {'67c47c57-09e4-4303-97e1-a2215115ce2a'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:56.771976 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['67c47c57-09e4-4303-97e1-a2215115ce2a'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:56.783691 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.826075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.832883 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:56.840940 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/2e6064ab-419c-4cc1-b3c6-34a9bdf153e1 HTTP/1.1" status: 204 len: 168 time: 4.2189596 Dec 10 14:25:56.841566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54100) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:56.851995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1356265298'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:56.884884 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad11efe-ced9-4e58-8cd1-fdfeee88d795 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=2e6064ab-419c-4cc1-b3c6-34a9bdf153e1,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:56.890425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:56.895440 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:56.896912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] Set router 67c47c57-09e4-4303-97e1-a2215115ce2a gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:25:57.053602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Checking segment: {'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:57.054144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Network hostable DHCP agents. Network: 5c0f5153-b96e-46db-aaab-a604f5138cfd, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:57.066204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:57.070355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:57.096807 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ee29247c-dc2c-462c-8dd3-82df98de4aa6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags HTTP/1.1" status: 200 len: 239 time: 0.6686153 Dec 10 14:25:57.104756 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54108) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:57.112961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-b0ad3ace-4e81-43a5-981e-eb5e8d8d1f60 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc', 'tempest-TagsExtTest-Tag-91424850') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:57.159680 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 377, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:57.166703 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:57.175534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router a9d6ff8f-6f21-4d81-bd51-c184c2a50541 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:25:57.178509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:57.178895 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment 9790fbc8-f56b-4119-bc13-8be29da95c81 of type vlan for network e3d7af68-e53b-41d1-a8cc-bb38d6273466 Dec 10 14:25:57.219977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-1fedf504-5a21-432d-afba-a680614055ef None None] Provisioning complete for port bc425151-c37a-4f55-b82a-4767b22938c1 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:57.220567 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1fedf504-5a21-432d-afba-a680614055ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:57.222531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:25:54Z', 'revision_number': 5, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:57.272160 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8bbda92-191b-44f0-83fe-8285f68a0595 None None] The sync data for ids ['67c47c57-09e4-4303-97e1-a2215115ce2a'] in dv-neutron-821401-2-hyperv is: [{'id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'name': 'tempest-ServersTestJSON-1676129679-router', 'tenant_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5'}], 'enable_snat': True}, 'gw_port_id': '3e34a057-7219-452b-8317-f70e57f89f17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:25:54Z', 'revision_number': 5, 'project_id': '8f11a2c4cb6b474d81f884b20c96a97b', 'gw_port': {'id': '3e34a057-7219-452b-8317-f70e57f89f17', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:3a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c47c57-09e4-4303-97e1-a2215115ce2a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 62, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:57.286802 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1fedf504-5a21-432d-afba-a680614055ef None None] Port bc425151-c37a-4f55-b82a-4767b22938c1 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:57.348759 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:57.351436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Network 5c0f5153-b96e-46db-aaab-a604f5138cfd is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:57.364462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:25:57.370103 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-622bcc81-9bd9-429c-8803-517da1f40101 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/routers/a9d6ff8f-6f21-4d81-bd51-c184c2a50541/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4424973 Dec 10 14:25:57.373636 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54114) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:57.380330 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42caba4f-2d90-46e4-adcb-41b725a57e4d None None] Sync routers for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:25:57.381755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'port': {'network_id': '9c3829d2-ad8b-4c9e-8fca-cff12849a398', 'name': 'tempest-FloatingIPTestJSON-925542482'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:57.399277 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42caba4f-2d90-46e4-adcb-41b725a57e4d None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:57.401344 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-42caba4f-2d90-46e4-adcb-41b725a57e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:57.414084 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b0ad3ace-4e81-43a5-981e-eb5e8d8d1f60 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags/tempest-TagsExtTest-Tag-91424850 HTTP/1.1" status: 204 len: 168 time: 0.3016694 Dec 10 14:25:57.425472 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54118) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:57.436389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-aee13815-1ffa-4b6b-be69-08c40c364b62 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc', 'tempest-TagsExtTest-Tag-91424850') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:57.452954 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-42caba4f-2d90-46e4-adcb-41b725a57e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:57.466646 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42caba4f-2d90-46e4-adcb-41b725a57e4d None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:25:57.468024 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-42caba4f-2d90-46e4-adcb-41b725a57e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:57.507045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:57.516847 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:57.517708 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:57.535249 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-42caba4f-2d90-46e4-adcb-41b725a57e4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:57.536365 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42caba4f-2d90-46e4-adcb-41b725a57e4d None None] The sync data for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:25:57.610458 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=e3d7af68-e53b-41d1-a8cc-bb38d6273466,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:57.626266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network e3d7af68-e53b-41d1-a8cc-bb38d6273466 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:25:57.716577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Made reservation on behalf of c2a7c581de164ccf910afaf96add3a69 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:57.721057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:57.751460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] device_id is not set on port 4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:25:57.793677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 5c0f5153-b96e-46db-aaab-a604f5138cfd) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:57.805180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a777dbc3-2775-4d82-b8ec-27cac4f13af5 None None] Network 5c0f5153-b96e-46db-aaab-a604f5138cfd requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:57.816907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:57.840450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Deleting port 3e34a057-7219-452b-8317-f70e57f89f17 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:57.840823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:57.849819 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9004b2b7-b03e-43b3-89ad-2dec96773819 req-43eda013-fb14-43ce-b3fe-2da479d258e2 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:57.857569 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9004b2b7-b03e-43b3-89ad-2dec96773819 req-43eda013-fb14-43ce-b3fe-2da479d258e2 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.6136897 Dec 10 14:25:57.868058 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6fc3c767-fdad-4fc8-90f0-0b33de4d57ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.0200720 Dec 10 14:25:57.872089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54122) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:57.884249 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': 'e3d7af68-e53b-41d1-a8cc-bb38d6273466', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:57.975089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:57.975423 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:57.975764 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:57.997664 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:57.998008 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.004251 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 2 to bind port 118783be-b64b-400a-959d-5e8752a0ed69 Dec 10 14:25:58.042221 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Allocated IP 172.20.0.11 (9c3829d2-ad8b-4c9e-8fca-cff12849a398/f812692c-cac5-411a-b257-d33ebcf6a597/4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:58.056169 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:58.056506 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:58.057390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:58.077012 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9004b2b7-b03e-43b3-89ad-2dec96773819 req-ccf7bf85-794b-4a13-9151-be4c92589954 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2185271 Dec 10 14:25:58.082178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:58.082507 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.086631 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 3 to bind port 118783be-b64b-400a-959d-5e8752a0ed69 Dec 10 14:25:58.107518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.148218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:58.151798 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.157888 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:58.158224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:58.158559 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:58.170700 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-aee13815-1ffa-4b6b-be69-08c40c364b62 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags/tempest-TagsExtTest-Tag-91424850 HTTP/1.1" status: 204 len: 168 time: 0.7420392 Dec 10 14:25:58.177645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54128) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:58.182492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] For port 3e34a057-7219-452b-8317-f70e57f89f17, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3e34a057-7219-452b-8317-f70e57f89f17,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:58.182883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.187724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-428ca60c-8825-4761-80ff-d49b5c0f5cc8 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:58.197016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:58.197322 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.217827 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing IP validity checks on allocation pools {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 10 14:25:58.218338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 10 14:25:58.227258 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 4 to bind port 118783be-b64b-400a-959d-5e8752a0ed69 Dec 10 14:25:58.240583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Calling delete_port for 3e34a057-7219-452b-8317-f70e57f89f17 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:58.283021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.292305 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:58.292647 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:58.292988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:58.363953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:58.364481 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.368336 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 5 to bind port 118783be-b64b-400a-959d-5e8752a0ed69 Dec 10 14:25:58.397741 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:58.398082 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:58.398420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:58.432596 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-428ca60c-8825-4761-80ff-d49b5c0f5cc8 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags HTTP/1.1" status: 200 len: 205 time: 0.2538998 Dec 10 14:25:58.435303 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54136) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:58.441014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-04f186df-c88a-4990-9ee4-b9f66d85de05 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:58.442944 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:58.443283 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.445626 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 6 to bind port 118783be-b64b-400a-959d-5e8752a0ed69 Dec 10 14:25:58.457445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.471088 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:25:58.496152 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:25:58.496692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d68de4f4-15dd-41d2-a9d2-fbeb4e1ccd3d not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:25:58.505674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.521233 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:58.521601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:58.522005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:58.542554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:58.542890 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.544970 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 7 to bind port 118783be-b64b-400a-959d-5e8752a0ed69 Dec 10 14:25:58.548216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54138) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:58.576328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:58.576328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:58.576328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:58.576799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:58.583786 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-04f186df-c88a-4990-9ee4-b9f66d85de05 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags HTTP/1.1" status: 200 len: 241 time: 0.1447144 Dec 10 14:25:58.584926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54142) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:58.586865 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:58.594281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-6d78180a-05a5-46b6-a23f-817d67c6fc2a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59', 'tempest-TagsExtTest-Tag-1259735777') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:58.602820 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:58.612822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=0e71c03c-67ca-4b85-9270-5f0aa43e07dc,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:58.613774 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:58.614109 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.617092 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event updated for resources: {'Port': ['ID=4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:58.622422 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 8 to bind port 118783be-b64b-400a-959d-5e8752a0ed69 Dec 10 14:25:58.692910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': '9790fbc8-f56b-4119-bc13-8be29da95c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'e3d7af68-e53b-41d1-a8cc-bb38d6273466'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:58.693642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: e3d7af68-e53b-41d1-a8cc-bb38d6273466, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:25:58.700054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:58.700054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:58.700054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:58.718343 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'network': {'name': 'tempest-RoutersIpV6AdminTest-539533135', 'router:external': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:58.719760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:58.720476 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.727529 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6d78180a-05a5-46b6-a23f-817d67c6fc2a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags/tempest-TagsExtTest-Tag-1259735777 HTTP/1.1" status: 204 len: 168 time: 0.1411846 Dec 10 14:25:58.733220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54144) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:58.736348 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-540892c6-7f41-48ef-83de-bd6864570ab9 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59', 'tempest-TagsExtTest-Tag-1259735777') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:58.758867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:58.759213 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.759783 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 9 to bind port 118783be-b64b-400a-959d-5e8752a0ed69 Dec 10 14:25:58.781135 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:58.781496 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:58.781842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:58.789631 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.794384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:58.794755 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.799428 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 10 to bind port 118783be-b64b-400a-959d-5e8752a0ed69 Dec 10 14:25:58.830057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Pushing event deleted for resources: {'Port': ['ID=3e34a057-7219-452b-8317-f70e57f89f17,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:58.844021 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34e0a015-d31c-4894-9533-5c44422ed42f None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:25:58.877237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network e3d7af68-e53b-41d1-a8cc-bb38d6273466 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:25:58.877454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:58.877454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:58.877454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:58.877707 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1569c70b-4062-4542-aaca-15c59ea10384 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.4896924 Dec 10 14:25:58.877707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54146) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:58.877707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Request body: {'floatingip': {'port_id': '4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:25:58.900444 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 118783be-b64b-400a-959d-5e8752a0ed69 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:25:58.901357 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 118783be-b64b-400a-959d-5e8752a0ed69 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:25:58.901755 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.912503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Deleting port a0de3123-62f5-41a9-921c-6e2250a89def {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:25:58.912849 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:58.928093 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-540892c6-7f41-48ef-83de-bd6864570ab9 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags/tempest-TagsExtTest-Tag-1259735777 HTTP/1.1" status: 204 len: 168 time: 0.1951451 Dec 10 14:25:58.931005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54148) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:58.935407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-67943ee3-89ba-4062-a17d-71d4abfb5d5e tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:58.960515 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.003960 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.009233 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-67943ee3-89ba-4062-a17d-71d4abfb5d5e tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags HTTP/1.1" status: 200 len: 205 time: 0.0747097 Dec 10 14:25:59.010093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54150) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:59.014392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-a52ebe8f-f6b2-4610-b4a2-3d1f22e35750 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:59.021802 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-fb99a3e5-a8e9-4ac6-baac-937f5fdc771d None None] Provisioning complete for port 4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:25:59.022534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, e3d7af68-e53b-41d1-a8cc-bb38d6273466) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:59.022761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb99a3e5-a8e9-4ac6-baac-937f5fdc771d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.041053 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:59.042559 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.052663 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-747319b0-14a3-4f7f-a557-1c7219d240f5 None None] Network e3d7af68-e53b-41d1-a8cc-bb38d6273466 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:25:59.084374 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Made reservation on behalf of f9aa01fe07354a7bb501a9f380ddaed8 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:25:59.086745 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.116172 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-fb99a3e5-a8e9-4ac6-baac-937f5fdc771d None None] Port 4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:25:59.125517 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a52ebe8f-f6b2-4610-b4a2-3d1f22e35750 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags HTTP/1.1" status: 204 len: 168 time: 0.1125178 Dec 10 14:25:59.126260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54154) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:59.130667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-3144973e-ac82-4bc7-b599-6da1ab7a5cb1 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:59.160094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.163279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.190463 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-e3d7af68-e53b-41d1-a8cc-bb38d6273466', 'network_id': 'e3d7af68-e53b-41d1-a8cc-bb38d6273466', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': '0e71c03c-67ca-4b85-9270-5f0aa43e07dc'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:25:59.191372 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.215141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.297560 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] For port 118783be-b64b-400a-959d-5e8752a0ed69, host hv-neutron-8214, cleared binding levels {{(pid=103811) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:59.298279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempted to set empty binding levels {{(pid=103811) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 10 14:25:59.311441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] For port a0de3123-62f5-41a9-921c-6e2250a89def, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a0de3123-62f5-41a9-921c-6e2250a89def,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:25:59.311850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.316680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.317236 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 67c47c57-09e4-4303-97e1-a2215115ce2a {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:25:59.326807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.326807 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-00366edd-a55e-455f-b488-32dc2fb92243 admin admin] 10.222.0.57 "DELETE /v2.0/routers/67c47c57-09e4-4303-97e1-a2215115ce2a HTTP/1.1" status: 204 len: 168 time: 3.0231311 Dec 10 14:25:59.335284 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54156) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:59.356410 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Allocated IP 172.20.0.3 (e3d7af68-e53b-41d1-a8cc-bb38d6273466/0e71c03c-67ca-4b85-9270-5f0aa43e07dc/f75e8e2e-ae95-429b-818c-e5a78138a7bf) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:25:59.378146 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Calling delete_port for a0de3123-62f5-41a9-921c-6e2250a89def owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:25:59.423980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.518115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d4fb5a-81af-43b2-93c8-571d9ba3d79c req-0ab5553c-33ec-46d7-8611-73f93e1e1d7b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:59.529991 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-87d4fb5a-81af-43b2-93c8-571d9ba3d79c req-0ab5553c-33ec-46d7-8611-73f93e1e1d7b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2940261 Dec 10 14:25:59.538909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.545210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-381d38a0-a582-4fe8-b7e0-5c039fc4258c admin admin] Deleting subnet f95bfcc0-b514-425e-a401-25563b482fae {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:25:59.553081 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-90999919-02fa-44da-b360-e9b8c084c0ca tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 800 time: 1.6774845 Dec 10 14:25:59.555247 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-381d38a0-a582-4fe8-b7e0-5c039fc4258c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.556896 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54158) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:59.567186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:25:59.567786 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.625882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.630674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'Port': ['ID=118783be-b64b-400a-959d-5e8752a0ed69,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:59.667834 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-381d38a0-a582-4fe8-b7e0-5c039fc4258c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.677457 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Network e3d7af68-e53b-41d1-a8cc-bb38d6273466 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:25:59.682694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.682894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:25:59.684458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:25:59.698716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Pushing event updated for resources: {'Port': ['ID=f75e8e2e-ae95-429b-818c-e5a78138a7bf,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:25:59.704374 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3144973e-ac82-4bc7-b599-6da1ab7a5cb1 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags HTTP/1.1" status: 204 len: 168 time: 0.5768640 Dec 10 14:25:59.704671 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54160) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:59.720440 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-3f7120e2-7475-4e16-8d3a-af59b477c835 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:59.747725 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Attempting to bind port f75e8e2e-ae95-429b-818c-e5a78138a7bf on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:25:59.747988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Attempting to bind port f75e8e2e-ae95-429b-818c-e5a78138a7bf by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '9790fbc8-f56b-4119-bc13-8be29da95c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'e3d7af68-e53b-41d1-a8cc-bb38d6273466'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:25:59.748254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Attempting to bind port f75e8e2e-ae95-429b-818c-e5a78138a7bf on network e3d7af68-e53b-41d1-a8cc-bb38d6273466 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:25:59.753490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:25:59.753863 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Checking segment: {'id': '9790fbc8-f56b-4119-bc13-8be29da95c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'e3d7af68-e53b-41d1-a8cc-bb38d6273466'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:25:59.754304 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.754731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Bound using segment: {'id': '9790fbc8-f56b-4119-bc13-8be29da95c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'e3d7af68-e53b-41d1-a8cc-bb38d6273466'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:25:59.757981 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Bound port: f75e8e2e-ae95-429b-818c-e5a78138a7bf, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9790fbc8-f56b-4119-bc13-8be29da95c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'e3d7af68-e53b-41d1-a8cc-bb38d6273466'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:25:59.758142 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cf66cc21-3fad-4c4b-8d9f-ee964190932a tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 982 time: 4.9284446 Dec 10 14:25:59.758271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.760260 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54162) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:59.774725 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-87d4fb5a-81af-43b2-93c8-571d9ba3d79c req-abecc078-d7ef-4cb5-a007-669194dfc319 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2241821 Dec 10 14:25:59.779295 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.804523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.839353 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] For port f75e8e2e-ae95-429b-818c-e5a78138a7bf, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:25:59.843594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] For port f75e8e2e-ae95-429b-818c-e5a78138a7bf, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f75e8e2e-ae95-429b-818c-e5a78138a7bf,segment=NetworkSegment(9790fbc8-f56b-4119-bc13-8be29da95c81),segment_id=9790fbc8-f56b-4119-bc13-8be29da95c81)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:25:59.930786 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3f7120e2-7475-4e16-8d3a-af59b477c835 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags HTTP/1.1" status: 204 len: 168 time: 0.2171478 Dec 10 14:25:59.934568 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.937166 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] vlan segment allocate from pool success with {'vlan_id': 351, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:25:59.938061 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54166) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:25:59.942572 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-d0bbf002-3d46-4805-ab6a-4f97637502b4 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:25:59.975171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.975522 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Added segment 5ddd761f-1d0b-42c3-8f44-6cda32ad0add of type vlan for network 86dcd512-65b5-48d0-925b-b7b236a1690d Dec 10 14:25:59.977209 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-381d38a0-a582-4fe8-b7e0-5c039fc4258c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:25:59.983508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5bcfca9b-3f66-4159-ac88-ef1172b3b515,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:00.026219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f018085-396c-404b-b76a-a8981304a0bc None None] Pushing event updated for resources: {'Port': ['ID=f75e8e2e-ae95-429b-818c-e5a78138a7bf,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:00.053480 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port f75e8e2e-ae95-429b-818c-e5a78138a7bf {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:00.053480 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.140739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7438ea06-cae8-48b0-bba0-6c5308ff8cbf req-6557258c-c120-47d1-9252-2ba02f23cbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:00.142448 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7438ea06-cae8-48b0-bba0-6c5308ff8cbf req-6557258c-c120-47d1-9252-2ba02f23cbb7 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2644749 Dec 10 14:26:00.184871 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.188005 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d0bbf002-3d46-4805-ab6a-4f97637502b4 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags HTTP/1.1" status: 204 len: 168 time: 0.2489381 Dec 10 14:26:00.192334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54168) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:00.198232 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-8a5fc0a3-fcd9-412c-999f-77a66b773b3d tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545', 'tempest-TagsExtTest-Tag-1349595575') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:00.248526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port f75e8e2e-ae95-429b-818c-e5a78138a7bf, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f75e8e2e-ae95-429b-818c-e5a78138a7bf,segment=NetworkSegment(9790fbc8-f56b-4119-bc13-8be29da95c81),segment_id=9790fbc8-f56b-4119-bc13-8be29da95c81)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:00.248902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.266964 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.272548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for f75e8e2e-ae95-429b-818c-e5a78138a7bf owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:00.288492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-659486c5-0857-4551-a3b8-de872eb7d0f9 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Deleting port 118783be-b64b-400a-959d-5e8752a0ed69 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:00.289094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-659486c5-0857-4551-a3b8-de872eb7d0f9 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.295434 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7438ea06-cae8-48b0-bba0-6c5308ff8cbf req-2af931be-0400-4654-a89a-edc8fb947358 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1293814 Dec 10 14:26:00.362495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.410230 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.435923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-659486c5-0857-4551-a3b8-de872eb7d0f9 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] For port 118783be-b64b-400a-959d-5e8752a0ed69, host hv-neutron-8214, got binding levels [] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:00.436455 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-659486c5-0857-4551-a3b8-de872eb7d0f9 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.439735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-381d38a0-a582-4fe8-b7e0-5c039fc4258c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.451405 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Pushing event deleted for resources: {'Port': ['ID=a0de3123-62f5-41a9-921c-6e2250a89def,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:00.454529 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.455487 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:00.456079 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.469011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-381d38a0-a582-4fe8-b7e0-5c039fc4258c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.474455 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-381d38a0-a582-4fe8-b7e0-5c039fc4258c admin admin] 10.222.0.57 "DELETE /v2.0/subnets/f95bfcc0-b514-425e-a401-25563b482fae HTTP/1.1" status: 204 len: 168 time: 1.1306095 Dec 10 14:26:00.479680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0afe0dd-db6a-47c6-b907-ea1a035938b7 None None] Network 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:00.523779 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54172) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:00.537479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-659486c5-0857-4551-a3b8-de872eb7d0f9 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Calling delete_port for 118783be-b64b-400a-959d-5e8752a0ed69 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:00.572133 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-381d38a0-a582-4fe8-b7e0-5c039fc4258c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f95bfcc0-b514-425e-a401-25563b482fae,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:00.665456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f75e8e2e-ae95-429b-818c-e5a78138a7bf up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:00.672976 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8a5fc0a3-fcd9-412c-999f-77a66b773b3d tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags/tempest-TagsExtTest-Tag-1349595575 HTTP/1.1" status: 201 len: 201 time: 0.4793830 Dec 10 14:26:00.676773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.678729 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54174) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:00.690722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-7fdf6396-c033-40d2-8de1-607a1556ad1b tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2', 'tempest-TagsExtTest-Tag-1925618907') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:00.695794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: f75e8e2e-ae95-429b-818c-e5a78138a7bf {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:00.696139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f75e8e2e-ae95-429b-818c-e5a78138a7bf not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Dec 10 14:26:00.731905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Port f75e8e2e-ae95-429b-818c-e5a78138a7bf not found, will not notify nova. {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Dec 10 14:26:00.764931 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:00.798631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=f75e8e2e-ae95-429b-818c-e5a78138a7bf,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:00.840443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10e52420-1134-4b62-b069-5652c9e8adfe None None] DHCP port deletion for 90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:00.900034 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP efcd9b24-6792-4105-904f-0dfec93fb6cc associated. External IP: 172.26.2.9, port: 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb. Dec 10 14:26:00.901829 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3e34a057-7219-452b-8317-f70e57f89f17 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:00.905341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port f75e8e2e-ae95-429b-818c-e5a78138a7bf on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:00.956988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 3e34a057-7219-452b-8317-f70e57f89f17 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:00.957712 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3e34a057-7219-452b-8317-f70e57f89f17 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:00.982290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-10e52420-1134-4b62-b069-5652c9e8adfe None None] Deleting port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:00.982936 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-10e52420-1134-4b62-b069-5652c9e8adfe None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.048492 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.064590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.071400 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 874 time: 2.5204334 Dec 10 14:26:01.072292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e406031d-d626-430c-ba24-cb5729c419c2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event updated for resources: {'Network': ['ID=86dcd512-65b5-48d0-925b-b7b236a1690d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:01.073386 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-10e52420-1134-4b62-b069-5652c9e8adfe None None] For port c5a831ab-ec1e-4be3-9f77-2b2a42921d13, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a831ab-ec1e-4be3-9f77-2b2a42921d13,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:01.073711 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-10e52420-1134-4b62-b069-5652c9e8adfe None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.084995 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 86dcd512-65b5-48d0-925b-b7b236a1690d details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:01.089301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54178) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:01.100613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'subnet': {'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:01.172289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-10e52420-1134-4b62-b069-5652c9e8adfe None None] Calling delete_port for c5a831ab-ec1e-4be3-9f77-2b2a42921d13 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:01.204020 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Deleting port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:01.204462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.215757 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Made reservation on behalf of f9aa01fe07354a7bb501a9f380ddaed8 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:01.218259 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.235683 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99eb528e-b7e2-4745-93b5-58eff5b7e757 req-5382920b-d0da-447b-9fe1-6e66d6acb1d3 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:01.237237 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-99eb528e-b7e2-4745-93b5-58eff5b7e757 req-5382920b-d0da-447b-9fe1-6e66d6acb1d3 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1713390 Dec 10 14:26:01.246940 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7fdf6396-c033-40d2-8de1-607a1556ad1b tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags/tempest-TagsExtTest-Tag-1925618907 HTTP/1.1" status: 201 len: 201 time: 0.5622082 Dec 10 14:26:01.255034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54180) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:01.267526 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-43ef6d8c-ccdb-4482-b2d5-5280e9735d2b tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc', 'tempest-TagsExtTest-Tag-1167563768') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:01.312662 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc3419e2-6f18-4cdb-bcec-d84a09f2269e None None] Network e3d7af68-e53b-41d1-a8cc-bb38d6273466 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:01.335495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.365048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-10e52420-1134-4b62-b069-5652c9e8adfe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.372836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-bf703df2-3163-4249-a7c0-d0bef06e301d None None] Could not find standard attr ID for object f75e8e2e-ae95-429b-818c-e5a78138a7bf. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:26:01.395847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.396260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=0e71c03c-67ca-4b85-9270-5f0aa43e07dc,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:01.405656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] For port c5a831ab-ec1e-4be3-9f77-2b2a42921d13, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a831ab-ec1e-4be3-9f77-2b2a42921d13,segment=NetworkSegment(6d1241a1-dea0-4f8f-8e5e-03b341b37387),segment_id=6d1241a1-dea0-4f8f-8e5e-03b341b37387)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:01.406048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.410727 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e52420-1134-4b62-b069-5652c9e8adfe None None] Pushing event deleted for resources: {'Port': ['ID=c5a831ab-ec1e-4be3-9f77-2b2a42921d13,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:01.414701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10e52420-1134-4b62-b069-5652c9e8adfe None None] No DVR routers for this DVR port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:01.470243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-659486c5-0857-4551-a3b8-de872eb7d0f9 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.473244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Calling delete_port for c5a831ab-ec1e-4be3-9f77-2b2a42921d13 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:01.498895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:26:01.501364 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.554026 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-99eb528e-b7e2-4745-93b5-58eff5b7e757 req-5190865b-04e2-48ef-9f43-35278a9f3e62 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2924652 Dec 10 14:26:01.554238 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e3d7af68-e53b-41d1-a8cc-bb38d6273466']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:01.584008 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9790fbc8-f56b-4119-bc13-8be29da95c81') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:01.592094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9790fbc8-f56b-4119-bc13-8be29da95c81') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:01.620714 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-659486c5-0857-4551-a3b8-de872eb7d0f9 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event deleted for resources: {'Port': ['ID=118783be-b64b-400a-959d-5e8752a0ed69,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:01.642179 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.643212 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-659486c5-0857-4551-a3b8-de872eb7d0f9 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.649781 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-659486c5-0857-4551-a3b8-de872eb7d0f9 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "DELETE /v2.0/ports/118783be-b64b-400a-959d-5e8752a0ed69 HTTP/1.1" status: 204 len: 168 time: 1.8867996 Dec 10 14:26:01.657859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54184) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:01.672176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.689172 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 377 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:01.689800 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:01.693083 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:01.700716 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-b178a97d-46cd-4b89-8d97-f142187ff8e0 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] GET failed (client error): The resource could not be found. Dec 10 14:26:01.705593 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b178a97d-46cd-4b89-8d97-f142187ff8e0 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "GET /v2.0/ports/118783be-b64b-400a-959d-5e8752a0ed69 HTTP/1.1" status: 404 len: 333 time: 0.0434020 Dec 10 14:26:01.708991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54186) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:01.733360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3cd83b7-157b-4815-bd0e-7bf89bc7f13a None None] Network e3d7af68-e53b-41d1-a8cc-bb38d6273466 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:01.761000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Request body: {'port': {'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1575474979'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:01.768833 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.785089 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-43ef6d8c-ccdb-4482-b2d5-5280e9735d2b tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags/tempest-TagsExtTest-Tag-1167563768 HTTP/1.1" status: 201 len: 201 time: 0.5209136 Dec 10 14:26:01.785089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54188) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:01.806091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-aa8f9778-e921-4e9e-b44d-354a0d7e5ca5 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59', 'tempest-TagsExtTest-Tag-1178376151') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:01.818438 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Pushing event deleted for resources: {'Port': ['ID=c5a831ab-ec1e-4be3-9f77-2b2a42921d13,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:01.820269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] No DVR routers for this DVR port c5a831ab-ec1e-4be3-9f77-2b2a42921d13 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:01.851501 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:01.870959 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b552dfc-3c21-412b-a6a5-a58b28607c25 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:01.890168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b552dfc-3c21-412b-a6a5-a58b28607c25 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:01.890954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9b552dfc-3c21-412b-a6a5-a58b28607c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:01.939085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.946713 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e149f9dd-4611-4363-9da0-564ed4e47083 None None] DHCP port deletion for e3d7af68-e53b-41d1-a8cc-bb38d6273466 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:01.949935 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.952361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9b552dfc-3c21-412b-a6a5-a58b28607c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:01.956776 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/e3d7af68-e53b-41d1-a8cc-bb38d6273466 HTTP/1.1" status: 204 len: 168 time: 2.3946440 Dec 10 14:26:01.958559 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54192) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:01.961615 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:01.975718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b552dfc-3c21-412b-a6a5-a58b28607c25 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:01.976525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9b552dfc-3c21-412b-a6a5-a58b28607c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:01.981915 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-679234844'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:01.998876 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e96f3e-54eb-4a1e-9fda-6aaa82dd6c6a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=e3d7af68-e53b-41d1-a8cc-bb38d6273466,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:02.003412 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Made reservation on behalf of ea35a951bf5c4706970400d2939b7ccc for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:02.005369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.014819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9b552dfc-3c21-412b-a6a5-a58b28607c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.015566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b552dfc-3c21-412b-a6a5-a58b28607c25 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:02.039023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['90ab95ca-b6c7-4d4c-8815-86eb5dad26d0']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.055213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6d1241a1-dea0-4f8f-8e5e-03b341b37387') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.055662 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6d1241a1-dea0-4f8f-8e5e-03b341b37387') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.068714 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.089724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.097437 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-aa8f9778-e921-4e9e-b44d-354a0d7e5ca5 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags/tempest-TagsExtTest-Tag-1178376151 HTTP/1.1" status: 201 len: 201 time: 0.3018391 Dec 10 14:26:02.104475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54194) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:02.114321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] device_id is not set on port 3efc397c-4a59-43df-af58-1fb8fed789cf yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:02.122354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-b5735da6-4a1a-4aa3-883d-86bd6f5f7a77 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545', {'tags': ['tempest-TagsExtTest-Tag-420776456', 'tempest-TagsExtTest-Tag-1647074272', 'tempest-TagsExtTest-Tag-149894096']}) {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.129591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Releasing vlan 353 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:02.130010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:02.131673 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:02.201640 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:02.205092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.214392 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e00ce40-21ca-4262-aab9-cabe4e7f9f3c req-aeca91be-550d-4436-9a39-de118e08d778 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:02.215922 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8e00ce40-21ca-4262-aab9-cabe4e7f9f3c req-aeca91be-550d-4436-9a39-de118e08d778 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2765303 Dec 10 14:26:02.239723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router a9d6ff8f-6f21-4d81-bd51-c184c2a50541 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:26:02.244337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:26:02.328199 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.345971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.349879 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] 10.222.0.57 "DELETE /v2.0/networks/90ab95ca-b6c7-4d4c-8815-86eb5dad26d0 HTTP/1.1" status: 204 len: 168 time: 1.8223472 Dec 10 14:26:02.355165 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c04ac066-fa5f-4b33-9b08-cf40a7c9c380 admin admin] Pushing event deleted for resources: {'Network': ['ID=90ab95ca-b6c7-4d4c-8815-86eb5dad26d0,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:02.355378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 380, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:02.376306 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:02.381473 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.388146 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f8c88ad-9916-44c5-b00d-2a603234888c None None] Sync routers for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:02.397368 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f8c88ad-9916-44c5-b00d-2a603234888c None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:02.401354 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0f8c88ad-9916-44c5-b00d-2a603234888c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.466616 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b5735da6-4a1a-4aa3-883d-86bd6f5f7a77 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags HTTP/1.1" status: 200 len: 316 time: 0.3559363 Dec 10 14:26:02.469506 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54198) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:02.470452 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8e00ce40-21ca-4262-aab9-cabe4e7f9f3c req-20f68665-0d29-44de-bc0d-832347e0484d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2446432 Dec 10 14:26:02.475967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.475967 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment d9db027f-68e6-458a-be8d-6bb57e6add25 of type vlan for network 36c1aa98-7802-48a7-aee3-174f9dc199a3 Dec 10 14:26:02.479491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-4f4aac3c-a12f-4c6a-b258-30b03a90a5cd tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.497012 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0f8c88ad-9916-44c5-b00d-2a603234888c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.511132 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f8c88ad-9916-44c5-b00d-2a603234888c None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:02.512120 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0f8c88ad-9916-44c5-b00d-2a603234888c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.537008 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-df9f3b13-701d-4c26-968b-3c1a8b613739 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/floatingips/efcd9b24-6792-4105-904f-0dfec93fb6cc HTTP/1.1" status: 200 len: 976 time: 3.6684566 Dec 10 14:26:02.540336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54200) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:02.554465 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0f8c88ad-9916-44c5-b00d-2a603234888c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.557920 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f8c88ad-9916-44c5-b00d-2a603234888c None None] The sync data for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:02.595441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.612953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.648040 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a831ab-ec1e-4be3-9f77-2b2a42921d13 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:02.680003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: c5a831ab-ec1e-4be3-9f77-2b2a42921d13 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:02.680374 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a831ab-ec1e-4be3-9f77-2b2a42921d13 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:02.680774 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f75e8e2e-ae95-429b-818c-e5a78138a7bf no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:02.693786 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:26:02.694265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.701695 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port 4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:02.702231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.702457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:02.703402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: f75e8e2e-ae95-429b-818c-e5a78138a7bf {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:02.703766 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f75e8e2e-ae95-429b-818c-e5a78138a7bf not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:02.708674 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f5b89d8b-a0f5-4d92-a9cb-d69f03087480 admin admin] 10.222.0.57 "PUT /v2.0/routers/6b7d9a03-a75e-4f11-8074-0360686c8ab9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3116736 Dec 10 14:26:02.714547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54202) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:02.717436 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] Sync routers for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:02.729386 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:02.730065 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:02.784892 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.791144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:02.791961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.801583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event updated for resources: {'Subnet': ['ID=f2a70a35-c6fc-4572-a861-5de01fc40935,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:02.854504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:26:02.872785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.878054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.878413 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.878768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.879115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.879459 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.879801 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.880139 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.880479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.880820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.882574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.882574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.882574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.882574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:02.882907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e7b280fb-0282-4ee0-a071-732c615a1347 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.892693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Checking segment: {'id': '5ddd761f-1d0b-42c3-8f44-6cda32ad0add', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:02.893067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Network hostable DHCP agents. Network: 86dcd512-65b5-48d0-925b-b7b236a1690d, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:02.950747 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=36c1aa98-7802-48a7-aee3-174f9dc199a3,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:02.967117 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Network 5c0f5153-b96e-46db-aaab-a604f5138cfd is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:02.971995 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-28afe7bf-90b6-4b6c-a645-8991efc33853 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.0016530 Dec 10 14:26:02.977405 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:02.979931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:02.980364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 36c1aa98-7802-48a7-aee3-174f9dc199a3 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:02.981081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:02.981729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:02.987848 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54204) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:02.992224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': '36c1aa98-7802-48a7-aee3-174f9dc199a3', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:03.001615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'Port': ['ID=3efc397c-4a59-43df-af58-1fb8fed789cf,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:03.066658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54206) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:03.078095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Network 86dcd512-65b5-48d0-925b-b7b236a1690d is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:03.115109 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-44e4afed-8a46-456f-825c-c0a11ca651e6 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.4057012 Dec 10 14:26:03.118488 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54208) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:03.124339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8214'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:03.140248 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4f4aac3c-a12f-4c6a-b258-30b03a90a5cd tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags HTTP/1.1" status: 204 len: 168 time: 0.6650774 Dec 10 14:26:03.146254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54210) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:03.152410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-058280d5-7051-4cec-8a2e-3dca5061441a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545', 'tempest-TagsExtTest-Tag-420776456') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:03.191094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 86dcd512-65b5-48d0-925b-b7b236a1690d) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:03.195425 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:03.196028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.219052 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d782b57-aafd-4739-9688-6f4b939fad33 None None] Network 86dcd512-65b5-48d0-925b-b7b236a1690d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:03.239107 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-60b9db75-6416-4a3c-903a-3ad5f67513ec admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=8f11a2c4cb6b474d81f884b20c96a97b&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1712227 Dec 10 14:26:03.243012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54212) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:03.252166 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.282629 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.314966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:03.318531 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.352273 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-058280d5-7051-4cec-8a2e-3dca5061441a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:03.355976 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-058280d5-7051-4cec-8a2e-3dca5061441a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags/tempest-TagsExtTest-Tag-420776456 HTTP/1.1" status: 404 len: 328 time: 0.2073834 Dec 10 14:26:03.358796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54214) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:03.362866 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-22e146d5-9be1-418c-b247-3dd46603a385 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545', 'tempest-TagsExtTest-Tag-1647074272') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:03.378281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94bc4d8c-78ac-4ece-904d-b839769d08a6 None None] Network 86dcd512-65b5-48d0-925b-b7b236a1690d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:03.384565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.408103 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7ae681e8-d47d-42ba-adb1-1c96e0300db7 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 822 time: 2.3155770 Dec 10 14:26:03.420170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54216) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:03.425653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:26:00Z', 'revision_number': 5, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:03.427534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'port': {'name': 'tempest-RoutersIpV6AdminTest-1878774380', 'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:03.455022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ec9082b5-9562-41b0-9fd4-5241a0a2e622 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.459377 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] Checking router: 6b7d9a03-a75e-4f11-8074-0360686c8ab9 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:26:03.475557 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] Routers {'6b7d9a03-a75e-4f11-8074-0360686c8ab9'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:03.476403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:03.507313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.544275 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ec9082b5-9562-41b0-9fd4-5241a0a2e622 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.588895 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-22e146d5-9be1-418c-b247-3dd46603a385 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:03.593103 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-22e146d5-9be1-418c-b247-3dd46603a385 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags/tempest-TagsExtTest-Tag-1647074272 HTTP/1.1" status: 404 len: 329 time: 0.2334070 Dec 10 14:26:03.594772 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54220) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:03.607278 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-dd5f2ffd-44bd-400a-a89d-65e38e0f51e3 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545', 'tempest-TagsExtTest-Tag-149894096') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:03.620511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] Set router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:26:03.694910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.695277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.696080 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Floating IP efcd9b24-6792-4105-904f-0dfec93fb6cc disassociated. External IP: 172.26.2.9, port: 4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e. Dec 10 14:26:03.696080 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for 4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:03.701826 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Deleting port a98b7c4e-6b43-4945-87ef-560059ea48ae {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:03.702478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.718127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Made reservation on behalf of f9aa01fe07354a7bb501a9f380ddaed8 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:03.719410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.754015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] device_id is not set on port 3efc397c-4a59-43df-af58-1fb8fed789cf yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:03.769069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.787235 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] device_id is not set on port a8faad2d-a0b7-48ff-9c67-cf1da10b948f yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:03.811188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:26:00Z', 'revision_number': 5, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:03.835984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] For port a98b7c4e-6b43-4945-87ef-560059ea48ae, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a98b7c4e-6b43-4945-87ef-560059ea48ae,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:03.836372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:03.842156 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86a71b0f-ccfd-47c2-a732-3016cb00a2ae None None] The sync data for ids ['6b7d9a03-a75e-4f11-8074-0360686c8ab9'] in dv-neutron-821401-2-hyperv is: [{'id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'name': 'tempest-ServersTestManualDisk-1991717068-router', 'tenant_id': 'af5207bd54c6403799a8cc223fa0ea80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188'}], 'enable_snat': True}, 'gw_port_id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:05Z', 'updated_at': '2021-12-10T14:26:00Z', 'revision_number': 5, 'project_id': 'af5207bd54c6403799a8cc223fa0ea80', 'gw_port': {'id': 'a98b7c4e-6b43-4945-87ef-560059ea48ae', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:a3:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b7d9a03-a75e-4f11-8074-0360686c8ab9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:06Z', 'updated_at': '2021-12-10T14:24:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:03.857687 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Calling delete_port for a98b7c4e-6b43-4945-87ef-560059ea48ae owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:03.870311 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e979be6-4f5a-47cf-b970-6fd5189c3e5d req-15849c12-3330-4600-964a-a78d4afca35d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:03.871861 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5e979be6-4f5a-47cf-b970-6fd5189c3e5d req-15849c12-3330-4600-964a-a78d4afca35d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2312124 Dec 10 14:26:03.886401 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.132534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.166489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:04.182288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.214506 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ec9082b5-9562-41b0-9fd4-5241a0a2e622 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.217301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ec9082b5-9562-41b0-9fd4-5241a0a2e622 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.220719 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ec9082b5-9562-41b0-9fd4-5241a0a2e622 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/b210820b-78f8-47c3-816b-1b7cecf0d826 HTTP/1.1" status: 204 len: 168 time: 0.9723604 Dec 10 14:26:04.220857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.220857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.220857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.220857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.220857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.221200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.221271 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.221728 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.221975 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.222500 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.222709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.222956 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.223282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:04.277933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec9082b5-9562-41b0-9fd4-5241a0a2e622 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b210820b-78f8-47c3-816b-1b7cecf0d826,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:04.310816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Pushing event deleted for resources: {'Port': ['ID=a98b7c4e-6b43-4945-87ef-560059ea48ae,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:04.342606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-605989fb-d293-463a-a981-e6126cfc199b None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:04.409140 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-dd5f2ffd-44bd-400a-a89d-65e38e0f51e3 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:04.410464 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dd5f2ffd-44bd-400a-a89d-65e38e0f51e3 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags/tempest-TagsExtTest-Tag-149894096 HTTP/1.1" status: 404 len: 328 time: 0.8066456 Dec 10 14:26:04.417189 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54224) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:04.428893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-9f481cdb-05b0-404e-9359-84ef74a76aa0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2', {'tags': ['tempest-TagsExtTest-Tag-1698556599', 'tempest-TagsExtTest-Tag-1203079884', 'tempest-TagsExtTest-Tag-781706215']}) {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:04.434774 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.440100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Allocated IP 2001:db8::60 (86dcd512-65b5-48d0-925b-b7b236a1690d/f2a70a35-c6fc-4572-a861-5de01fc40935/a8faad2d-a0b7-48ff-9c67-cf1da10b948f) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:04.451126 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'Port': ['ID=3efc397c-4a59-43df-af58-1fb8fed789cf,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:04.467946 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5e979be6-4f5a-47cf-b970-6fd5189c3e5d req-470d83cc-ce6c-4acc-a08c-a0017c82d089 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5880029 Dec 10 14:26:04.508260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.549584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:04.550101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:04.550331 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:04.597592 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a0de3123-62f5-41a9-921c-6e2250a89def no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:04.613770 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:04.614112 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:04.618082 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 2 to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf Dec 10 14:26:04.621150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.623942 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: a0de3123-62f5-41a9-921c-6e2250a89def {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:04.624511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a0de3123-62f5-41a9-921c-6e2250a89def not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:04.628624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.629965 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=a81d921c-3a7c-4e52-9114-93ef4fb5979f,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:04.631181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router a9d6ff8f-6f21-4d81-bd51-c184c2a50541 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:26:04.752240 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9f481cdb-05b0-404e-9359-84ef74a76aa0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags HTTP/1.1" status: 200 len: 317 time: 0.3321583 Dec 10 14:26:04.757312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54230) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:04.762866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.763927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-07410c27-15a4-4d3a-b724-eb0b6c2d6395 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:04.764678 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:04.772105 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:04.772105 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:04.773009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': 'd9db027f-68e6-458a-be8d-6bb57e6add25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': '36c1aa98-7802-48a7-aee3-174f9dc199a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:04.773376 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: 36c1aa98-7802-48a7-aee3-174f9dc199a3, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:04.794460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:04.794794 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:04.796375 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 3 to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf Dec 10 14:26:04.822242 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:04.822587 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:04.822923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:04.832544 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:04.832874 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:04.834545 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 4 to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf Dec 10 14:26:04.848141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.848701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 6b7d9a03-a75e-4f11-8074-0360686c8ab9 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:04.854608 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:04.854963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:04.855301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:04.860169 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:04.860426 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:04.860914 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 5 to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf Dec 10 14:26:04.861257 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.863348 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-957dd655-89a1-4561-90d2-8a146080cac0 admin admin] 10.222.0.57 "DELETE /v2.0/routers/6b7d9a03-a75e-4f11-8074-0360686c8ab9 HTTP/1.1" status: 204 len: 168 time: 2.1476119 Dec 10 14:26:04.873407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54238) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:04.882610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:04.899181 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-927dbb5a-b149-40b0-a698-d0544ccc5c63 None None] Sync routers for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:04.914617 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-927dbb5a-b149-40b0-a698-d0544ccc5c63 None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:04.920296 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:04.920625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:04.920979 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:04.923092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 36c1aa98-7802-48a7-aee3-174f9dc199a3 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:04.926629 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-927dbb5a-b149-40b0-a698-d0544ccc5c63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:04.964358 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-927dbb5a-b149-40b0-a698-d0544ccc5c63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:04.972041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-be75e614-e595-4434-a323-890729198679 admin admin] Deleting subnet f3e2204d-7027-4309-a5db-3d266a3ff37e {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:26:04.975007 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-927dbb5a-b149-40b0-a698-d0544ccc5c63 None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:04.975729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:04.975849 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-927dbb5a-b149-40b0-a698-d0544ccc5c63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:25:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:04.976212 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:04.983532 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 6 to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf Dec 10 14:26:04.988759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be75e614-e595-4434-a323-890729198679 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.992486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:04.995456 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.001465 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5ef81970-f8cc-4e23-b242-c8d2cf2fb2d6 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/ports/4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e HTTP/1.1" status: 204 len: 168 time: 2.4577346 Dec 10 14:26:05.003550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54242) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:05.016111 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-927dbb5a-b149-40b0-a698-d0544ccc5c63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:05.016766 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-927dbb5a-b149-40b0-a698-d0544ccc5c63 None None] The sync data for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:05.083996 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-07410c27-15a4-4d3a-b724-eb0b6c2d6395 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags HTTP/1.1" status: 204 len: 168 time: 0.3242049 Dec 10 14:26:05.088887 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54246) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:05.096107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-4bf4cd80-95a2-414b-90f0-c37aef671098 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2', 'tempest-TagsExtTest-Tag-1698556599') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:05.133623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-acfc45e2-ae2a-4bb2-bd6a-814000e13f2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.157202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 36c1aa98-7802-48a7-aee3-174f9dc199a3) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:05.167715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Network 86dcd512-65b5-48d0-925b-b7b236a1690d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:05.169241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-890f66e0-1f7a-4b8b-8fb4-3761d7ae368f None None] Network 36c1aa98-7802-48a7-aee3-174f9dc199a3 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:05.172481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:05.173455 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:05.173455 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:05.176413 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event updated for resources: {'Port': ['ID=a8faad2d-a0b7-48ff-9c67-cf1da10b948f,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:05.181740 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:05.182633 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.190553 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:05.198669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be75e614-e595-4434-a323-890729198679 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.200634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:05.201807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:05.202479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.241597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:05.242765 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:05.249705 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 7 to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf Dec 10 14:26:05.257218 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-4bf4cd80-95a2-414b-90f0-c37aef671098 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:05.258306 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4bf4cd80-95a2-414b-90f0-c37aef671098 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags/tempest-TagsExtTest-Tag-1698556599 HTTP/1.1" status: 404 len: 329 time: 0.1681855 Dec 10 14:26:05.263371 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54248) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:05.269156 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-3a3d32a7-cfff-429a-a084-7765a8bbbc9d tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2', 'tempest-TagsExtTest-Tag-1203079884') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:05.281606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e141b5-1c08-4b0a-be36-49736d20393c req-7577ddcd-04e2-49ad-a7c8-c53076f53874 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:05.283155 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-13e141b5-1c08-4b0a-be36-49736d20393c req-7577ddcd-04e2-49ad-a7c8-c53076f53874 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2352498 Dec 10 14:26:05.290813 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:05.291170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:05.291517 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:05.310224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:05.310578 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:05.320734 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 8 to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf Dec 10 14:26:05.345823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:05.346028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:05.346377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:05.351689 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-46f702f6-eb13-4ae7-be44-97989ef347f6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 2.3637390 Dec 10 14:26:05.356382 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54252) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:05.357162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-36c1aa98-7802-48a7-aee3-174f9dc199a3', 'network_id': '36c1aa98-7802-48a7-aee3-174f9dc199a3', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': 'a81d921c-3a7c-4e52-9114-93ef4fb5979f'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:05.359942 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.399034 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-22a55860-6eac-4b3f-94ad-a0b3044153a2 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1029 time: 1.9718311 Dec 10 14:26:05.403435 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54254) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:05.434402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:05.435325 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:05.504184 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 9 to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf Dec 10 14:26:05.505989 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-3a3d32a7-cfff-429a-a084-7765a8bbbc9d tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:05.507220 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3a3d32a7-cfff-429a-a084-7765a8bbbc9d tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags/tempest-TagsExtTest-Tag-1203079884 HTTP/1.1" status: 404 len: 329 time: 0.2429340 Dec 10 14:26:05.517266 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54260) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:05.523943 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-f77c4f88-5f35-4754-9781-24be1b381a09 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2', 'tempest-TagsExtTest-Tag-781706215') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:05.543591 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be75e614-e595-4434-a323-890729198679 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.578177 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Allocated IP 172.20.0.1 (36c1aa98-7802-48a7-aee3-174f9dc199a3/a81d921c-3a7c-4e52-9114-93ef4fb5979f/0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:05.595928 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-13e141b5-1c08-4b0a-be36-49736d20393c req-ad0fee10-2a11-41ab-9c70-4e01f9d004a2 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2930095 Dec 10 14:26:05.598215 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:05.598579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:05.598907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:05.607791 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:05.608129 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:05.609980 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 10 to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf Dec 10 14:26:05.622761 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.645835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:05.646043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:05.647013 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:05.654962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:05.655292 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port 3efc397c-4a59-43df-af58-1fb8fed789cf on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:05.655673 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.695819 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f5be8055-15a8-4738-8c83-101adbcb66ec tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Deleting port a8faad2d-a0b7-48ff-9c67-cf1da10b948f {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:05.696158 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5be8055-15a8-4738-8c83-101adbcb66ec tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.733248 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-f77c4f88-5f35-4754-9781-24be1b381a09 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:05.737347 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f77c4f88-5f35-4754-9781-24be1b381a09 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags/tempest-TagsExtTest-Tag-781706215 HTTP/1.1" status: 404 len: 328 time: 0.2166617 Dec 10 14:26:05.738308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54264) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:05.743954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-c985e213-ebed-4c56-bd46-c17df8451258 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc', {'tags': ['tempest-TagsExtTest-Tag-2041533229', 'tempest-TagsExtTest-Tag-2027019828', 'tempest-TagsExtTest-Tag-576462805']}) {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:05.747554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.772115 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.779358 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be75e614-e595-4434-a323-890729198679 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.820758 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be75e614-e595-4434-a323-890729198679 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f3e2204d-7027-4309-a5db-3d266a3ff37e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:05.836413 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be75e614-e595-4434-a323-890729198679 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.845289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe691c4f-f60d-4045-8ec8-33c7174fa728 None None] Network 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:05.846772 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-be75e614-e595-4434-a323-890729198679 admin admin] 10.222.0.57 "DELETE /v2.0/subnets/f3e2204d-7027-4309-a5db-3d266a3ff37e HTTP/1.1" status: 204 len: 168 time: 0.9721346 Dec 10 14:26:05.851492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54268) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:05.867568 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.949563 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] For port 3efc397c-4a59-43df-af58-1fb8fed789cf, host hv-neutron-8214, cleared binding levels {{(pid=103811) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:05.950259 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempted to set empty binding levels {{(pid=103811) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 10 14:26:05.958500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Network 36c1aa98-7802-48a7-aee3-174f9dc199a3 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:05.963493 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:05.969580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5be8055-15a8-4738-8c83-101adbcb66ec tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.978785 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:05.983224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:05.992190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f5be8055-15a8-4738-8c83-101adbcb66ec tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Calling delete_port for a8faad2d-a0b7-48ff-9c67-cf1da10b948f owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:06.057034 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Pushing event updated for resources: {'Port': ['ID=0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:06.062099 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Attempting to bind port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:06.062701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Attempting to bind port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'd9db027f-68e6-458a-be8d-6bb57e6add25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': '36c1aa98-7802-48a7-aee3-174f9dc199a3'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:06.063289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Attempting to bind port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd on network 36c1aa98-7802-48a7-aee3-174f9dc199a3 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:06.078380 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 25, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:06.079883 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Checking segment: {'id': 'd9db027f-68e6-458a-be8d-6bb57e6add25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': '36c1aa98-7802-48a7-aee3-174f9dc199a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:06.080524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.081175 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.081324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Bound using segment: {'id': 'd9db027f-68e6-458a-be8d-6bb57e6add25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': '36c1aa98-7802-48a7-aee3-174f9dc199a3'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:06.082080 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Bound port: 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd9db027f-68e6-458a-be8d-6bb57e6add25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': '36c1aa98-7802-48a7-aee3-174f9dc199a3'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:06.082695 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.151629 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] In _notify_port_updated(), no bound segment for port 3efc397c-4a59-43df-af58-1fb8fed789cf on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103811) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:06.152790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.153554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.155100 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "PUT /v2.0/ports/3efc397c-4a59-43df-af58-1fb8fed789cf HTTP/1.1" status: 200 len: 977 time: 3.0351079 Dec 10 14:26:06.164641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54272) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:06.180154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa0c72c0-971c-46a0-84d9-73c6e5ed614a None None] DHCP port deletion for 8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:06.211643 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] For port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:06.223065 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.228857 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] For port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd,segment=NetworkSegment(d9db027f-68e6-458a-be8d-6bb57e6add25),segment_id=d9db027f-68e6-458a-be8d-6bb57e6add25)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:06.250702 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-fa0c72c0-971c-46a0-84d9-73c6e5ed614a None None] Deleting port 39fe2430-2766-46a9-9af1-837b19f271bb {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:06.251456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fa0c72c0-971c-46a0-84d9-73c6e5ed614a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.259551 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0eb3105-f547-4ba8-bec2-7105cc043f2e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'Port': ['ID=3efc397c-4a59-43df-af58-1fb8fed789cf,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:06.300027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Deleting port 39fe2430-2766-46a9-9af1-837b19f271bb {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:06.300377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.307516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.326866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.327483 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.328401 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.328518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.328971 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.329463 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.329937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.330471 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.331314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.331547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.332009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.332650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.333198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.333834 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.334442 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.334898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.335432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.335886 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.337721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.337721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.337721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.338496 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.338496 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.338927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.339917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fa0c72c0-971c-46a0-84d9-73c6e5ed614a None None] For port 39fe2430-2766-46a9-9af1-837b19f271bb, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=39fe2430-2766-46a9-9af1-837b19f271bb,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:06.340872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fa0c72c0-971c-46a0-84d9-73c6e5ed614a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.342779 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6cc51bda-d8f7-4b4a-abad-bf7f1afbacfa tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 20872 time: 0.1738610 Dec 10 14:26:06.351275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54276) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:06.360472 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-fa0c72c0-971c-46a0-84d9-73c6e5ed614a None None] Calling delete_port for 39fe2430-2766-46a9-9af1-837b19f271bb owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:06.447858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.452115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] For port 39fe2430-2766-46a9-9af1-837b19f271bb, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=39fe2430-2766-46a9-9af1-837b19f271bb,segment=NetworkSegment(9f890aad-2e77-4afa-a708-065638c55845),segment_id=9f890aad-2e77-4afa-a708-065638c55845)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:06.452716 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.468908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Calling delete_port for 39fe2430-2766-46a9-9af1-837b19f271bb owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:06.496257 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c985e213-ebed-4c56-bd46-c17df8451258 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags HTTP/1.1" status: 200 len: 317 time: 0.7558444 Dec 10 14:26:06.499096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54280) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:06.507395 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.519018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-abed2307-3ed4-441a-b7dc-685de17c63ce tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:06.523591 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a98b7c4e-6b43-4945-87ef-560059ea48ae no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:06.550048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23342a09-a553-43cb-b22c-bdb5a854c58d None None] Pushing event updated for resources: {'Port': ['ID=0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:06.554326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: a98b7c4e-6b43-4945-87ef-560059ea48ae {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:06.554848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a98b7c4e-6b43-4945-87ef-560059ea48ae not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:06.555345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 39fe2430-2766-46a9-9af1-837b19f271bb no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:06.568560 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5be8055-15a8-4738-8c83-101adbcb66ec tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.596079 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fa0c72c0-971c-46a0-84d9-73c6e5ed614a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.613310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=a81d921c-3a7c-4e52-9114-93ef4fb5979f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:06.641750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5be8055-15a8-4738-8c83-101adbcb66ec tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event deleted for resources: {'Port': ['ID=a8faad2d-a0b7-48ff-9c67-cf1da10b948f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:06.702493 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa0c72c0-971c-46a0-84d9-73c6e5ed614a None None] No DVR routers for this DVR port 39fe2430-2766-46a9-9af1-837b19f271bb on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:06.703439 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.714500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5be8055-15a8-4738-8c83-101adbcb66ec tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.717287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa0c72c0-971c-46a0-84d9-73c6e5ed614a None None] Pushing event deleted for resources: {'Port': ['ID=39fe2430-2766-46a9-9af1-837b19f271bb,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:06.720575 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f5be8055-15a8-4738-8c83-101adbcb66ec tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "DELETE /v2.0/ports/a8faad2d-a0b7-48ff-9c67-cf1da10b948f HTTP/1.1" status: 204 len: 168 time: 1.3128150 Dec 10 14:26:06.732440 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No active binding found for port 39fe2430-2766-46a9-9af1-837b19f271bb {{(pid=103812) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 10 14:26:06.733019 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 39fe2430-2766-46a9-9af1-837b19f271bb not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:06.747907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54288) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:06.749852 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Pushing event deleted for resources: {'Port': ['ID=39fe2430-2766-46a9-9af1-837b19f271bb,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:06.755745 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d', 'external_fixed_ips': [{'subnet_id': 'f2a70a35-c6fc-4572-a861-5de01fc40935', 'ip_address': '2001:db8::60'}]}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:06.760743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] No DVR routers for this DVR port 39fe2430-2766-46a9-9af1-837b19f271bb on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:06.871297 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.911344 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['36c1aa98-7802-48a7-aee3-174f9dc199a3']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:06.933139 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd9db027f-68e6-458a-be8d-6bb57e6add25') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:06.933460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd9db027f-68e6-458a-be8d-6bb57e6add25') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:06.936690 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b8f221b1-16cc-477d-a3b0-530c786d4c14 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Deleting port 3efc397c-4a59-43df-af58-1fb8fed789cf {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:06.936690 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b8f221b1-16cc-477d-a3b0-530c786d4c14 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.945976 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:06.976732 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a3d9e68-e9c3-4301-8c5d-8ad832bddb93 req-2d5d3966-0fdb-4015-8688-62764cf5fd89 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:06.978452 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3a3d9e68-e9c3-4301-8c5d-8ad832bddb93 req-2d5d3966-0fdb-4015-8688-62764cf5fd89 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2296536 Dec 10 14:26:06.996511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8a88c7d6-baa3-4bff-a8db-78e7aa6fb066']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:07.001016 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.012626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.014050 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.036121 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9f890aad-2e77-4afa-a708-065638c55845') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:07.036498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9f890aad-2e77-4afa-a708-065638c55845') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:07.040482 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.054533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 380 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:07.054930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.057411 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:07.058517 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:07.060341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-b8f221b1-16cc-477d-a3b0-530c786d4c14 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] For port 3efc397c-4a59-43df-af58-1fb8fed789cf, host hv-neutron-8214, got binding levels [] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:07.060341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b8f221b1-16cc-477d-a3b0-530c786d4c14 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.087033 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3a3d9e68-e9c3-4301-8c5d-8ad832bddb93 req-9b3c5bb1-2239-464d-bc76-e9e662b78eaa tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1010664 Dec 10 14:26:07.088500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.094716 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Releasing vlan 371 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:07.095112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:07.096777 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:07.148198 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-abed2307-3ed4-441a-b7dc-685de17c63ce tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags HTTP/1.1" status: 204 len: 168 time: 0.6423781 Dec 10 14:26:07.150936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b8f221b1-16cc-477d-a3b0-530c786d4c14 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Calling delete_port for 3efc397c-4a59-43df-af58-1fb8fed789cf owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:07.151818 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54298) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.157264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-8a59569a-38fa-407e-a15f-86f006e876cd tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc', 'tempest-TagsExtTest-Tag-2041533229') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:07.227549 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:26:07.227549 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:26:07.227549 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': '36c1aa98-7802-48a7-aee3-174f9dc199a3'}] Dec 10 14:26:07.227549 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:26:07.227962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:26:07.245338 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.292451 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54302) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.308051 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port bc425151-c37a-4f55-b82a-4767b22938c1 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:07.308596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.311768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.316061 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.319428 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] 10.222.0.57 "DELETE /v2.0/networks/8a88c7d6-baa3-4bff-a8db-78e7aa6fb066 HTTP/1.1" status: 204 len: 168 time: 1.4666300 Dec 10 14:26:07.336432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59eb4238-ced7-419f-be76-cfa310af08ef admin admin] Pushing event deleted for resources: {'Network': ['ID=8a88c7d6-baa3-4bff-a8db-78e7aa6fb066,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:07.352208 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-8a59569a-38fa-407e-a15f-86f006e876cd tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:07.356376 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8a59569a-38fa-407e-a15f-86f006e876cd tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags/tempest-TagsExtTest-Tag-2041533229 HTTP/1.1" status: 404 len: 329 time: 0.2033536 Dec 10 14:26:07.357011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54308) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.363318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-7b03fb48-4be9-4a34-9246-631145ada0a1 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc', 'tempest-TagsExtTest-Tag-2027019828') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:07.372172 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd6da2dc-f618-40b4-9c64-e307b2afa2f9 req-057bb717-e893-4910-9236-bdfd96fbb322 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:07.373737 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cd6da2dc-f618-40b4-9c64-e307b2afa2f9 req-057bb717-e893-4910-9236-bdfd96fbb322 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2124681 Dec 10 14:26:07.406485 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b8f221b1-16cc-477d-a3b0-530c786d4c14 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.492731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ce778a2f-4991-4ac9-ac07-b05f986bd56f tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Request body: {'quota': {'network': 0, 'port': 0}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:07.496295 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f221b1-16cc-477d-a3b0-530c786d4c14 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event deleted for resources: {'Port': ['ID=3efc397c-4a59-43df-af58-1fb8fed789cf,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:07.500219 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b8f221b1-16cc-477d-a3b0-530c786d4c14 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.506264 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b8f221b1-16cc-477d-a3b0-530c786d4c14 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "DELETE /v2.0/ports/3efc397c-4a59-43df-af58-1fb8fed789cf HTTP/1.1" status: 204 len: 168 time: 1.1537969 Dec 10 14:26:07.515799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54310) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.519106 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.541993 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.557217 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for bc425151-c37a-4f55-b82a-4767b22938c1 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:07.561974 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-d703c9d1-f53e-4436-9fe1-a6e1ca750b85 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] GET failed (client error): The resource could not be found. Dec 10 14:26:07.563494 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d703c9d1-f53e-4436-9fe1-a6e1ca750b85 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "GET /v2.0/ports/3efc397c-4a59-43df-af58-1fb8fed789cf HTTP/1.1" status: 404 len: 333 time: 0.0464392 Dec 10 14:26:07.567697 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54312) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.576277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1475357747', 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:07.650611 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cd6da2dc-f618-40b4-9c64-e307b2afa2f9 req-08081169-0f05-4fb6-a824-e9240b6289b8 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2405579 Dec 10 14:26:07.659972 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-7b03fb48-4be9-4a34-9246-631145ada0a1 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:07.661055 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7b03fb48-4be9-4a34-9246-631145ada0a1 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags/tempest-TagsExtTest-Tag-2027019828 HTTP/1.1" status: 404 len: 329 time: 0.3015370 Dec 10 14:26:07.674255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54314) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.695566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.717927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-b07954dd-6053-4c27-9374-a8b633238883 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc', 'tempest-TagsExtTest-Tag-576462805') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:07.731628 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Made reservation on behalf of ea35a951bf5c4706970400d2939b7ccc for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:07.733922 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.744842 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54318) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.772573 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.777466 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ce778a2f-4991-4ac9-ac07-b05f986bd56f tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] 10.222.0.57 "PUT /v2.0/quotas/71f6efcbe63446fa92d531a8c4aa6357 HTTP/1.1" status: 200 len: 366 time: 0.4811275 Dec 10 14:26:07.779371 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54320) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.784855 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b8c1d97-dd98-409f-b054-f6882204028f None None] Network 36c1aa98-7802-48a7-aee3-174f9dc199a3 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:07.800054 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2df9be60-6cae-4774-8041-c4309f886e3f tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] 10.222.0.57 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 732 time: 0.0171456 Dec 10 14:26:07.808592 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54322) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.829791 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] device_id is not set on port 872c55e1-c256-4b81-9ac0-71c682c9c03d yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:07.840109 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55224d29-1bc3-4751-a00c-d3c48e3f405a req-5c482bc6-1581-4d9c-9f3f-9a1906e5b7ae tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:07.841614 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-55224d29-1bc3-4751-a00c-d3c48e3f405a req-5c482bc6-1581-4d9c-9f3f-9a1906e5b7ae tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1099808 Dec 10 14:26:07.862372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54324) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:07.862679 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-417b059e-9c52-4603-86d4-00a05bc06dd2 tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] 10.222.0.57 "GET /v2.0/quotas/71f6efcbe63446fa92d531a8c4aa6357 HTTP/1.1" status: 200 len: 366 time: 0.0501575 Dec 10 14:26:07.888599 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7e25c29a-f071-4c7d-a259-20df57fdfbdd None None] Provisioning complete for port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:07.889618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7e25c29a-f071-4c7d-a259-20df57fdfbdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:07.920371 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-55224d29-1bc3-4751-a00c-d3c48e3f405a req-42ce2995-f684-493b-bd62-40a75eed2866 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0700309 Dec 10 14:26:08.021695 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-538af9d7-3eff-4d02-a1e9-2f1aaaed7d9d tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] 10.222.0.57 "DELETE /v2.0/quotas/71f6efcbe63446fa92d531a8c4aa6357 HTTP/1.1" status: 204 len: 168 time: 0.1508863 Dec 10 14:26:08.032788 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f1b13303-4a1a-4f25-b63b-6813088ac7fc admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=af5207bd54c6403799a8cc223fa0ea80&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2557831 Dec 10 14:26:08.033502 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54328) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:08.033838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54330) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:08.080191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bff0cab4-1c8f-4a61-a3c7-31c7f4cca533 None None] DHCP port deletion for 36c1aa98-7802-48a7-aee3-174f9dc199a3 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:08.080752 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-b07954dd-6053-4c27-9374-a8b633238883 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:08.084328 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b07954dd-6053-4c27-9374-a8b633238883 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags/tempest-TagsExtTest-Tag-576462805 HTTP/1.1" status: 404 len: 328 time: 0.3697088 Dec 10 14:26:08.092388 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-36a83b11-316f-4766-9c3d-cd538a01a78a tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] 10.222.0.57 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 470 time: 0.0483973 Dec 10 14:26:08.096369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54332) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:08.096630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54334) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:08.122196 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-37602c7d-6157-46f3-b58b-35ab54f822fe tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59', {'tags': ['tempest-TagsExtTest-Tag-9667577', 'tempest-TagsExtTest-Tag-18247243', 'tempest-TagsExtTest-Tag-1776006152']}) {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:08.153996 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4836825-89c5-4e0b-8a32-134bcbbadd04 req-77fa2f01-5d57-4357-8932-4fe46614066e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:08.155482 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e4836825-89c5-4e0b-8a32-134bcbbadd04 req-77fa2f01-5d57-4357-8932-4fe46614066e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.0960870 Dec 10 14:26:08.156821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.178396 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7e25c29a-f071-4c7d-a259-20df57fdfbdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.178646 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.215819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7e25c29a-f071-4c7d-a259-20df57fdfbdd None None] For port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd,segment=NetworkSegment(d9db027f-68e6-458a-be8d-6bb57e6add25),segment_id=d9db027f-68e6-458a-be8d-6bb57e6add25)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:08.216375 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-74e88de2-8d11-442b-986a-7506cb36a8e0 tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] 10.222.0.57 "GET /v2.0/quotas/71f6efcbe63446fa92d531a8c4aa6357 HTTP/1.1" status: 200 len: 370 time: 0.0992043 Dec 10 14:26:08.230933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54338) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:08.231124 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-bff0cab4-1c8f-4a61-a3c7-31c7f4cca533 None None] Deleting port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:08.231462 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bff0cab4-1c8f-4a61-a3c7-31c7f4cca533 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.240698 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-90343cc0-8b6a-4141-ab41-abf48ceb9554 tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] 10.222.0.57 "GET /v2.0/quotas/71f6efcbe63446fa92d531a8c4aa6357/default HTTP/1.1" status: 200 len: 370 time: 0.0069759 Dec 10 14:26:08.255200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54340) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:08.267713 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:08.268811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.303757 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e4836825-89c5-4e0b-8a32-134bcbbadd04 req-b59c0bdc-539c-4518-bdb8-d490801cacc6 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1275666 Dec 10 14:26:08.303967 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7e25c29a-f071-4c7d-a259-20df57fdfbdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.327727 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-01565987-3fbe-416b-b018-7bcc25620ad8 tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] delete failed (client error): The resource could not be found. Dec 10 14:26:08.328879 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-01565987-3fbe-416b-b018-7bcc25620ad8 tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] 10.222.0.57 "DELETE /v2.0/quotas/71f6efcbe63446fa92d531a8c4aa6357 HTTP/1.1" status: 404 len: 348 time: 0.0752921 Dec 10 14:26:08.333875 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.348272 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.365587 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd8d1f28-4da6-41f6-b868-889b897d7049 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.370455 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e25c29a-f071-4c7d-a259-20df57fdfbdd None None] Pushing event updated for resources: {'Port': ['ID=0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:08.371621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-bff0cab4-1c8f-4a61-a3c7-31c7f4cca533 None None] For port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd,segment=NetworkSegment(d9db027f-68e6-458a-be8d-6bb57e6add25),segment_id=d9db027f-68e6-458a-be8d-6bb57e6add25)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:08.372270 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bff0cab4-1c8f-4a61-a3c7-31c7f4cca533 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.388797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-bff0cab4-1c8f-4a61-a3c7-31c7f4cca533 None None] Calling delete_port for 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:08.415310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=bc425151-c37a-4f55-b82a-4767b22938c1,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:08.428822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd,segment=NetworkSegment(d9db027f-68e6-458a-be8d-6bb57e6add25),segment_id=d9db027f-68e6-458a-be8d-6bb57e6add25)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:08.429188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.443947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Allocated IP 2001:db8::60 (86dcd512-65b5-48d0-925b-b7b236a1690d/f2a70a35-c6fc-4572-a861-5de01fc40935/08b6ee99-abc3-45fe-aa40-a46a36116494) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:08.455186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd8d1f28-4da6-41f6-b868-889b897d7049 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.486764 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-37602c7d-6157-46f3-b58b-35ab54f822fe tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "PUT /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags HTTP/1.1" status: 200 len: 313 time: 0.3707926 Dec 10 14:26:08.492176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:08.497266 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54346) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:08.519139 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-b2edce49-fdab-4612-ada6-b82268b79cf0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:08.568949 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bff0cab4-1c8f-4a61-a3c7-31c7f4cca533 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.604416 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bff0cab4-1c8f-4a61-a3c7-31c7f4cca533 None None] No DVR routers for this DVR port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:08.632509 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.637937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff0cab4-1c8f-4a61-a3c7-31c7f4cca533 None None] Pushing event deleted for resources: {'Port': ['ID=0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:08.658501 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.773899 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.792657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd8d1f28-4da6-41f6-b868-889b897d7049 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.795415 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd8d1f28-4da6-41f6-b868-889b897d7049 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.799324 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bd8d1f28-4da6-41f6-b868-889b897d7049 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/a9e21142-577f-4b62-9a60-709b4b2f57e7 HTTP/1.1" status: 204 len: 168 time: 0.7464342 Dec 10 14:26:08.800784 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Network 5c0f5153-b96e-46db-aaab-a604f5138cfd is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:08.830136 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54350) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:08.858025 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:08.860661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:08.861849 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:08.862520 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.885515 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd8d1f28-4da6-41f6-b868-889b897d7049 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9e21142-577f-4b62-9a60-709b4b2f57e7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:08.901407 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b2edce49-fdab-4612-ada6-b82268b79cf0 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags HTTP/1.1" status: 204 len: 168 time: 0.3858006 Dec 10 14:26:08.908388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54352) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:08.916823 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-7a0a53ff-13ae-4ef5-b029-4945aae3f88b tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59', 'tempest-TagsExtTest-Tag-9667577') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:08.922403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'Port': ['ID=872c55e1-c256-4b81-9ac0-71c682c9c03d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:08.942666 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.950756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Usage tracker for resource:network and project:20411f282057448393dc0529d42892be is out of sync, need to count used quota {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 10 14:26:08.982312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:08.986981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 10 14:26:08.996808 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-39f06bd6-4de2-4993-82a2-550c67b2dd59 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.4280047 Dec 10 14:26:08.999631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port 0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:09.000002 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54354) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:09.003808 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=0e5d2cb4-4f71-41e3-b780-1e0c9a06b3dd,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:09.034420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5111902-f3d0-4622-a6e9-bd523a139bf0 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:09.036653 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c5111902-f3d0-4622-a6e9-bd523a139bf0 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "GET /v2.0/ports/872c55e1-c256-4b81-9ac0-71c682c9c03d HTTP/1.1" status: 200 len: 955 time: 0.0351758 Dec 10 14:26:09.039844 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54356) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:09.062514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.068212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Usage tracker for resource:subnet and project:20411f282057448393dc0529d42892be is out of sync, need to count used quota {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 10 14:26:09.070135 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-7a0a53ff-13ae-4ef5-b029-4945aae3f88b tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:09.074493 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7a0a53ff-13ae-4ef5-b029-4945aae3f88b tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags/tempest-TagsExtTest-Tag-9667577 HTTP/1.1" status: 404 len: 326 time: 0.1589372 Dec 10 14:26:09.078258 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54358) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:09.099233 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-0bd63159-5891-4d46-bb55-63c6e049e985 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59', 'tempest-TagsExtTest-Tag-18247243') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:09.123630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 10 14:26:09.126601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Network 86dcd512-65b5-48d0-925b-b7b236a1690d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:09.155709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.155933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:09.159781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Usage tracker for resource:subnetpool and project:20411f282057448393dc0529d42892be is out of sync, need to count used quota {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 10 14:26:09.166746 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:09.170699 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event updated for resources: {'Port': ['ID=08b6ee99-abc3-45fe-aa40-a46a36116494,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:09.204999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Quota usage for subnetpool was recalculated. Used quota:0. {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 10 14:26:09.222243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['36c1aa98-7802-48a7-aee3-174f9dc199a3']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:09.235924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Usage tracker for resource:port and project:20411f282057448393dc0529d42892be is out of sync, need to count used quota {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 10 14:26:09.241083 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd9db027f-68e6-458a-be8d-6bb57e6add25') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:09.241379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd9db027f-68e6-458a-be8d-6bb57e6add25') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:09.246288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 10 14:26:09.255039 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-0bd63159-5891-4d46-bb55-63c6e049e985 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:09.260323 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0bd63159-5891-4d46-bb55-63c6e049e985 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags/tempest-TagsExtTest-Tag-18247243 HTTP/1.1" status: 404 len: 327 time: 0.1633713 Dec 10 14:26:09.261820 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54362) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:09.263645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.286368 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-8ce43ee3-cc36-4257-a014-d30a92293868 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59', 'tempest-TagsExtTest-Tag-1776006152') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:09.289483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Usage tracker for resource:router and project:20411f282057448393dc0529d42892be is out of sync, need to count used quota {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 10 14:26:09.307111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-c37871b9-9713-4bdd-9bcd-082c37528d04 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Deleting port 872c55e1-c256-4b81-9ac0-71c682c9c03d {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:09.307450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c37871b9-9713-4bdd-9bcd-082c37528d04 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.318983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 10 14:26:09.323353 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.337514 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 380 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:09.350293 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:09.359066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Usage tracker for resource:floatingip and project:20411f282057448393dc0529d42892be is out of sync, need to count used quota {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 10 14:26:09.445005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c37871b9-9713-4bdd-9bcd-082c37528d04 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.446609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 10 14:26:09.472012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-c37871b9-9713-4bdd-9bcd-082c37528d04 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Calling delete_port for 872c55e1-c256-4b81-9ac0-71c682c9c03d owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:09.496524 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-8ce43ee3-cc36-4257-a014-d30a92293868 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] show failed (client error): The resource could not be found. Dec 10 14:26:09.497622 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8ce43ee3-cc36-4257-a014-d30a92293868 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags/tempest-TagsExtTest-Tag-1776006152 HTTP/1.1" status: 404 len: 329 time: 0.2321050 Dec 10 14:26:09.506925 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54370) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:09.512949 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-98103bb1-3a05-4aaf-a9b0-792326a3b8cd tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '1eeb4216-3b6f-47b0-a64a-94e4ef355f59') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:09.571275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.580361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.583229 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.590546 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/36c1aa98-7802-48a7-aee3-174f9dc199a3 HTTP/1.1" status: 204 len: 168 time: 4.2315187 Dec 10 14:26:09.598851 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54374) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:09.616889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-147338370'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:09.630070 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e91829-6b05-4a6c-a16d-6ccb478579e0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=36c1aa98-7802-48a7-aee3-174f9dc199a3,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:09.661406 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router a9d6ff8f-6f21-4d81-bd51-c184c2a50541 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:26:09.666085 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-98103bb1-3a05-4aaf-a9b0-792326a3b8cd tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59/tags HTTP/1.1" status: 204 len: 168 time: 0.1573775 Dec 10 14:26:09.670814 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54376) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:09.677769 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-cfa779bd-d09e-4068-bf85-b38612ab3a9a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '6ef1e570-ade8-45c5-bd58-68e1221589cc') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:09.684330 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Usage tracker for resource:security_group and project:20411f282057448393dc0529d42892be is out of sync, need to count used quota {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 10 14:26:09.692915 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 10 14:26:09.740230 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Usage tracker for resource:security_group_rule and project:20411f282057448393dc0529d42892be is out of sync, need to count used quota {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 10 14:26:09.746890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:09.750469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.754762 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.quota.resource [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103810) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 10 14:26:09.770412 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a16a5f3c-95a7-43ea-b012-99b14882abcd tempest-QuotasTest-2048952171 tempest-QuotasTest-2048952171-project-admin] 10.222.0.57 "GET /v2.0/quotas/20411f282057448393dc0529d42892be/details.json HTTP/1.1" status: 200 len: 703 time: 0.9138312 Dec 10 14:26:09.830694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c37871b9-9713-4bdd-9bcd-082c37528d04 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.845355 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cfa779bd-d09e-4068-bf85-b38612ab3a9a tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc/tags HTTP/1.1" status: 204 len: 168 time: 0.1722500 Dec 10 14:26:09.875192 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54384) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:09.880165 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-308c215f-ccb1-4bb7-9032-e513c2289e73 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:09.884765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c37871b9-9713-4bdd-9bcd-082c37528d04 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event deleted for resources: {'Port': ['ID=872c55e1-c256-4b81-9ac0-71c682c9c03d,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:09.937246 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c37871b9-9713-4bdd-9bcd-082c37528d04 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:09.941041 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c37871b9-9713-4bdd-9bcd-082c37528d04 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "DELETE /v2.0/ports/872c55e1-c256-4b81-9ac0-71c682c9c03d HTTP/1.1" status: 204 len: 168 time: 0.9006696 Dec 10 14:26:09.947354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54388) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:09.992055 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-0f6ac6be-7531-4e45-a759-c3e7e325980e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] GET failed (client error): The resource could not be found. Dec 10 14:26:09.993538 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0f6ac6be-7531-4e45-a759-c3e7e325980e tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "GET /v2.0/ports/872c55e1-c256-4b81-9ac0-71c682c9c03d HTTP/1.1" status: 404 len: 333 time: 0.0452044 Dec 10 14:26:09.999674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54390) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:10.005845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Request body: {'port': {'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-637439251'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:10.012292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.086175 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-308c215f-ccb1-4bb7-9032-e513c2289e73 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2/tags HTTP/1.1" status: 204 len: 168 time: 0.2096865 Dec 10 14:26:10.089311 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54394) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:10.095534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-98b19c17-3d1a-4085-bd5d-3b53f22aaad6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', 'ec8ef166-737b-4e91-ad59-1413d9d87545') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:10.159405 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Made reservation on behalf of ea35a951bf5c4706970400d2939b7ccc for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:10.162833 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.167053 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 360, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:10.184323 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.184464 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment 4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63 of type vlan for network 61cd8ab1-c210-4b89-8018-e6c2f32e1e85 Dec 10 14:26:10.186548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:10.201067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54400) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:10.201204 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-95135883-df6d-40c2-991f-60d6c2d6fced tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/routers/a9d6ff8f-6f21-4d81-bd51-c184c2a50541/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1961975 Dec 10 14:26:10.205550 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47fb51fc-e681-4309-ae1f-d1aa01674556 None None] Sync routers for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:10.207124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] device_id is not set on port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:10.216246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47fb51fc-e681-4309-ae1f-d1aa01674556 None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:10.216876 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-47fb51fc-e681-4309-ae1f-d1aa01674556 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:10.282439 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.286846 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-47fb51fc-e681-4309-ae1f-d1aa01674556 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:10.300946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47fb51fc-e681-4309-ae1f-d1aa01674556 None None] Routers {'a9d6ff8f-6f21-4d81-bd51-c184c2a50541'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:10.301607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-47fb51fc-e681-4309-ae1f-d1aa01674556 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:10.307405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54402) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:10.353632 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-47fb51fc-e681-4309-ae1f-d1aa01674556 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:10.354304 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47fb51fc-e681-4309-ae1f-d1aa01674556 None None] The sync data for ids ['a9d6ff8f-6f21-4d81-bd51-c184c2a50541'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:10.389329 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.395558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:10.396270 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.449124 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-98b19c17-3d1a-4085-bd5d-3b53f22aaad6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545/tags HTTP/1.1" status: 204 len: 168 time: 0.3585587 Dec 10 14:26:10.455491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54408) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:10.486947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.502063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6f40086-b621-4c08-aa94-8d72f95f428c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.531002 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Router dbde97c0-467c-4687-8462-adb1edd4840c is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:26:10.533427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=61cd8ab1-c210-4b89-8018-e6c2f32e1e85,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:10.549248 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7a6f3cac-1e69-4635-82fa-335b4600370b tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.9484625 Dec 10 14:26:10.551393 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 61cd8ab1-c210-4b89-8018-e6c2f32e1e85 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:10.558277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54410) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:10.566558 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': '61cd8ab1-c210-4b89-8018-e6c2f32e1e85', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:10.635052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6f40086-b621-4c08-aa94-8d72f95f428c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.678343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f481a34-9b1b-48f4-8ae5-cc4569d39315 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for subnetpool, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.679540 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9f481a34-9b1b-48f4-8ae5-cc4569d39315 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnetpools/1eeb4216-3b6f-47b0-a64a-94e4ef355f59 HTTP/1.1" status: 204 len: 168 time: 0.2213550 Dec 10 14:26:10.687105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54416) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:10.715379 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-25fbbf7f-2ffd-49aa-8653-bd5c104813ee tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "GET /v2.0/ports?device_id=6ef1e570-ade8-45c5-bd58-68e1221589cc HTTP/1.1" status: 200 len: 205 time: 0.0268745 Dec 10 14:26:10.716346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6f40086-b621-4c08-aa94-8d72f95f428c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.718881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54418) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:10.828902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-adfa45d2-fd22-4c0c-a718-69d9d6063112 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:10.835143 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c6f40086-b621-4c08-aa94-8d72f95f428c admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=13cf6f07c37149ec89e10cfcc4efa5fc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5239794 Dec 10 14:26:10.835143 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f40086-b621-4c08-aa94-8d72f95f428c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb1ff41c-4214-4af7-9461-311c6b310a43,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:10.870858 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54422) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:10.969483 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.028876 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-adfa45d2-fd22-4c0c-a718-69d9d6063112 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.032511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-adfa45d2-fd22-4c0c-a718-69d9d6063112 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.047778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d85d5000-1ae1-44f6-af61-f6c673753cda admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.081692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54428) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:11.112289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d85d5000-1ae1-44f6-af61-f6c673753cda admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.133044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.155604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:11.157557 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-adfa45d2-fd22-4c0c-a718-69d9d6063112 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.158126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-adfa45d2-fd22-4c0c-a718-69d9d6063112 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Fanout notify agent at l3_agent the message router_deleted on router 6ef1e570-ade8-45c5-bd58-68e1221589cc {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:11.167102 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-adfa45d2-fd22-4c0c-a718-69d9d6063112 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.171017 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Sync routers for ids ['dbde97c0-467c-4687-8462-adb1edd4840c'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:11.171603 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-adfa45d2-fd22-4c0c-a718-69d9d6063112 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/routers/6ef1e570-ade8-45c5-bd58-68e1221589cc HTTP/1.1" status: 204 len: 168 time: 0.4503860 Dec 10 14:26:11.174058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54432) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:11.182860 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Routers {'dbde97c0-467c-4687-8462-adb1edd4840c'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:11.183905 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dbde97c0-467c-4687-8462-adb1edd4840c'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:11.236034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:11.239760 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.258054 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-test-network-841373850'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:11.268115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d85d5000-1ae1-44f6-af61-f6c673753cda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.270714 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d85d5000-1ae1-44f6-af61-f6c673753cda admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.271832 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d85d5000-1ae1-44f6-af61-f6c673753cda admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/bb1ff41c-4214-4af7-9461-311c6b310a43 HTTP/1.1" status: 204 len: 168 time: 0.3996472 Dec 10 14:26:11.294510 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.296764 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-673bbd2b-433a-42c2-89be-f36beaa1f1b6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Deleting port fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:11.297074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-673bbd2b-433a-42c2-89be-f36beaa1f1b6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.310290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.314122 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-011d5398-9b56-4085-b1b7-498ca607c48c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 877 time: 4.5616376 Dec 10 14:26:11.316359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54436) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:11.326491 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Set router dbde97c0-467c-4687-8462-adb1edd4840c gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:26:11.386538 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-673bbd2b-433a-42c2-89be-f36beaa1f1b6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.398874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-673bbd2b-433a-42c2-89be-f36beaa1f1b6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Calling delete_port for fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:11.403322 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d85d5000-1ae1-44f6-af61-f6c673753cda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb1ff41c-4214-4af7-9461-311c6b310a43,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:11.458475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Network 5c0f5153-b96e-46db-aaab-a604f5138cfd is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:11.475839 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:11.484734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:11.485778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:11.491328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.491462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Made reservation on behalf of 98ab9e3fd19b478393c39883394fc9da for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:11.491995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.493120 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'Port': ['ID=b94a3d2c-70d7-483a-9a04-e682bcaf76d2,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:11.509479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.575498 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbde97c0-467c-4687-8462-adb1edd4840c', 'name': '', 'tenant_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d', 'external_fixed_ips': [{'subnet_id': 'f2a70a35-c6fc-4572-a861-5de01fc40935', 'ip_address': '2001:db8::60'}], 'enable_snat': True}, 'gw_port_id': '08b6ee99-abc3-45fe-aa40-a46a36116494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:26:07Z', 'updated_at': '2021-12-10T14:26:09Z', 'revision_number': 3, 'project_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'gw_port': {'id': '08b6ee99-abc3-45fe-aa40-a46a36116494', 'name': '', 'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:02:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbde97c0-467c-4687-8462-adb1edd4840c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': 'f2a70a35-c6fc-4572-a861-5de01fc40935', 'ip_address': '2001:db8::60', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:26:08Z', 'updated_at': '2021-12-10T14:26:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f2a70a35-c6fc-4572-a861-5de01fc40935', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:11.591136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port e8996883-538c-4dc5-867d-b29c37005f9c {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:11.591398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.596651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.617342 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Checking router: dbde97c0-467c-4687-8462-adb1edd4840c for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:26:11.617743 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Updating router dbde97c0-467c-4687-8462-adb1edd4840c port 08b6ee99-abc3-45fe-aa40-a46a36116494 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:26:11.632894 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.643883 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.680097 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9692acb4-e3b9-4a34-93e5-468aa1921134 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 959 time: 1.6754310 Dec 10 14:26:11.680388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54438) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:11.686813 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:11.708445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-673bbd2b-433a-42c2-89be-f36beaa1f1b6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.720347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.773888 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] vlan segment allocate from pool success with {'vlan_id': 353, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:11.782822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-673bbd2b-433a-42c2-89be-f36beaa1f1b6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Pushing event deleted for resources: {'Port': ['ID=fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:11.821245 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.843000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for e8996883-538c-4dc5-867d-b29c37005f9c owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:11.845316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.873140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3e8e1eb5-e2d3-4255-a76b-25aa6068784d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:11.879740 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.880098 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Added segment d9fb5c1e-4a9f-433f-8c8a-4da5f824a58b of type vlan for network 43123a64-63e8-41a8-a5f9-b7b478de3cbc Dec 10 14:26:11.892713 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.949656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.953978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-673bbd2b-433a-42c2-89be-f36beaa1f1b6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:11.957479 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-673bbd2b-433a-42c2-89be-f36beaa1f1b6 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/ports/fb4577a0-3d4d-43f3-beb0-b3ab9d5989a2 HTTP/1.1" status: 204 len: 168 time: 0.7839878 Dec 10 14:26:11.960250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54442) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:12.012601 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.065763 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-bd776978-5dec-4217-b41b-50c20728cb65 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Deleting subnet ec8ef166-737b-4e91-ad59-1413d9d87545 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:26:12.069629 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bd776978-5dec-4217-b41b-50c20728cb65 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.094522 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.100262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:12.100850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.101183 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.144526 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.196800 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Pushing event updated for resources: {'Port': ['ID=08b6ee99-abc3-45fe-aa40-a46a36116494,revision_number=2']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:12.198927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] device_id is not set on port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:12.204647 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bd776978-5dec-4217-b41b-50c20728cb65 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.207514 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.208270 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.208820 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.209325 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.209849 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.212045 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.212045 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.212045 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.212281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.212879 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.212879 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.212879 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.213612 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.214057 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:12.217496 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 802 time: 1.1323800 Dec 10 14:26:12.218108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330242a5-3c44-470e-aae5-4b051ef6f415 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Pushing event updated for resources: {'Network': ['ID=43123a64-63e8-41a8-a5f9-b7b478de3cbc,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:12.238361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 43123a64-63e8-41a8-a5f9-b7b478de3cbc details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:12.247876 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Attempting to bind port 08b6ee99-abc3-45fe-aa40-a46a36116494 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.252967 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Attempting to bind port 08b6ee99-abc3-45fe-aa40-a46a36116494 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '5ddd761f-1d0b-42c3-8f44-6cda32ad0add', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.253486 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Attempting to bind port 08b6ee99-abc3-45fe-aa40-a46a36116494 on network 86dcd512-65b5-48d0-925b-b7b236a1690d {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.268087 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.272524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=80b1af56-f290-4199-a044-f456fb3c2007,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:12.274167 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:12.275940 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Checking segment: {'id': '5ddd761f-1d0b-42c3-8f44-6cda32ad0add', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:12.276515 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.279231 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Bound using segment: {'id': '5ddd761f-1d0b-42c3-8f44-6cda32ad0add', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:12.280575 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Bound port: 08b6ee99-abc3-45fe-aa40-a46a36116494, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5ddd761f-1d0b-42c3-8f44-6cda32ad0add', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '86dcd512-65b5-48d0-925b-b7b236a1690d'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:12.281882 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.312426 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': '4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '61cd8ab1-c210-4b89-8018-e6c2f32e1e85'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:12.312783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: 61cd8ab1-c210-4b89-8018-e6c2f32e1e85, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:12.346530 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54448) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:12.357557 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.375919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Deleting port 08b6ee99-abc3-45fe-aa40-a46a36116494 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:12.376255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.388999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-13bf42d8-513d-42eb-bf57-ad5002003426 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.401926 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] For port 08b6ee99-abc3-45fe-aa40-a46a36116494, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:12.406057 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] For port 08b6ee99-abc3-45fe-aa40-a46a36116494, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=08b6ee99-abc3-45fe-aa40-a46a36116494,segment=NetworkSegment(5ddd761f-1d0b-42c3-8f44-6cda32ad0add),segment_id=5ddd761f-1d0b-42c3-8f44-6cda32ad0add)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:12.414868 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=e8996883-538c-4dc5-867d-b29c37005f9c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:12.432167 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'Port': ['ID=b94a3d2c-70d7-483a-9a04-e682bcaf76d2,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:12.432648 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85a789b2-ee6d-4594-bdd8-f185e24f67a8 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:12.436244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.436781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.437281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.451714 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.452116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bd776978-5dec-4217-b41b-50c20728cb65 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.452654 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.454985 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 2 to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 Dec 10 14:26:12.484096 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.493114 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.493785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.494751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.505973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.506312 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.507721 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 3 to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 Dec 10 14:26:12.522681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.523578 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.523936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.535472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.536242 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.539290 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 4 to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 Dec 10 14:26:12.569007 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.569679 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.570212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.574482 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-13bf42d8-513d-42eb-bf57-ad5002003426 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.578046 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.579190 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.579802 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.580407 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 5 to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 Dec 10 14:26:12.588413 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 61cd8ab1-c210-4b89-8018-e6c2f32e1e85 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:12.593463 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Routers {'dbde97c0-467c-4687-8462-adb1edd4840c'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:12.594985 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.595346 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dbde97c0-467c-4687-8462-adb1edd4840c'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:12.595792 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.596336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.601279 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b17e9c8-432c-4405-94ac-bcdce51e1b32 None None] Pushing event updated for resources: {'Port': ['ID=08b6ee99-abc3-45fe-aa40-a46a36116494,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:12.602825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.603387 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.603935 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 6 to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 Dec 10 14:26:12.620113 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.620736 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.621321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.622570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.627346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.627851 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.628395 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 7 to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 Dec 10 14:26:12.643390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.643737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.644071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.648827 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.649178 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.650778 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 8 to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 Dec 10 14:26:12.673515 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-13bf42d8-513d-42eb-bf57-ad5002003426 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.673616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54450) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:12.679518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.679862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.680198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.701074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Calling delete_port for 08b6ee99-abc3-45fe-aa40-a46a36116494 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:12.707751 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Request body: {'port': {'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc', 'binding:host_id': 'hv-neutron-8214', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112982130'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:12.710278 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.710406 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.713468 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 9 to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 Dec 10 14:26:12.714884 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.721276 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-13bf42d8-513d-42eb-bf57-ad5002003426 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=20411f282057448393dc0529d42892be&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3660722 Dec 10 14:26:12.721276 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13bf42d8-513d-42eb-bf57-ad5002003426 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4faddf83-fb16-4fd8-8159-d405f739f723,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:12.721577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.723279 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] Set router dbde97c0-467c-4687-8462-adb1edd4840c gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:26:12.725599 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54452) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:12.736368 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.736704 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.741747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.750663 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.750879 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.751247 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempt 10 to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 Dec 10 14:26:12.766667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:12.767153 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:12.767525 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempting to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:12.772925 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:12.773346 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Failed to bind port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on host hv-neutron-8214 for vnic_type normal using segments [{'id': '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '5c0f5153-b96e-46db-aaab-a604f5138cfd'}] Dec 10 14:26:12.773841 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.818870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bd776978-5dec-4217-b41b-50c20728cb65 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.820747 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 61cd8ab1-c210-4b89-8018-e6c2f32e1e85) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:12.834018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d820fb4-9239-4baa-8085-77acccf3d7a5 None None] Network 61cd8ab1-c210-4b89-8018-e6c2f32e1e85 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:12.847288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] For port b94a3d2c-70d7-483a-9a04-e682bcaf76d2, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:12.847657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attempted to set empty binding levels {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 10 14:26:12.878048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:12.878557 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.881252 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbde97c0-467c-4687-8462-adb1edd4840c', 'name': '', 'tenant_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:26:07Z', 'updated_at': '2021-12-10T14:26:11Z', 'revision_number': 4, 'project_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:12.887364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd776978-5dec-4217-b41b-50c20728cb65 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Pushing event deleted for resources: {'Subnet': ['ID=ec8ef166-737b-4e91-ad59-1413d9d87545,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:12.903476 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bd776978-5dec-4217-b41b-50c20728cb65 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.909373 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bd776978-5dec-4217-b41b-50c20728cb65 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/subnets/ec8ef166-737b-4e91-ad59-1413d9d87545 HTTP/1.1" status: 204 len: 168 time: 0.9468029 Dec 10 14:26:12.909717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54454) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:12.910088 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b44f6d7-77eb-41b0-bba9-82e9ee8e2d6d None None] The sync data for ids ['dbde97c0-467c-4687-8462-adb1edd4840c'] in dv-neutron-821401-2-hyperv is: [{'id': 'dbde97c0-467c-4687-8462-adb1edd4840c', 'name': '', 'tenant_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:26:07Z', 'updated_at': '2021-12-10T14:26:11Z', 'revision_number': 4, 'project_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'gw_port_host': None}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:12.913635 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ca11958-3127-4ccc-8190-0330ffd1bc88 None None] Network 7e45316e-5348-48a4-ba91-b71be829572c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:12.922827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Made reservation on behalf of 73dc370c75ab42df98c43f1e3c0887e7 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:12.925284 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.927962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.928779 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.928906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Fanout notify agent at l3_agent the message router_deleted on router a9d6ff8f-6f21-4d81-bd51-c184c2a50541 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:12.962765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.968342 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-106ec19a-5b1c-43f2-8596-71c30c00cbac tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/routers/a9d6ff8f-6f21-4d81-bd51-c184c2a50541 HTTP/1.1" status: 204 len: 168 time: 2.7615995 Dec 10 14:26:12.972344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:12.974557 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54456) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:13.012729 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-61cd8ab1-c210-4b89-8018-e6c2f32e1e85', 'network_id': '61cd8ab1-c210-4b89-8018-e6c2f32e1e85', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': '80b1af56-f290-4199-a044-f456fb3c2007'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:13.013962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.028644 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] In _notify_port_updated(), no bound segment for port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 on network 5c0f5153-b96e-46db-aaab-a604f5138cfd {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:13.034883 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:13.036239 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.038016 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "PUT /v2.0/ports/b94a3d2c-70d7-483a-9a04-e682bcaf76d2 HTTP/1.1" status: 200 len: 976 time: 1.3562996 Dec 10 14:26:13.064041 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9365233b-7a3c-4561-acd2-4f6b23a456b5 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 2.5022051 Dec 10 14:26:13.069059 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54458) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:13.069626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54460) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:13.074759 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.090809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba8b6dc3-b5a1-48ea-8ae0-ba183d1b76ce tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event updated for resources: {'Port': ['ID=b94a3d2c-70d7-483a-9a04-e682bcaf76d2,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:13.096830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1edbc423-46ae-49aa-9899-43517e661ac9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.160221 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Deleting port b3286fb7-5f0c-4501-86c7-119c73fa8509 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:13.164096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.204970 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Allocated IP 172.20.0.1 (61cd8ab1-c210-4b89-8018-e6c2f32e1e85/80b1af56-f290-4199-a044-f456fb3c2007/7c2bd0a5-9665-44cb-8182-df5190e9dfa0) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:13.234022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1edbc423-46ae-49aa-9899-43517e661ac9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.240550 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-a70daba8-3faa-428a-9602-013ba715fd54 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting subnet f812692c-cac5-411a-b257-d33ebcf6a597 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:26:13.266615 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] For port b3286fb7-5f0c-4501-86c7-119c73fa8509, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b3286fb7-5f0c-4501-86c7-119c73fa8509,segment=NetworkSegment(5e06ec80-9ff0-4191-8d7d-ada7e7078368),segment_id=5e06ec80-9ff0-4191-8d7d-ada7e7078368)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:13.267226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.278882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a70daba8-3faa-428a-9602-013ba715fd54 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.284031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Calling delete_port for b3286fb7-5f0c-4501-86c7-119c73fa8509 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:13.302943 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] DHCP port deletion for 7e45316e-5348-48a4-ba91-b71be829572c request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:13.425981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.435504 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a70daba8-3faa-428a-9602-013ba715fd54 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.441761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] Deleting port b3286fb7-5f0c-4501-86c7-119c73fa8509 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:13.442141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.444097 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.470903 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Pushing event deleted for resources: {'Port': ['ID=b3286fb7-5f0c-4501-86c7-119c73fa8509,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:13.482299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] No DVR routers for this DVR port b3286fb7-5f0c-4501-86c7-119c73fa8509 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:13.487619 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.518432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.520850 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] For port b3286fb7-5f0c-4501-86c7-119c73fa8509, host dv-neutron-821401-2-hyperv, got binding levels [] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:13.521237 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.535794 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.546112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4aca77b9-3924-45d6-bcf8-fb4ac28af49c tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Deleting port b94a3d2c-70d7-483a-9a04-e682bcaf76d2 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:13.546428 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4aca77b9-3924-45d6-bcf8-fb4ac28af49c tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.567141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] Calling delete_port for b3286fb7-5f0c-4501-86c7-119c73fa8509 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:13.571491 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.ipam_backend_mixin [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] Port b3286fb7-5f0c-4501-86c7-119c73fa8509 was not found and therefore no delete operation was performed {{(pid=103812) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 10 14:26:13.582000 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.585126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Network 61cd8ab1-c210-4b89-8018-e6c2f32e1e85 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:13.586063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.591099 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:13.600576 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.602260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:13.610155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Pushing event updated for resources: {'Port': ['ID=7c2bd0a5-9665-44cb-8182-df5190e9dfa0,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:13.610347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7e45316e-5348-48a4-ba91-b71be829572c']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:13.620242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] No DVR routers for this DVR port b3286fb7-5f0c-4501-86c7-119c73fa8509 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:13.622588 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5e06ec80-9ff0-4191-8d7d-ada7e7078368') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:13.622960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5e06ec80-9ff0-4191-8d7d-ada7e7078368') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:13.645985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.646371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.646724 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.647069 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.647411 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.647748 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.648097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.648225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.648435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.648782 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.649136 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.649491 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.650200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.650200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:26:13.668280 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.675238 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Releasing vlan 386 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:13.675905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:13.679483 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:13.697668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc80f5f-0e6a-4286-a9c6-b3e7d6d51b45 None None] Pushing event deleted for resources: {'Port': ['ID=b3286fb7-5f0c-4501-86c7-119c73fa8509,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:13.710037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Attempting to bind port 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:13.710415 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Attempting to bind port 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '61cd8ab1-c210-4b89-8018-e6c2f32e1e85'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:13.710787 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Attempting to bind port 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 on network 61cd8ab1-c210-4b89-8018-e6c2f32e1e85 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:13.716511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:13.716903 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Checking segment: {'id': '4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '61cd8ab1-c210-4b89-8018-e6c2f32e1e85'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:13.717314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.717743 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Bound using segment: {'id': '4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '61cd8ab1-c210-4b89-8018-e6c2f32e1e85'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:13.718227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Bound port: 7c2bd0a5-9665-44cb-8182-df5190e9dfa0, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '61cd8ab1-c210-4b89-8018-e6c2f32e1e85'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:13.718617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.791374 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] For port 7c2bd0a5-9665-44cb-8182-df5190e9dfa0, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:13.794671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] For port 7c2bd0a5-9665-44cb-8182-df5190e9dfa0, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7c2bd0a5-9665-44cb-8182-df5190e9dfa0,segment=NetworkSegment(4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63),segment_id=4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:13.853917 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.872212 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.873987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.879880 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] 10.222.0.57 "DELETE /v2.0/networks/7e45316e-5348-48a4-ba91-b71be829572c HTTP/1.1" status: 204 len: 168 time: 0.9656982 Dec 10 14:26:13.879880 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e13d0f6-7c18-4bda-a7c9-e99666e64322 tempest-TagsExtTest-472657459 tempest-TagsExtTest-472657459-project] Pushing event deleted for resources: {'Network': ['ID=7e45316e-5348-48a4-ba91-b71be829572c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:13.954658 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3873d64f-c88a-4db1-bd0d-2dc99541e608 None None] Pushing event updated for resources: {'Port': ['ID=7c2bd0a5-9665-44cb-8182-df5190e9dfa0,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:13.988354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:13.998888 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1edbc423-46ae-49aa-9899-43517e661ac9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.001446 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1edbc423-46ae-49aa-9899-43517e661ac9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.002617 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1edbc423-46ae-49aa-9899-43517e661ac9 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/4faddf83-fb16-4fd8-8159-d405f739f723 HTTP/1.1" status: 204 len: 168 time: 1.2748172 Dec 10 14:26:14.013562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] device_id is not set on port 47157bd2-4946-49c0-9ef4-2d15eb96899c yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:14.029889 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event deleted for resources: {'Port': ['ID=08b6ee99-abc3-45fe-aa40-a46a36116494,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:14.071251 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a70daba8-3faa-428a-9602-013ba715fd54 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.151593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-4aca77b9-3924-45d6-bcf8-fb4ac28af49c tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] For port b94a3d2c-70d7-483a-9a04-e682bcaf76d2, host hv-neutron-8214, got binding levels [] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:14.152026 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4aca77b9-3924-45d6-bcf8-fb4ac28af49c tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.183066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.238668 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4db5689d-1751-474c-b3a5-4963cf7388dc,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:14.278671 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4aca77b9-3924-45d6-bcf8-fb4ac28af49c tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Calling delete_port for b94a3d2c-70d7-483a-9a04-e682bcaf76d2 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:14.348058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1edbc423-46ae-49aa-9899-43517e661ac9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4faddf83-fb16-4fd8-8159-d405f739f723,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:14.366437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.403382 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.410535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:14.410861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.428821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54474) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:14.569041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a70daba8-3faa-428a-9602-013ba715fd54 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.583568 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.584114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Fanout notify agent at l3_agent the message router_deleted on router dbde97c0-467c-4687-8462-adb1edd4840c {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:14.588750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.589965 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c275b90b-953e-44b3-b560-6b3953279fe3 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "DELETE /v2.0/routers/dbde97c0-467c-4687-8462-adb1edd4840c HTTP/1.1" status: 204 len: 168 time: 3.2468870 Dec 10 14:26:14.593370 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54482) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:14.624053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:14.641011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a70daba8-3faa-428a-9602-013ba715fd54 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Subnet': ['ID=f812692c-cac5-411a-b257-d33ebcf6a597,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:14.657233 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a70daba8-3faa-428a-9602-013ba715fd54 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.661196 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a70daba8-3faa-428a-9602-013ba715fd54 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/subnets/f812692c-cac5-411a-b257-d33ebcf6a597 HTTP/1.1" status: 204 len: 168 time: 1.6814461 Dec 10 14:26:14.668097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54486) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:14.679761 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port 7c2bd0a5-9665-44cb-8182-df5190e9dfa0, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7c2bd0a5-9665-44cb-8182-df5190e9dfa0,segment=NetworkSegment(4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63),segment_id=4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:14.680131 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.696852 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e63c44f-adb2-45c7-905c-e03c6be552b1 None None] Network 9c3829d2-ad8b-4c9e-8fca-cff12849a398 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:14.716616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:14.770622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4aca77b9-3924-45d6-bcf8-fb4ac28af49c tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.779724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-c20e0311-d416-4b00-bbb4-e50bd1d105d9 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Deleting subnet f2a70a35-c6fc-4572-a861-5de01fc40935 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:26:14.798315 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c20e0311-d416-4b00-bbb4-e50bd1d105d9 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.802184 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4b14a5a4-7b93-47b4-a478-0527c6d861e9 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=3477d1434b76476d8d2a87f0861257e6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3716555 Dec 10 14:26:14.820864 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54488) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:14.844277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] device_id is not set on port 47157bd2-4946-49c0-9ef4-2d15eb96899c yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:14.859027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aca77b9-3924-45d6-bcf8-fb4ac28af49c tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Pushing event deleted for resources: {'Port': ['ID=b94a3d2c-70d7-483a-9a04-e682bcaf76d2,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:14.866235 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4aca77b9-3924-45d6-bcf8-fb4ac28af49c tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.870510 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4aca77b9-3924-45d6-bcf8-fb4ac28af49c tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "DELETE /v2.0/ports/b94a3d2c-70d7-483a-9a04-e682bcaf76d2 HTTP/1.1" status: 204 len: 168 time: 1.7978089 Dec 10 14:26:14.878915 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54490) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:14.882680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.890735 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:26:14.903673 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:14.907936 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.908210 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-f56fff53-2355-4f9a-bb4d-e681fef4f8f1 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] GET failed (client error): The resource could not be found. Dec 10 14:26:14.909055 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f56fff53-2355-4f9a-bb4d-e681fef4f8f1 tempest-PortsAdminExtendedAttrsTestJSON-2008250625 tempest-PortsAdminExtendedAttrsTestJSON-2008250625-project-admin] 10.222.0.57 "GET /v2.0/ports/b94a3d2c-70d7-483a-9a04-e682bcaf76d2 HTTP/1.1" status: 404 len: 333 time: 0.0291722 Dec 10 14:26:14.913701 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54492) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:14.921833 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:14.947260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c20e0311-d416-4b00-bbb4-e50bd1d105d9 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.002699 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.031401 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91c7bc58-142c-4b9a-a000-cedd36976a91 None None] DHCP port deletion for 9c3829d2-ad8b-4c9e-8fca-cff12849a398 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:15.082774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c20e0311-d416-4b00-bbb4-e50bd1d105d9 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.119753 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.127830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be0e7e37-34d7-4e03-8f51-c5c5d6a49e94 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.135404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.153250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'Port': ['ID=47157bd2-4946-49c0-9ef4-2d15eb96899c,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:15.162013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port 514dfe42-d394-4cf0-b634-07ada4981db4 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:15.162571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.190069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be0e7e37-34d7-4e03-8f51-c5c5d6a49e94 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.205851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-91c7bc58-142c-4b9a-a000-cedd36976a91 None None] Deleting port 514dfe42-d394-4cf0-b634-07ada4981db4 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:15.206528 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91c7bc58-142c-4b9a-a000-cedd36976a91 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.233994 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Checking segment: {'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:15.234384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Network hostable DHCP agents. Network: 43123a64-63e8-41a8-a5f9-b7b478de3cbc, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:15.242677 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] For port 514dfe42-d394-4cf0-b634-07ada4981db4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=514dfe42-d394-4cf0-b634-07ada4981db4,segment=NetworkSegment(92dede0e-5309-4094-90c3-53a0a9b80ce1),segment_id=92dede0e-5309-4094-90c3-53a0a9b80ce1)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:15.243728 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.263219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-717ed5a1-139a-4a51-a7e6-d688071e95a0 None None] Network 61cd8ab1-c210-4b89-8018-e6c2f32e1e85 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:15.270059 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for 514dfe42-d394-4cf0-b634-07ada4981db4 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:15.341928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.347320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6e7ee435-510e-44ab-97f4-ad24f644c6f1 None None] Could not find standard attr ID for object 7c2bd0a5-9665-44cb-8182-df5190e9dfa0. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:26:15.369712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c20e0311-d416-4b00-bbb4-e50bd1d105d9 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.375226 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.380875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c0f5153-b96e-46db-aaab-a604f5138cfd']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:15.408426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-91c7bc58-142c-4b9a-a000-cedd36976a91 None None] For port 514dfe42-d394-4cf0-b634-07ada4981db4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=514dfe42-d394-4cf0-b634-07ada4981db4,segment=NetworkSegment(92dede0e-5309-4094-90c3-53a0a9b80ce1),segment_id=92dede0e-5309-4094-90c3-53a0a9b80ce1)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:15.409169 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91c7bc58-142c-4b9a-a000-cedd36976a91 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.413321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c20e0311-d416-4b00-bbb4-e50bd1d105d9 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=f2a70a35-c6fc-4572-a861-5de01fc40935,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:15.419678 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c20e0311-d416-4b00-bbb4-e50bd1d105d9 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.422854 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c20e0311-d416-4b00-bbb4-e50bd1d105d9 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "DELETE /v2.0/subnets/f2a70a35-c6fc-4572-a861-5de01fc40935 HTTP/1.1" status: 204 len: 168 time: 0.8242347 Dec 10 14:26:15.423184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54504) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:15.430774 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:15.431196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '01ac3344-f7ee-4634-9c6b-21ab9c23b8d4') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:15.451823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Network 43123a64-63e8-41a8-a5f9-b7b478de3cbc is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:15.453810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be0e7e37-34d7-4e03-8f51-c5c5d6a49e94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.456474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be0e7e37-34d7-4e03-8f51-c5c5d6a49e94 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.457561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-91c7bc58-142c-4b9a-a000-cedd36976a91 None None] Calling delete_port for 514dfe42-d394-4cf0-b634-07ada4981db4 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:15.457685 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-be0e7e37-34d7-4e03-8f51-c5c5d6a49e94 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/c5dd898e-4545-440a-8373-be195677f0e2 HTTP/1.1" status: 204 len: 168 time: 0.6362267 Dec 10 14:26:15.458467 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=7c2bd0a5-9665-44cb-8182-df5190e9dfa0,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:15.483960 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.499324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.516674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b3286fb7-5f0c-4501-86c7-119c73fa8509 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:15.525367 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:15.527867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be0e7e37-34d7-4e03-8f51-c5c5d6a49e94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c5dd898e-4545-440a-8373-be195677f0e2,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:15.531464 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.540618 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=514dfe42-d394-4cf0-b634-07ada4981db4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:15.561971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] No DVR routers for this DVR port 514dfe42-d394-4cf0-b634-07ada4981db4 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:15.571133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.582623 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.645318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 43123a64-63e8-41a8-a5f9-b7b478de3cbc) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:15.649672 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:15.660703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: b3286fb7-5f0c-4501-86c7-119c73fa8509 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:15.662234 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Releasing vlan 350 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:15.662645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.663645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b3286fb7-5f0c-4501-86c7-119c73fa8509 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:15.666857 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:15.683346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.683795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-186a4727-c854-467a-bd89-5d7a0aff4189 None None] Network 43123a64-63e8-41a8-a5f9-b7b478de3cbc requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:15.684814 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:15.685153 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:15.685588 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:15.704708 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9c3829d2-ad8b-4c9e-8fca-cff12849a398']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:15.716456 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '92dede0e-5309-4094-90c3-53a0a9b80ce1') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:15.716789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '92dede0e-5309-4094-90c3-53a0a9b80ce1') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:15.724518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.726951 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.740923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.747572 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Releasing vlan 396 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:15.747981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.749572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:15.751514 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:15.770179 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 2 to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c Dec 10 14:26:15.784861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:15.785246 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:15.785661 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:15.804348 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:15.807747 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:15.808036 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:15.808911 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=80b1af56-f290-4199-a044-f456fb3c2007,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:15.818765 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 3 to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c Dec 10 14:26:15.872154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91c7bc58-142c-4b9a-a000-cedd36976a91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.922497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c7bc58-142c-4b9a-a000-cedd36976a91 None None] Pushing event deleted for resources: {'Port': ['ID=514dfe42-d394-4cf0-b634-07ada4981db4,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:15.927419 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91c7bc58-142c-4b9a-a000-cedd36976a91 None None] No DVR routers for this DVR port 514dfe42-d394-4cf0-b634-07ada4981db4 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:15.942407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.950205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:15.950325 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.950540 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:15.950884 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:15.966068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.966307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.969435 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] 10.222.0.57 "DELETE /v2.0/networks/5c0f5153-b96e-46db-aaab-a604f5138cfd HTTP/1.1" status: 204 len: 168 time: 1.0529513 Dec 10 14:26:15.970220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:15.970325 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.970502 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:15.973068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:15.974033 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/networks/9c3829d2-ad8b-4c9e-8fca-cff12849a398 HTTP/1.1" status: 204 len: 168 time: 1.3057950 Dec 10 14:26:15.983417 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 4 to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c Dec 10 14:26:15.983417 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54514) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:15.999504 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86dcd512-65b5-48d0-925b-b7b236a1690d']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:16.003033 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-917feebc-68d7-48cc-898d-e0cf31659c59 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Network': ['ID=9c3829d2-ad8b-4c9e-8fca-cff12849a398,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:16.016473 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5ddd761f-1d0b-42c3-8f44-6cda32ad0add') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:16.016802 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5ddd761f-1d0b-42c3-8f44-6cda32ad0add') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:16.035200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.053934 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c0503be-2d3c-4264-a2e3-6a371185fbd3 None None] Network 61cd8ab1-c210-4b89-8018-e6c2f32e1e85 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:16.054116 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.060823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a05ab9e-c7c0-4879-8ecb-5139e84d5a41 tempest-PortsAdminExtendedAttrsTestJSON-1413722973 tempest-PortsAdminExtendedAttrsTestJSON-1413722973-project] Pushing event deleted for resources: {'Network': ['ID=5c0f5153-b96e-46db-aaab-a604f5138cfd,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:16.076124 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Releasing vlan 351 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:16.077968 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.079539 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:16.079884 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:16.080223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:16.087725 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['61cd8ab1-c210-4b89-8018-e6c2f32e1e85']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:16.134908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:16.135277 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:16.137097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:16.137398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4ed3dc9d-2fa1-4aa3-802c-09d1fad37f63') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:16.142885 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 5 to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:16.165570 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:16.167775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.197964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:16.198303 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:16.198641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:16.208686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.210728 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:16.217637 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:16.217732 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67866c73-d35f-4a99-9ee0-2a6d32831a0e None None] DHCP port deletion for 61cd8ab1-c210-4b89-8018-e6c2f32e1e85 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:16.217811 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 6 to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c Dec 10 14:26:16.222188 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 360 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:16.222645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.235931 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.240512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 86dcd512-65b5-48d0-925b-b7b236a1690d {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:16.245045 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:16.251731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.271181 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "DELETE /v2.0/networks/86dcd512-65b5-48d0-925b-b7b236a1690d HTTP/1.1" status: 204 len: 168 time: 0.8456461 Dec 10 14:26:16.288578 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:16.288898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:16.289270 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:16.298021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd5a8abf-267e-4e8d-9060-a430bd50fc5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event deleted for resources: {'Network': ['ID=86dcd512-65b5-48d0-925b-b7b236a1690d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:16.308588 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:16.308925 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:16.311690 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 7 to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c Dec 10 14:26:16.327215 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port ffd5e0b3-98a0-4430-b60c-d3683623e008 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:16.327567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.331778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:16.332114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:16.332450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:16.348523 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:16.349487 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:16.374198 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 8 to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c Dec 10 14:26:16.394698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:16.395035 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:16.395364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:16.401815 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:16.401815 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:16.403540 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 9 to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c Dec 10 14:26:16.422438 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:16.422838 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:16.423178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:16.434360 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.456778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.465755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54532) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:16.474146 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/61cd8ab1-c210-4b89-8018-e6c2f32e1e85 HTTP/1.1" status: 204 len: 168 time: 3.3983643 Dec 10 14:26:16.478275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1025954560'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:16.483787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:16.484123 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:16.490609 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1264e9e-4436-489b-a03d-aed3946223b4 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=61cd8ab1-c210-4b89-8018-e6c2f32e1e85,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:16.513400 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.plugins.ml2.plugin [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 10 to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c Dec 10 14:26:16.533503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:16.534129 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:16.535144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:16.542205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.542609 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.545607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port 47157bd2-4946-49c0-9ef4-2d15eb96899c on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:16.546017 dv-neutron-821401-2-hyperv neutron-server[103811]: ERROR neutron.plugins.ml2.managers [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port 47157bd2-4946-49c0-9ef4-2d15eb96899c on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:16.546443 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.550938 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:16.561085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:16.566679 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.574254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for ffd5e0b3-98a0-4430-b60c-d3683623e008 owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:16.598133 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:16.600227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7c2bd0a5-9665-44cb-8182-df5190e9dfa0 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:16.603380 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 514dfe42-d394-4cf0-b634-07ada4981db4 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:16.620461 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 374, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:16.641075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.641680 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment c9ae1534-e9f2-46ae-b8db-99b242ade57f of type vlan for network 0d5d465c-7c22-4460-bec0-9f82527dd175 Dec 10 14:26:16.668022 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 514dfe42-d394-4cf0-b634-07ada4981db4 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:16.670180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 514dfe42-d394-4cf0-b634-07ada4981db4 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:16.686666 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] For port 47157bd2-4946-49c0-9ef4-2d15eb96899c, host hv-neutron-8214, cleared binding levels {{(pid=103811) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:16.687382 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempted to set empty binding levels {{(pid=103811) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 10 14:26:16.708889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54536) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:16.729787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.750795 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.818694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:16.818856 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.819270 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.825017 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:16.825828 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.843417 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'Port': ['ID=47157bd2-4946-49c0-9ef4-2d15eb96899c,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:16.894266 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=0d5d465c-7c22-4460-bec0-9f82527dd175,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:16.905435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 0d5d465c-7c22-4460-bec0-9f82527dd175 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:16.922759 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5c2bee00-0cac-4804-8647-21367fa34962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 986 time: 4.2203076 Dec 10 14:26:16.923067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54546) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:16.950156 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:16.970691 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-094bd906-3aea-4062-98c2-d38afa1c185e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.5037997 Dec 10 14:26:16.982254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54548) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:16.991127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-91e6a21e-fafe-49fb-8613-01d013cfef6f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'New_network'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:17.005846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=ffd5e0b3-98a0-4430-b60c-d3683623e008,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:17.100125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.103975 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.105495 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f5467904-1377-4ff9-9a39-64577305a702 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/floatingips/efcd9b24-6792-4105-904f-0dfec93fb6cc HTTP/1.1" status: 204 len: 168 time: 1.1019249 Dec 10 14:26:17.109044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54552) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.142192 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-457c032f-af9d-464f-a7db-525a8b2974c7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:17.143067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-457c032f-af9d-464f-a7db-525a8b2974c7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:17.146664 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-457c032f-af9d-464f-a7db-525a8b2974c7 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/ports/4be9c35e-4c6e-4bc5-a2af-eb9ebf78662e HTTP/1.1" status: 404 len: 333 time: 0.0367744 Dec 10 14:26:17.149286 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54554) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.178045 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-72967cde-7781-449b-969f-2d6c917194fd tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "GET /v2.0/ports?device_id=a9d6ff8f-6f21-4d81-bd51-c184c2a50541 HTTP/1.1" status: 200 len: 205 time: 0.0275657 Dec 10 14:26:17.180292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54556) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.217922 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4ca7ce79-5fd4-45c6-a713-55b65839acff admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=bd535c3c1ede4dabbd4be542a3f2fbe1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5075033 Dec 10 14:26:17.223088 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54560) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.228535 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-79152989-70da-40d9-b929-6995960eb034 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] delete failed (client error): The resource could not be found. Dec 10 14:26:17.229811 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-79152989-70da-40d9-b929-6995960eb034 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/routers/a9d6ff8f-6f21-4d81-bd51-c184c2a50541 HTTP/1.1" status: 404 len: 336 time: 0.0475233 Dec 10 14:26:17.232262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54562) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.248749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54564) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.262819 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-81ba04c6-b4f8-4365-afb0-53c268cbe87b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:17.263754 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-bb638484-7063-41d6-8ee1-3e38e1f44734 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'router': {'name': 'tempest-router--978422983', 'project_id': '08b7d1a8cc114b34aa25b15de5ded62c'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:17.263955 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-81ba04c6-b4f8-4365-afb0-53c268cbe87b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:17.267435 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-290a9529-f194-42d7-b492-d3be94a6eb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Deleting port 47157bd2-4946-49c0-9ef4-2d15eb96899c {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:17.267653 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-290a9529-f194-42d7-b492-d3be94a6eb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.270077 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-81ba04c6-b4f8-4365-afb0-53c268cbe87b tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/subnets/f812692c-cac5-411a-b257-d33ebcf6a597 HTTP/1.1" status: 404 len: 337 time: 0.0366645 Dec 10 14:26:17.278316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54566) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.369521 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54572) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.411038 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f2e5d55e-3da7-4cfc-9266-b311581aca1e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:17.411685 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2e5d55e-3da7-4cfc-9266-b311581aca1e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.515596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeIpV6Test-514106883', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:17.527824 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2e5d55e-3da7-4cfc-9266-b311581aca1e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.542682 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f2e5d55e-3da7-4cfc-9266-b311581aca1e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for 8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:17.568187 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-91e6a21e-fafe-49fb-8613-01d013cfef6f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.618140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-290a9529-f194-42d7-b492-d3be94a6eb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] For port 47157bd2-4946-49c0-9ef4-2d15eb96899c, host hv-neutron-8214, got binding levels [] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:17.619058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-290a9529-f194-42d7-b492-d3be94a6eb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.621753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3779def-5c25-4241-8819-2db6d4221b9c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.639194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-290a9529-f194-42d7-b492-d3be94a6eb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Calling delete_port for 47157bd2-4946-49c0-9ef4-2d15eb96899c owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:17.640636 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54578) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.666740 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3779def-5c25-4241-8819-2db6d4221b9c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.673183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bb638484-7063-41d6-8ee1-3e38e1f44734 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.673183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bb638484-7063-41d6-8ee1-3e38e1f44734 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.712742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-91e6a21e-fafe-49fb-8613-01d013cfef6f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.756537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-91e6a21e-fafe-49fb-8613-01d013cfef6f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 0d5d465c-7c22-4460-bec0-9f82527dd175 is not hosted by any dhcp agent {{(pid=103810) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 10 14:26:17.761279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Made reservation on behalf of c49505f36ecb43908e4b23e23c4ebbbf for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:17.762024 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91e6a21e-fafe-49fb-8613-01d013cfef6f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:17.762587 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-91e6a21e-fafe-49fb-8613-01d013cfef6f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.763695 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.763835 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-91e6a21e-fafe-49fb-8613-01d013cfef6f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "PUT /v2.0/networks/0d5d465c-7c22-4460-bec0-9f82527dd175 HTTP/1.1" status: 200 len: 723 time: 0.7805998 Dec 10 14:26:17.776250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54582) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:17.776424 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Request body: {'network': {'name': 'tempest-TagsTest-test-network-2021219577'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:17.776559 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': '0d5d465c-7c22-4460-bec0-9f82527dd175', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:17.791906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.830010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2e5d55e-3da7-4cfc-9266-b311581aca1e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.875908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2e5d55e-3da7-4cfc-9266-b311581aca1e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:17.888078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e6a21e-fafe-49fb-8613-01d013cfef6f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=0d5d465c-7c22-4460-bec0-9f82527dd175,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:17.905076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 0d5d465c-7c22-4460-bec0-9f82527dd175 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:17.907511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e568839-1b16-4d86-bc79-d25e68d7e878 None None] DHCP port deletion for 826f4ffe-6ffa-44c2-a055-d6d8b94c119d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:17.927717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bb638484-7063-41d6-8ee1-3e38e1f44734 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.972797 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Made reservation on behalf of 8281f96db1de4d1aa07605815db4f2fe for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:17.976983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.987613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2e5d55e-3da7-4cfc-9266-b311581aca1e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.987978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:17.990942 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f2e5d55e-3da7-4cfc-9266-b311581aca1e tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/ports/8cd5b80c-4afc-4d92-a9d6-0cbb4f7d13fb HTTP/1.1" status: 204 len: 168 time: 0.7163384 Dec 10 14:26:17.993624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54584) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:18.008054 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-290a9529-f194-42d7-b492-d3be94a6eb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.011560 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bb638484-7063-41d6-8ee1-3e38e1f44734 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.013385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3779def-5c25-4241-8819-2db6d4221b9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.015849 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3779def-5c25-4241-8819-2db6d4221b9c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.016939 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e3779def-5c25-4241-8819-2db6d4221b9c admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/afabf5cf-66b3-4c78-8bc8-373c5880c23e HTTP/1.1" status: 204 len: 168 time: 0.7929795 Dec 10 14:26:18.046252 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.051634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:18.055550 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.088017 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3779def-5c25-4241-8819-2db6d4221b9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afabf5cf-66b3-4c78-8bc8-373c5880c23e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:18.094980 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290a9529-f194-42d7-b492-d3be94a6eb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event deleted for resources: {'Port': ['ID=47157bd2-4946-49c0-9ef4-2d15eb96899c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:18.099767 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.133994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-290a9529-f194-42d7-b492-d3be94a6eb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.137216 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-290a9529-f194-42d7-b492-d3be94a6eb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "DELETE /v2.0/ports/47157bd2-4946-49c0-9ef4-2d15eb96899c HTTP/1.1" status: 204 len: 168 time: 1.2130926 Dec 10 14:26:18.142220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bb638484-7063-41d6-8ee1-3e38e1f44734 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.146011 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bb638484-7063-41d6-8ee1-3e38e1f44734 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.8880625 Dec 10 14:26:18.147432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54588) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:18.147929 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54590) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:18.153827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34c9dfd3-eb20-4165-9430-a2ad888e4f49,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:18.158524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] device_id is not set on port c5373a3c-bfd5-40fd-9d6e-538c7a3bedb0 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:18.215564 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-40b381d6-8198-477c-86c3-c9397e4cb094 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] GET failed (client error): The resource could not be found. Dec 10 14:26:18.216992 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-40b381d6-8198-477c-86c3-c9397e4cb094 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "GET /v2.0/ports/47157bd2-4946-49c0-9ef4-2d15eb96899c HTTP/1.1" status: 404 len: 333 time: 0.0684199 Dec 10 14:26:18.223367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54592) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:18.230957 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Request body: {'port': {'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1037831487'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:18.277999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4da8f0e2-f6ad-4c97-bdb4-d59111625a5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.339873 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Allocated IP 172.26.2.95 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/c5373a3c-bfd5-40fd-9d6e-538c7a3bedb0) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:18.374702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.438838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Made reservation on behalf of 73dc370c75ab42df98c43f1e3c0887e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:18.441133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.447238 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-3dfe73bb-6d32-4524-abc8-c549a99da2cc tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:18.447563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3dfe73bb-6d32-4524-abc8-c549a99da2cc tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.493292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.498401 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4da8f0e2-f6ad-4c97-bdb4-d59111625a5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.505133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4da8f0e2-f6ad-4c97-bdb4-d59111625a5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.509739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.547307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] device_id is not set on port c024ff13-25dc-4781-9300-6fc3159a3840 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:18.555746 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.567222 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] vlan segment allocate from pool success with {'vlan_id': 395, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:18.597800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=663276bf-95ca-4adc-a51e-ba7c0585f104,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:18.611591 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': 'c9ae1534-e9f2-46ae-b8db-99b242ade57f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '0d5d465c-7c22-4460-bec0-9f82527dd175'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:18.611959 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: 0d5d465c-7c22-4460-bec0-9f82527dd175, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:18.647184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.647526 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Added segment eb5942f5-2399-4724-8439-b5bf891f264e of type vlan for network c4f1707a-3551-4067-96e9-1931573839ae Dec 10 14:26:18.679218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2d1f3f88-f195-4332-9fdd-29ce9c635cb7,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:18.998914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54596) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:18.999137 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3dfe73bb-6d32-4524-abc8-c549a99da2cc tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:18.999137 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.000028 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9b501a88-45b0-437e-a156-ebd41ceb5094 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=ea35a951bf5c4706970400d2939b7ccc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0400259 Dec 10 14:26:19.000028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54598) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:19.000271 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-3dfe73bb-6d32-4524-abc8-c549a99da2cc tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:19.000395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d82ebe3e-57ae-48d6-aa33-6ff3b8d07352 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.000395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d82ebe3e-57ae-48d6-aa33-6ff3b8d07352 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.000637 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.332907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4da8f0e2-f6ad-4c97-bdb4-d59111625a5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.333390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4da8f0e2-f6ad-4c97-bdb4-d59111625a5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Fanout notify agent at l3_agent the message router_deleted on router f750346d-32be-4767-bcf0-6dbd0c9cc207 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:19.333549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.335644 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 0d5d465c-7c22-4460-bec0-9f82527dd175 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:19.338882 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4da8f0e2-f6ad-4c97-bdb4-d59111625a5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.343284 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4da8f0e2-f6ad-4c97-bdb4-d59111625a5c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "DELETE /v2.0/routers/f750346d-32be-4767-bcf0-6dbd0c9cc207 HTTP/1.1" status: 204 len: 168 time: 1.1903367 Dec 10 14:26:19.382974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:19.386605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:19.390570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:19.402516 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f86dc21-3711-443d-8edd-785cb32772dc None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:19.431521 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Pushing event updated for resources: {'Port': ['ID=c5373a3c-bfd5-40fd-9d6e-538c7a3bedb0,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:19.449154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:19.449799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.454298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.456304 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d82ebe3e-57ae-48d6-aa33-6ff3b8d07352 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.459125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d82ebe3e-57ae-48d6-aa33-6ff3b8d07352 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.463164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:19.463309 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d82ebe3e-57ae-48d6-aa33-6ff3b8d07352 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/5fbbbe1f-3b56-4d06-b507-70d07a6a45b9 HTTP/1.1" status: 204 len: 168 time: 0.7026188 Dec 10 14:26:19.463399 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.463489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 0d5d465c-7c22-4460-bec0-9f82527dd175) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:19.470753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41f9ac91-e1f6-44fd-8586-afd1d2bb57b9 None None] Network 0d5d465c-7c22-4460-bec0-9f82527dd175 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:19.472205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:19.472807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.487064 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3dfe73bb-6d32-4524-abc8-c549a99da2cc tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.488447 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d82ebe3e-57ae-48d6-aa33-6ff3b8d07352 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5fbbbe1f-3b56-4d06-b507-70d07a6a45b9,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:19.499376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.564657 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f646efd9-e9a9-4226-8e10-944f5593d178 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1035 time: 2.1936026 Dec 10 14:26:19.567658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54604) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:19.588223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.95'}]}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:19.599046 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dfe73bb-6d32-4524-abc8-c549a99da2cc tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:19.601170 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3debe0ee-6cf0-4231-a787-59ad0e76a8df None None] Provisioning complete for port c5373a3c-bfd5-40fd-9d6e-538c7a3bedb0 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:19.601775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3debe0ee-6cf0-4231-a787-59ad0e76a8df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.610780 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1acc1604-6055-456f-b4ac-32ae420e7c56 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8428309 Dec 10 14:26:19.614069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54606) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:19.622008 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8766b188-5e86-42d9-a3c6-e1daa2714cab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:19.646121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-0d5d465c-7c22-4460-bec0-9f82527dd175', 'network_id': '0d5d465c-7c22-4460-bec0-9f82527dd175', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': '663276bf-95ca-4adc-a51e-ba7c0585f104'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:19.647413 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.659909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b3684b2-3721-4f9f-8ca6-36edd9783123 None None] DHCP port deletion for 826f4ffe-6ffa-44c2-a055-d6d8b94c119d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:19.662687 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Network 43123a64-63e8-41a8-a5f9-b7b478de3cbc is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:19.663982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Pushing event updated for resources: {'Network': ['ID=c4f1707a-3551-4067-96e9-1931573839ae,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:19.675095 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5b2f0541-85cf-4389-bca9-8ae99bc2539c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 776 time: 2.0334041 Dec 10 14:26:19.682660 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54608) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:19.696056 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-eb8801a3-dc0c-4ae1-9f30-fd58b7728df0 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae', 'tempest-TagsTest-Tag-1432428873') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:19.698717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:19.705757 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:19.714550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:19.717330 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.747667 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network c4f1707a-3551-4067-96e9-1931573839ae details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:19.748089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'Port': ['ID=c024ff13-25dc-4781-9300-6fc3159a3840,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:19.750675 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3debe0ee-6cf0-4231-a787-59ad0e76a8df None None] Port c5373a3c-bfd5-40fd-9d6e-538c7a3bedb0 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:19.762383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3dfe73bb-6d32-4524-abc8-c549a99da2cc tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.769298 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3dfe73bb-6d32-4524-abc8-c549a99da2cc tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/ports/a703f2a1-9fe0-41d3-8b3e-4fb8a4d1a125 HTTP/1.1" status: 204 len: 168 time: 1.7701821 Dec 10 14:26:19.770223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54610) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:19.823512 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8766b188-5e86-42d9-a3c6-e1daa2714cab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-126683541'] for subnet, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.865101 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-991e174d-fae5-4c85-97bd-ed8f309662c4 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:19.871979 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-991e174d-fae5-4c85-97bd-ed8f309662c4 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "GET /v2.0/ports?device_id=e99fc658-fff4-4ea9-a04c-33ee04a756ca HTTP/1.1" status: 200 len: 913 time: 0.0990486 Dec 10 14:26:19.872420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54612) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:19.886866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.887917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:19.895607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54614) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:19.998919 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-eb8801a3-dc0c-4ae1-9f30-fd58b7728df0 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "PUT /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags/tempest-TagsTest-Tag-1432428873 HTTP/1.1" status: 201 len: 201 time: 0.3124962 Dec 10 14:26:19.999304 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54618) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:20.003617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-d8b95a29-f36a-4e75-932b-042fd0036dba tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae', 'tempest-TagsTest-Tag-1432428873') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:20.011013 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8a5e51ac-2673-479d-95ca-55644d9031bb tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 1.7843747 Dec 10 14:26:20.027640 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54620) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:20.036307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:20.062489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.143652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.157621 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d8b95a29-f36a-4e75-932b-042fd0036dba tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "GET /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags/tempest-TagsTest-Tag-1432428873 HTTP/1.1" status: 204 len: 168 time: 0.1567700 Dec 10 14:26:20.162313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1657146342', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:20.169760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54624) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:20.177811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-04d94393-1595-4f49-9210-ebd5f9fb3756 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:20.333840 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.335298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.362434 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-04d94393-1595-4f49-9210-ebd5f9fb3756 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "GET /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags HTTP/1.1" status: 200 len: 238 time: 0.1916113 Dec 10 14:26:20.367218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54632) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:20.374543 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-fb7a6cbb-17cf-4dd4-9333-af9cd7dcd308 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae', {'tags': ['tempest-TagsTest-Tag-723781058', 'tempest-TagsTest-Tag-944198875', 'tempest-TagsTest-Tag-9209187']}) {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:20.476433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.538540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] device_id is not set on port c024ff13-25dc-4781-9300-6fc3159a3840 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:20.548116 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.645618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.675547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8766b188-5e86-42d9-a3c6-e1daa2714cab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8745562688988', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-126567472'] for subnet, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.725135 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8766b188-5e86-42d9-a3c6-e1daa2714cab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:20.725758 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8766b188-5e86-42d9-a3c6-e1daa2714cab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.727077 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8766b188-5e86-42d9-a3c6-e1daa2714cab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "PUT /v2.0/subnets/663276bf-95ca-4adc-a51e-ba7c0585f104 HTTP/1.1" status: 200 len: 806 time: 1.1119101 Dec 10 14:26:20.730287 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54644) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:20.739210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Allocated IP 172.20.0.2 (0d5d465c-7c22-4460-bec0-9f82527dd175/663276bf-95ca-4adc-a51e-ba7c0585f104/7a12c85e-adc8-420c-badb-38bb93a49777) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:20.781470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8766b188-5e86-42d9-a3c6-e1daa2714cab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=663276bf-95ca-4adc-a51e-ba7c0585f104,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:20.801511 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fb7a6cbb-17cf-4dd4-9333-af9cd7dcd308 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "PUT /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags HTTP/1.1" status: 200 len: 304 time: 0.4321983 Dec 10 14:26:20.802234 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.806235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54646) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:20.838357 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-daa5e2ef-8dc6-4789-a360-c9ee7a4e8d5c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae', 'tempest-TagsTest-Tag-723781058') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:20.953484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.965332 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:20.989627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'Port': ['ID=c024ff13-25dc-4781-9300-6fc3159a3840,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:20.998353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54650) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:21.001113 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.001661 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.018869 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.019192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.019534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.032122 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.032416 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.032939 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 2 to bind port c024ff13-25dc-4781-9300-6fc3159a3840 Dec 10 14:26:21.067623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.067623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.067995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.069848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Network 0d5d465c-7c22-4460-bec0-9f82527dd175 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:21.074852 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:21.079485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:21.081955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.082294 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.084362 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 3 to bind port c024ff13-25dc-4781-9300-6fc3159a3840 Dec 10 14:26:21.093918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.104566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Pushing event updated for resources: {'Port': ['ID=7a12c85e-adc8-420c-badb-38bb93a49777,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:21.128711 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.131663 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.131663 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.141002 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.141344 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.143365 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 4 to bind port c024ff13-25dc-4781-9300-6fc3159a3840 Dec 10 14:26:21.158425 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-daa5e2ef-8dc6-4789-a360-c9ee7a4e8d5c tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "DELETE /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags/tempest-TagsTest-Tag-723781058 HTTP/1.1" status: 204 len: 168 time: 0.3495648 Dec 10 14:26:21.161249 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54654) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:21.167665 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-858e0dc7-cf9f-445b-a5d6-54868567db83 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae', 'tempest-TagsTest-Tag-723781058') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:21.171425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.171425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.171425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.176431 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Attempting to bind port 7a12c85e-adc8-420c-badb-38bb93a49777 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.178048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Attempting to bind port 7a12c85e-adc8-420c-badb-38bb93a49777 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'c9ae1534-e9f2-46ae-b8db-99b242ade57f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '0d5d465c-7c22-4460-bec0-9f82527dd175'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.178524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Attempting to bind port 7a12c85e-adc8-420c-badb-38bb93a49777 on network 0d5d465c-7c22-4460-bec0-9f82527dd175 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.189019 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:21.189218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.189676 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.189768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Checking segment: {'id': 'c9ae1534-e9f2-46ae-b8db-99b242ade57f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '0d5d465c-7c22-4460-bec0-9f82527dd175'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:21.190120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.190581 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Bound using segment: {'id': 'c9ae1534-e9f2-46ae-b8db-99b242ade57f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '0d5d465c-7c22-4460-bec0-9f82527dd175'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:21.191794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Bound port: 7a12c85e-adc8-420c-badb-38bb93a49777, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9ae1534-e9f2-46ae-b8db-99b242ade57f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '0d5d465c-7c22-4460-bec0-9f82527dd175'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:21.191941 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 5 to bind port c024ff13-25dc-4781-9300-6fc3159a3840 Dec 10 14:26:21.192043 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.226035 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairIpV6TestJSON-test-network-124792798'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:21.231292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.236045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.236204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.236506 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.252993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.253330 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.258080 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 6 to bind port c024ff13-25dc-4781-9300-6fc3159a3840 Dec 10 14:26:21.268442 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] For port 7a12c85e-adc8-420c-badb-38bb93a49777, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:21.271830 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] For port 7a12c85e-adc8-420c-badb-38bb93a49777, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7a12c85e-adc8-420c-badb-38bb93a49777,segment=NetworkSegment(c9ae1534-e9f2-46ae-b8db-99b242ade57f),segment_id=c9ae1534-e9f2-46ae-b8db-99b242ade57f)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:21.294563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.294899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.295231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.326040 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.335790 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.336125 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.361398 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 7 to bind port c024ff13-25dc-4781-9300-6fc3159a3840 Dec 10 14:26:21.364310 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-858e0dc7-cf9f-445b-a5d6-54868567db83 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] show failed (client error): The resource could not be found. Dec 10 14:26:21.367965 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-858e0dc7-cf9f-445b-a5d6-54868567db83 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "GET /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags/tempest-TagsTest-Tag-723781058 HTTP/1.1" status: 404 len: 325 time: 0.2029109 Dec 10 14:26:21.370001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54656) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:21.373297 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.373801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-4f1dde8b-fa0d-4844-97c5-070d00f8dad5 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae', 'tempest-TagsTest-Tag-944198875') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:21.397609 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cacf5d3-f196-4799-9aea-09fb3c4dcec5 None None] Pushing event updated for resources: {'Port': ['ID=7a12c85e-adc8-420c-badb-38bb93a49777,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:21.413915 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.415041 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.415925 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.416265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.439750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=663276bf-95ca-4adc-a51e-ba7c0585f104,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:21.441532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Made reservation on behalf of ef5003e8d7fc43dcb8d6e7196c2360d1 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:21.445404 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.445741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.459121 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.468906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.476103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.476449 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.496228 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 8 to bind port c024ff13-25dc-4781-9300-6fc3159a3840 Dec 10 14:26:21.501752 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.528744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.529337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.529849 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.579102 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.580205 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.586872 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 9 to bind port c024ff13-25dc-4781-9300-6fc3159a3840 Dec 10 14:26:21.626236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.626569 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.626901 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.638256 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4f1dde8b-fa0d-4844-97c5-070d00f8dad5 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "GET /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags/tempest-TagsTest-Tag-944198875 HTTP/1.1" status: 204 len: 168 time: 0.2676980 Dec 10 14:26:21.646101 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54658) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:21.649924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.652685 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-454483da-8e66-4493-acb6-8dcb39948eb9 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae', 'tempest-TagsTest-Tag-9209187') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:21.677202 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.677749 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.691938 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 10 to bind port c024ff13-25dc-4781-9300-6fc3159a3840 Dec 10 14:26:21.700449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d5d465c-7c22-4460-bec0-9f82527dd175']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:21.738308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c9ae1534-e9f2-46ae-b8db-99b242ade57f') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:21.738611 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c9ae1534-e9f2-46ae-b8db-99b242ade57f') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:21.750769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:21.751107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:21.751442 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:21.760474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.776070 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:21.776403 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port c024ff13-25dc-4781-9300-6fc3159a3840 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:21.776768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.779005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Allocated IP 172.26.2.14 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/fe998eab-939b-40bf-b774-7d0d0bdc7807) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:21.796928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.815484 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 374 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:21.815862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:21.818847 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:21.839540 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.869920 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-454483da-8e66-4493-acb6-8dcb39948eb9 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "GET /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags/tempest-TagsTest-Tag-9209187 HTTP/1.1" status: 204 len: 168 time: 0.2205203 Dec 10 14:26:21.873654 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54660) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:21.884032 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.tag.tag_plugin [None req-dcbc5b69-c557-4ba5-80e1-48cee1db21b1 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:21.907958 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.926829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] For port c024ff13-25dc-4781-9300-6fc3159a3840, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:21.926829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempted to set empty binding levels {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 10 14:26:21.944586 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:21.990196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] vlan segment allocate from pool success with {'vlan_id': 368, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:21.991979 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.api [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:26:21.991979 dv-neutron-821401-2-hyperv neutron-server[103811]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:26:21.991979 dv-neutron-821401-2-hyperv neutron-server[103811]: [parameters: {'id': '0d5d465c-7c22-4460-bec0-9f82527dd175'}] Dec 10 14:26:21.991979 dv-neutron-821401-2-hyperv neutron-server[103811]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103811) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:26:21.992340 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG oslo_db.api [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:26:22.018591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.024277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d0676ab8-4c5b-4205-a745-76b991c37160,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:22.041196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.041571 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Added segment 636ba934-3565-4c09-b7f6-90de379fe518 of type vlan for network 77457432-514b-48cd-95c7-0516e6ca0668 Dec 10 14:26:22.049735 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] In _notify_port_updated(), no bound segment for port c024ff13-25dc-4781-9300-6fc3159a3840 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:22.050756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.051795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.052746 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "PUT /v2.0/ports/c024ff13-25dc-4781-9300-6fc3159a3840 HTTP/1.1" status: 200 len: 981 time: 2.0228043 Dec 10 14:26:22.057330 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54662) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:22.107966 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.134662 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f35be16-aa66-4845-b31e-a5c685ed5d3a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'Port': ['ID=c024ff13-25dc-4781-9300-6fc3159a3840,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:22.138692 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.179244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:22.185657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:22.188079 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:22.191597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port 75de2cec-62f6-4af4-b128-88ca88f2ae1b {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:22.192060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.207013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d081009-c9d4-4adf-8ad5-8b6568a58a89 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:22.237032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.237032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.237285 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.237822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.237932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.238279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.238736 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.239194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.239774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.240183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.240594 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.241041 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.241520 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.242838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.242838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.243051 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.243490 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.249486 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cc71e523-1302-4fb8-a1b3-ee547d55fd58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 14104 time: 0.1878710 Dec 10 14:26:22.252910 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dcbc5b69-c557-4ba5-80e1-48cee1db21b1 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "DELETE /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags HTTP/1.1" status: 204 len: 168 time: 0.3761320 Dec 10 14:26:22.253038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54664) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:22.253038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54666) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:22.262893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-9b2ab8eb-fd27-4160-bd71-8f96b92e53fe tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae', 'tempest-TagsTest-Tag-944198875') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:22.271361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event updated for resources: {'Port': ['ID=fe998eab-939b-40bf-b774-7d0d0bdc7807,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:22.316873 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.322279 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-781be825-7680-4fb7-8a67-c13b1b26578f None None] Provisioning complete for port fe998eab-939b-40bf-b774-7d0d0bdc7807 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:22.322736 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-781be825-7680-4fb7-8a67-c13b1b26578f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.323107 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:22.323743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.370870 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-781be825-7680-4fb7-8a67-c13b1b26578f None None] Port fe998eab-939b-40bf-b774-7d0d0bdc7807 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:22.400479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.439808 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c54e83b-a620-41f5-a5fe-95fdffe6ef23 None None] Network 0d5d465c-7c22-4460-bec0-9f82527dd175 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:22.522566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ed5d83c9-8dc5-4c19-893f-17754d28529a None None] Provisioning complete for port 7a12c85e-adc8-420c-badb-38bb93a49777 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:22.522939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ed5d83c9-8dc5-4c19-893f-17754d28529a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.526821 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-9b2ab8eb-fd27-4160-bd71-8f96b92e53fe tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] show failed (client error): The resource could not be found. Dec 10 14:26:22.530867 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9b2ab8eb-fd27-4160-bd71-8f96b92e53fe tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "GET /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags/tempest-TagsTest-Tag-944198875 HTTP/1.1" status: 404 len: 325 time: 0.2711222 Dec 10 14:26:22.532815 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54668) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:22.540955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-b4642821-f854-4b91-b392-0e0afc4b9a21 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae', 'tempest-TagsTest-Tag-9209187') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:22.568696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-77d1c514-def9-4077-b788-446790f08f35 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Deleting port c024ff13-25dc-4781-9300-6fc3159a3840 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:22.572517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-77d1c514-def9-4077-b788-446790f08f35 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.643938 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7a12c85e-adc8-420c-badb-38bb93a49777 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:22.700086 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ed5d83c9-8dc5-4c19-893f-17754d28529a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.715809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07f9d4de-15ae-4077-94bf-14a7d90aa610 None None] DHCP port deletion for 0d5d465c-7c22-4460-bec0-9f82527dd175 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:22.760365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-77d1c514-def9-4077-b788-446790f08f35 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] For port c024ff13-25dc-4781-9300-6fc3159a3840, host hv-neutron-8214, got binding levels [] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:22.760365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-77d1c514-def9-4077-b788-446790f08f35 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.761661 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.785545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ed5d83c9-8dc5-4c19-893f-17754d28529a None None] For port 7a12c85e-adc8-420c-badb-38bb93a49777, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7a12c85e-adc8-420c-badb-38bb93a49777,segment=NetworkSegment(c9ae1534-e9f2-46ae-b8db-99b242ade57f),segment_id=c9ae1534-e9f2-46ae-b8db-99b242ade57f)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:22.787510 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 7a12c85e-adc8-420c-badb-38bb93a49777 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:22.788163 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.807787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-77d1c514-def9-4077-b788-446790f08f35 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Calling delete_port for c024ff13-25dc-4781-9300-6fc3159a3840 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:22.814031 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-b4642821-f854-4b91-b392-0e0afc4b9a21 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] show failed (client error): The resource could not be found. Dec 10 14:26:22.817931 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b4642821-f854-4b91-b392-0e0afc4b9a21 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "GET /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags/tempest-TagsTest-Tag-9209187 HTTP/1.1" status: 404 len: 323 time: 0.2794905 Dec 10 14:26:22.823649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54670) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:22.825320 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.tag.tag_plugin [None req-992fbbf1-4e89-4e6d-ac10-1e2925baa60b tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', 'c4f1707a-3551-4067-96e9-1931573839ae') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:22.830230 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 797 time: 1.8285120 Dec 10 14:26:22.833066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54672) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:22.833229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for 75de2cec-62f6-4af4-b128-88ca88f2ae1b owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:22.839321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'subnet': {'network_id': '77457432-514b-48cd-95c7-0516e6ca0668', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:22.847302 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ed5d83c9-8dc5-4c19-893f-17754d28529a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.858041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-07f9d4de-15ae-4077-94bf-14a7d90aa610 None None] Deleting port 7a12c85e-adc8-420c-badb-38bb93a49777 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:22.858041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-07f9d4de-15ae-4077-94bf-14a7d90aa610 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.887216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.893034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:22.898391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34fb991a-a5ee-4913-be18-1d07ccdb8a2d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Network': ['ID=77457432-514b-48cd-95c7-0516e6ca0668,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:22.956760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 77457432-514b-48cd-95c7-0516e6ca0668 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:23.037147 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-07f9d4de-15ae-4077-94bf-14a7d90aa610 None None] For port 7a12c85e-adc8-420c-badb-38bb93a49777, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7a12c85e-adc8-420c-badb-38bb93a49777,segment=NetworkSegment(c9ae1534-e9f2-46ae-b8db-99b242ade57f),segment_id=c9ae1534-e9f2-46ae-b8db-99b242ade57f)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:23.037490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-07f9d4de-15ae-4077-94bf-14a7d90aa610 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.070781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-07f9d4de-15ae-4077-94bf-14a7d90aa610 None None] Calling delete_port for 7a12c85e-adc8-420c-badb-38bb93a49777 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:23.077897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.078434 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 8459f55b-e06f-4a89-aa8a-4bdfcd80d6c6 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:23.080807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port 7a12c85e-adc8-420c-badb-38bb93a49777 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:23.081123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.114834 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed5d83c9-8dc5-4c19-893f-17754d28529a None None] Pushing event updated for resources: {'Port': ['ID=7a12c85e-adc8-420c-badb-38bb93a49777,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:23.169132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port 7a12c85e-adc8-420c-badb-38bb93a49777, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7a12c85e-adc8-420c-badb-38bb93a49777,segment=NetworkSegment(c9ae1534-e9f2-46ae-b8db-99b242ade57f),segment_id=c9ae1534-e9f2-46ae-b8db-99b242ade57f)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:23.169132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.185766 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for 7a12c85e-adc8-420c-badb-38bb93a49777 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:23.219536 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.264099 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] create failed (client error): There was a conflict when trying to complete your request. Dec 10 14:26:23.265884 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-307c3530-6fd5-4473-b945-e691ebbaec2e tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 409 len: 371 time: 3.6964829 Dec 10 14:26:23.269557 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-07f9d4de-15ae-4077-94bf-14a7d90aa610 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.272882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54674) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:23.302698 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07f9d4de-15ae-4077-94bf-14a7d90aa610 None None] Pushing event deleted for resources: {'Port': ['ID=7a12c85e-adc8-420c-badb-38bb93a49777,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:23.306277 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07f9d4de-15ae-4077-94bf-14a7d90aa610 None None] No DVR routers for this DVR port 7a12c85e-adc8-420c-badb-38bb93a49777 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:23.328194 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cf0eae9-3050-4cc8-91f0-a853a0c4daf9 None None] Network 0d5d465c-7c22-4460-bec0-9f82527dd175 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:23.381253 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.399293 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-992fbbf1-4e89-4e6d-ac10-1e2925baa60b tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "DELETE /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae/tags HTTP/1.1" status: 204 len: 168 time: 0.5778399 Dec 10 14:26:23.403531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54676) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:23.415881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.418909 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=7a12c85e-adc8-420c-badb-38bb93a49777,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:23.427803 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port 7a12c85e-adc8-420c-badb-38bb93a49777 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:23.476091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=75de2cec-62f6-4af4-b128-88ca88f2ae1b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:23.479739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-141e7ddf-10ec-4cff-a3bd-30ad1d1fe990 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Deleting port c5373a3c-bfd5-40fd-9d6e-538c7a3bedb0 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:23.480252 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-141e7ddf-10ec-4cff-a3bd-30ad1d1fe990 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.502783 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-77d1c514-def9-4077-b788-446790f08f35 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.504304 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Made reservation on behalf of ef5003e8d7fc43dcb8d6e7196c2360d1 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:23.507775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.508783 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e381c62-0693-4c66-8b6a-6fa9c678898f None None] DHCP port deletion for 826f4ffe-6ffa-44c2-a055-d6d8b94c119d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:23.594197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77d1c514-def9-4077-b788-446790f08f35 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event deleted for resources: {'Port': ['ID=c024ff13-25dc-4781-9300-6fc3159a3840,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:23.627298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-77d1c514-def9-4077-b788-446790f08f35 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.629066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.630558 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-77d1c514-def9-4077-b788-446790f08f35 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "DELETE /v2.0/ports/c024ff13-25dc-4781-9300-6fc3159a3840 HTTP/1.1" status: 204 len: 168 time: 1.3776891 Dec 10 14:26:23.635469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54678) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:23.668885 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.700056 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-beb40e52-9952-4d2f-8c18-5e3376d52957 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] GET failed (client error): The resource could not be found. Dec 10 14:26:23.701973 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-beb40e52-9952-4d2f-8c18-5e3376d52957 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "GET /v2.0/ports/c024ff13-25dc-4781-9300-6fc3159a3840 HTTP/1.1" status: 404 len: 333 time: 0.0595844 Dec 10 14:26:23.706292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54680) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:23.706866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d5d465c-7c22-4460-bec0-9f82527dd175']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:23.717154 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-741690411', 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:23.724587 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c9ae1534-e9f2-46ae-b8db-99b242ade57f') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:23.724925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c9ae1534-e9f2-46ae-b8db-99b242ade57f') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:23.727667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.770981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.773691 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-141e7ddf-10ec-4cff-a3bd-30ad1d1fe990 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.800010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-141e7ddf-10ec-4cff-a3bd-30ad1d1fe990 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Calling delete_port for c5373a3c-bfd5-40fd-9d6e-538c7a3bedb0 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:23.803441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.818657 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 374 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:23.819046 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:23.822649 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:23.931063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.939066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Made reservation on behalf of 73dc370c75ab42df98c43f1e3c0887e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:23.941553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.968175 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:23.987730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c4f1707a-3551-4067-96e9-1931573839ae']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.022985 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.024020 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] device_id is not set on port 33c07217-a0aa-4d66-a07d-c67770e99461 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:24.036737 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.036838 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/0d5d465c-7c22-4460-bec0-9f82527dd175 HTTP/1.1" status: 204 len: 168 time: 3.3040633 Dec 10 14:26:24.040584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54682) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:24.045176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eb5942f5-2399-4724-8439-b5bf891f264e') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.045499 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eb5942f5-2399-4724-8439-b5bf891f264e') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.090978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.094772 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510c7264-6e9a-4b23-ab66-2a9b85710342 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=0d5d465c-7c22-4460-bec0-9f82527dd175,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:24.102296 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-c8b42775-49de-4ffb-8021-fb551f4dce22 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:24.102845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c8b42775-49de-4ffb-8021-fb551f4dce22 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:24.106259 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c8b42775-49de-4ffb-8021-fb551f4dce22 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/0d5d465c-7c22-4460-bec0-9f82527dd175 HTTP/1.1" status: 404 len: 339 time: 0.0615106 Dec 10 14:26:24.110753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54684) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:24.118051 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1896343296', 'description': 'd1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:24.128684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.154000 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Releasing vlan 395 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:24.154393 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:24.157286 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:24.272522 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.277317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Router e99fc658-fff4-4ea9-a04c-33ee04a756ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:26:24.320305 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Router 8495a697-fa67-4075-9473-6536f238aea6 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:26:24.320575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-141e7ddf-10ec-4cff-a3bd-30ad1d1fe990 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.322215 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:24.325854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.353526 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-141e7ddf-10ec-4cff-a3bd-30ad1d1fe990 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Pushing event deleted for resources: {'Port': ['ID=c5373a3c-bfd5-40fd-9d6e-538c7a3bedb0,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:24.374337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20c0038d-f433-4693-8a41-6f7b34d5eeaa None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:24.376231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.384309 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.400642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.405434 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] 10.222.0.57 "DELETE /v2.0/networks/c4f1707a-3551-4067-96e9-1931573839ae HTTP/1.1" status: 204 len: 168 time: 1.0006073 Dec 10 14:26:24.406330 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Subnet': ['ID=a648a80e-9761-4658-b2e6-f0ee19b475b4,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:24.426563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 393, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:24.463012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-141e7ddf-10ec-4cff-a3bd-30ad1d1fe990 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.470692 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-141e7ddf-10ec-4cff-a3bd-30ad1d1fe990 tempest-RoutersAdminNegativeIpV6Test-2089364351 tempest-RoutersAdminNegativeIpV6Test-2089364351-project-admin] 10.222.0.57 "DELETE /v2.0/ports/c5373a3c-bfd5-40fd-9d6e-538c7a3bedb0 HTTP/1.1" status: 204 len: 168 time: 1.1949766 Dec 10 14:26:24.472424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:24.480937 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d8e8c45d-299d-41fc-b9f7-c934c43ae9aa tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "PUT /v2.0/routers/e99fc658-fff4-4ea9-a04c-33ee04a756ca/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6048067 Dec 10 14:26:24.482035 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54690) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:24.483316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-746f882a-0a51-4c5d-b16f-c467d8255790 None None] Sync routers for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:24.500173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-746f882a-0a51-4c5d-b16f-c467d8255790 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:24.501991 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-746f882a-0a51-4c5d-b16f-c467d8255790 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.523902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d07758d9-e524-4240-83fb-d6c6392bb589 tempest-TagsTest-868070268 tempest-TagsTest-868070268-project] Pushing event deleted for resources: {'Network': ['ID=c4f1707a-3551-4067-96e9-1931573839ae,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:24.576435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-746f882a-0a51-4c5d-b16f-c467d8255790 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.586721 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7a12c85e-adc8-420c-badb-38bb93a49777 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:24.593599 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.593945 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment 8e48b4c5-905c-447e-96f3-8d1a73159c97 of type vlan for network 9ddf0294-56c5-4f80-b9f2-88a181652931 Dec 10 14:26:24.613499 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-746f882a-0a51-4c5d-b16f-c467d8255790 None None] Routers {'e99fc658-fff4-4ea9-a04c-33ee04a756ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:24.614392 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.615402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-746f882a-0a51-4c5d-b16f-c467d8255790 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.617750 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 7a12c85e-adc8-420c-badb-38bb93a49777 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:24.618293 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7a12c85e-adc8-420c-badb-38bb93a49777 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:24.636107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Checking segment: {'id': '636ba934-3565-4c09-b7f6-90de379fe518', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '77457432-514b-48cd-95c7-0516e6ca0668'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:24.636107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Network hostable DHCP agents. Network: 77457432-514b-48cd-95c7-0516e6ca0668, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:24.661382 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-746f882a-0a51-4c5d-b16f-c467d8255790 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.662241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-746f882a-0a51-4c5d-b16f-c467d8255790 None None] The sync data for ids ['e99fc658-fff4-4ea9-a04c-33ee04a756ca'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:24.707944 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.725753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.732344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.789320 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Network 43123a64-63e8-41a8-a5f9-b7b478de3cbc is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:24.802049 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:24.806939 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'Port': ['ID=33c07217-a0aa-4d66-a07d-c67770e99461,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:24.809032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:24.809969 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:24.810595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.814533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:24.827809 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4682ba6-b72a-4210-9f90-b087704b43e7 None None] Sync routers for ids ['8495a697-fa67-4075-9473-6536f238aea6'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:24.839464 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4682ba6-b72a-4210-9f90-b087704b43e7 None None] Routers {'8495a697-fa67-4075-9473-6536f238aea6'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:24.839914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting port be184c7a-d36c-4620-8632-abcb07e7c70e {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:24.840384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.840479 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f4682ba6-b72a-4210-9f90-b087704b43e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['8495a697-fa67-4075-9473-6536f238aea6'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.846982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Network 77457432-514b-48cd-95c7-0516e6ca0668 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:24.873875 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f4682ba6-b72a-4210-9f90-b087704b43e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.883234 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4682ba6-b72a-4210-9f90-b087704b43e7 None None] Routers {'8495a697-fa67-4075-9473-6536f238aea6'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:24.884618 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f4682ba6-b72a-4210-9f90-b087704b43e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['8495a697-fa67-4075-9473-6536f238aea6'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.898439 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.905574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:24.908498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.919768 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f4682ba6-b72a-4210-9f90-b087704b43e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:24.920755 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4682ba6-b72a-4210-9f90-b087704b43e7 None None] The sync data for ids ['8495a697-fa67-4075-9473-6536f238aea6'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:24.937693 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1ef4bc88-464a-4e7c-b8dd-b3bbb6f4d01b tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 1.2270277 Dec 10 14:26:24.941460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54694) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:24.943760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.948262 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1c1af2bc-ff95-4bde-ac70-d4040018d41a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 5.0476182 Dec 10 14:26:24.948262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 77457432-514b-48cd-95c7-0516e6ca0668) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:24.953614 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54696) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:24.958631 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5a95e02-2e71-4a39-a8ed-6c24d9b065f8 None None] Network 77457432-514b-48cd-95c7-0516e6ca0668 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:24.970701 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:24.979247 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:24.980407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.006942 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=9ddf0294-56c5-4f80-b9f2-88a181652931,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:25.032607 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fd6884f1-0d48-4dfe-b1c0-851e83771770 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 0.9188941 Dec 10 14:26:25.035346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54698) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.046179 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Calling delete_port for be184c7a-d36c-4620-8632-abcb07e7c70e owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:25.058223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54702) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.078774 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 9ddf0294-56c5-4f80-b9f2-88a181652931 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:25.090121 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2e4a3b64-0a3f-4623-a4ac-43f4f2159412 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.2554474 Dec 10 14:26:25.090734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54706) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.107345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'port': {'network_id': '77457432-514b-48cd-95c7-0516e6ca0668', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-140497778'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:25.140398 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-77457432-514b-48cd-95c7-0516e6ca0668', 'network_id': '77457432-514b-48cd-95c7-0516e6ca0668', 'project_id': 'ef5003e8d7fc43dcb8d6e7196c2360d1', 'fixed_ips': [{'subnet_id': 'a648a80e-9761-4658-b2e6-f0ee19b475b4'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:25.141589 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.239960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54708) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.326787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67f1be18-6bb1-4ed4-b769-9c5eb9f053cd tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:25.328350 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-67f1be18-6bb1-4ed4-b769-9c5eb9f053cd tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/networks?id=9ddf0294-56c5-4f80-b9f2-88a181652931 HTTP/1.1" status: 200 len: 761 time: 0.2921047 Dec 10 14:26:25.340745 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54712) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.347056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-afa5a3ce-d013-415f-8188-d94633856e4f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'description': 'd2'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:25.354915 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Allocated IP 2001:db8::2 (77457432-514b-48cd-95c7-0516e6ca0668/a648a80e-9761-4658-b2e6-f0ee19b475b4/f4650184-7cc9-47a7-8dd8-70444267dc97) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:25.378753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e6a2bf50-c981-410f-8c58-c8115a0877a4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.407854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Made reservation on behalf of ef5003e8d7fc43dcb8d6e7196c2360d1 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:25.411414 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.444392 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8107cce5-c0c8-4019-b8f4-9cc6f18f09d0 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=8281f96db1de4d1aa07605815db4f2fe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3850386 Dec 10 14:26:25.453364 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54714) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.479994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] device_id is not set on port 9e947d7d-3e7d-4059-8b03-bc42b7f966c0 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:25.508590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.567475 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.619474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Network 77457432-514b-48cd-95c7-0516e6ca0668 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:25.622780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:25.628249 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:25.633578 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d4fe72f-9277-4b0a-956e-3f1722525aba tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:25.635037 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6d4fe72f-9277-4b0a-956e-3f1722525aba tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "GET /v2.0/ports/33c07217-a0aa-4d66-a07d-c67770e99461 HTTP/1.1" status: 200 len: 958 time: 0.6886575 Dec 10 14:26:25.639241 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54716) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.659986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Pushing event updated for resources: {'Port': ['ID=f4650184-7cc9-47a7-8dd8-70444267dc97,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:25.691861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Attempting to bind port f4650184-7cc9-47a7-8dd8-70444267dc97 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:25.692229 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Attempting to bind port f4650184-7cc9-47a7-8dd8-70444267dc97 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '636ba934-3565-4c09-b7f6-90de379fe518', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '77457432-514b-48cd-95c7-0516e6ca0668'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:25.693195 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Attempting to bind port f4650184-7cc9-47a7-8dd8-70444267dc97 on network 77457432-514b-48cd-95c7-0516e6ca0668 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:25.698950 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:25.699318 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Checking segment: {'id': '636ba934-3565-4c09-b7f6-90de379fe518', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '77457432-514b-48cd-95c7-0516e6ca0668'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:25.699890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.700285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Bound using segment: {'id': '636ba934-3565-4c09-b7f6-90de379fe518', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '77457432-514b-48cd-95c7-0516e6ca0668'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:25.700775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Bound port: f4650184-7cc9-47a7-8dd8-70444267dc97, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '636ba934-3565-4c09-b7f6-90de379fe518', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '77457432-514b-48cd-95c7-0516e6ca0668'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:25.701331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.715696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa5a3ce-d013-415f-8188-d94633856e4f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.718586 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-69401faa-734b-477c-9bc3-55318ca70dec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.752439 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e4180f6f-27ed-4e0d-b192-edb495ad06f1 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/routers/8495a697-fa67-4075-9473-6536f238aea6 HTTP/1.1" status: 200 len: 924 time: 0.7894170 Dec 10 14:26:25.755235 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54718) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.773795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] For port f4650184-7cc9-47a7-8dd8-70444267dc97, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:25.778048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] For port f4650184-7cc9-47a7-8dd8-70444267dc97, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4650184-7cc9-47a7-8dd8-70444267dc97,segment=NetworkSegment(636ba934-3565-4c09-b7f6-90de379fe518),segment_id=636ba934-3565-4c09-b7f6-90de379fe518)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:25.781895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e6a2bf50-c981-410f-8c58-c8115a0877a4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.782544 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-69401faa-734b-477c-9bc3-55318ca70dec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.783494 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7e5792b2-f2d2-41ab-82e1-98905af63d55 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=8495a697-fa67-4075-9473-6536f238aea6 HTTP/1.1" status: 200 len: 205 time: 0.0271978 Dec 10 14:26:25.786021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54720) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.799720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Allocated IP 2001:db8::b5 (77457432-514b-48cd-95c7-0516e6ca0668/a648a80e-9761-4658-b2e6-f0ee19b475b4/9e947d7d-3e7d-4059-8b03-bc42b7f966c0) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:25.827965 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.856996 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa5a3ce-d013-415f-8188-d94633856e4f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.869572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Port': ['ID=be184c7a-d36c-4620-8632-abcb07e7c70e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:25.883660 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-afa5a3ce-d013-415f-8188-d94633856e4f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 9ddf0294-56c5-4f80-b9f2-88a181652931 is not hosted by any dhcp agent {{(pid=103810) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 10 14:26:25.889326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.889967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afa5a3ce-d013-415f-8188-d94633856e4f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:25.890275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa5a3ce-d013-415f-8188-d94633856e4f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.894023 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-afa5a3ce-d013-415f-8188-d94633856e4f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "PUT /v2.0/networks/9ddf0294-56c5-4f80-b9f2-88a181652931 HTTP/1.1" status: 200 len: 758 time: 0.5498371 Dec 10 14:26:25.896750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54722) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:25.900141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6282cdb9-b240-4b77-a16e-339e4cd8ebfa tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Deleting port 33c07217-a0aa-4d66-a07d-c67770e99461 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:25.900491 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6282cdb9-b240-4b77-a16e-339e4cd8ebfa tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.905196 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45b49d02-d9a0-4828-a91f-73ee5e642cc6 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:25.924744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e6a2bf50-c981-410f-8c58-c8115a0877a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:25.977575 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb506641-6180-4e64-ae8d-4b94dfe04b83 None None] Pushing event updated for resources: {'Port': ['ID=f4650184-7cc9-47a7-8dd8-70444267dc97,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:26.185560 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.196935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b47b4d7a-a9d6-4f31-84c6-e98b634de2c3 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:26.198472 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b47b4d7a-a9d6-4f31-84c6-e98b634de2c3 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/networks?id=9ddf0294-56c5-4f80-b9f2-88a181652931 HTTP/1.1" status: 200 len: 761 time: 0.2959392 Dec 10 14:26:26.201776 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.204106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6282cdb9-b240-4b77-a16e-339e4cd8ebfa tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.206388 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54724) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:26.238457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-139914028'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:26.261484 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-69401faa-734b-477c-9bc3-55318ca70dec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.264033 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-69401faa-734b-477c-9bc3-55318ca70dec admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.267660 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-69401faa-734b-477c-9bc3-55318ca70dec admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/2d1f3f88-f195-4332-9fdd-29ce9c635cb7 HTTP/1.1" status: 204 len: 168 time: 0.8112984 Dec 10 14:26:26.283447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afa5a3ce-d013-415f-8188-d94633856e4f tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=9ddf0294-56c5-4f80-b9f2-88a181652931,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:26.294289 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e6a2bf50-c981-410f-8c58-c8115a0877a4 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=a181567104d9473fbf2b12df838a46b8&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0532172 Dec 10 14:26:26.300360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54728) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:26.304672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 9ddf0294-56c5-4f80-b9f2-88a181652931 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:26.330663 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6a2bf50-c981-410f-8c58-c8115a0877a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=724c951b-f467-4f23-9a67-5d97f5c6dee4,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:26.350433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.353801 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.385552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69401faa-734b-477c-9bc3-55318ca70dec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d1f3f88-f195-4332-9fdd-29ce9c635cb7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:26.416272 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.430069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6800a068-4a74-4984-973e-e6baedbc4692 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.466056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6800a068-4a74-4984-973e-e6baedbc4692 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.474284 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6282cdb9-b240-4b77-a16e-339e4cd8ebfa tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Calling delete_port for 33c07217-a0aa-4d66-a07d-c67770e99461 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:26.549569 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.567520 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.568069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Fanout notify agent at l3_agent the message router_deleted on router e99fc658-fff4-4ea9-a04c-33ee04a756ca {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:26.582883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.586415 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b0ed972c-1afb-45db-8be9-a3c96adc4f15 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/routers/e99fc658-fff4-4ea9-a04c-33ee04a756ca HTTP/1.1" status: 204 len: 168 time: 2.1010652 Dec 10 14:26:26.592874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54730) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:26.603698 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Network 77457432-514b-48cd-95c7-0516e6ca0668 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:26.607571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:26.611921 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:26.615764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4650184-7cc9-47a7-8dd8-70444267dc97 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:26.617693 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:26.618833 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.628194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6800a068-4a74-4984-973e-e6baedbc4692 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.630843 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6800a068-4a74-4984-973e-e6baedbc4692 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.632010 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6800a068-4a74-4984-973e-e6baedbc4692 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/724c951b-f467-4f23-9a67-5d97f5c6dee4 HTTP/1.1" status: 204 len: 168 time: 0.3287601 Dec 10 14:26:26.643625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:26.645734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6800a068-4a74-4984-973e-e6baedbc4692 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=724c951b-f467-4f23-9a67-5d97f5c6dee4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:26.645734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Port': ['ID=9e947d7d-3e7d-4059-8b03-bc42b7f966c0,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:26.647486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.701095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.724185 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4320796c-17fe-415a-ad03-7598cc8740f3 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 942 time: 1.6215768 Dec 10 14:26:26.725789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54736) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:26.727576 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-5ed28b29-9e27-4197-b5d2-919fb8870e23 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Deleting subnet acea17da-7f1b-4834-9b60-5d797c3b126f {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:26:26.730581 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 374, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:26.736190 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'port': {'network_id': '77457432-514b-48cd-95c7-0516e6ca0668', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-2101425220', 'allowed_address_pairs': [{'ip_address': '2001:db8::b5', 'mac_address': 'fa:16:3e:14:5a:ef'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:26.737044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ed28b29-9e27-4197-b5d2-919fb8870e23 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.758197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port f4650184-7cc9-47a7-8dd8-70444267dc97 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:26.759176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.780391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.780740 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment e34420d9-18cb-4325-bbd8-5681e37c4aa8 of type vlan for network 2fe74820-6fc2-45a6-9344-8f6da3a07469 Dec 10 14:26:26.846510 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ed28b29-9e27-4197-b5d2-919fb8870e23 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.848878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6282cdb9-b240-4b77-a16e-339e4cd8ebfa tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.917163 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.978203 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port f4650184-7cc9-47a7-8dd8-70444267dc97, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4650184-7cc9-47a7-8dd8-70444267dc97,segment=NetworkSegment(636ba934-3565-4c09-b7f6-90de379fe518),segment_id=636ba934-3565-4c09-b7f6-90de379fe518)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:26.980754 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6282cdb9-b240-4b77-a16e-339e4cd8ebfa tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event deleted for resources: {'Port': ['ID=33c07217-a0aa-4d66-a07d-c67770e99461,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:26.996208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:26.998852 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6282cdb9-b240-4b77-a16e-339e4cd8ebfa tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.002298 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6282cdb9-b240-4b77-a16e-339e4cd8ebfa tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "DELETE /v2.0/ports/33c07217-a0aa-4d66-a07d-c67770e99461 HTTP/1.1" status: 204 len: 168 time: 1.3612978 Dec 10 14:26:27.006682 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54744) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:27.030769 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ed28b29-9e27-4197-b5d2-919fb8870e23 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.036350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Made reservation on behalf of ef5003e8d7fc43dcb8d6e7196c2360d1 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:27.042646 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-e82bff32-9c65-4c68-baa9-747a39315445 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] GET failed (client error): The resource could not be found. Dec 10 14:26:27.047838 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e82bff32-9c65-4c68-baa9-747a39315445 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "GET /v2.0/ports/33c07217-a0aa-4d66-a07d-c67770e99461 HTTP/1.1" status: 404 len: 333 time: 0.0363784 Dec 10 14:26:27.054440 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54746) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:27.058496 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.060806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Request body: {'port': {'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-167060310'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:27.099154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Deleting port fe998eab-939b-40bf-b774-7d0d0bdc7807 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:27.099154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.152200 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.163969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:27.163969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.180206 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=f4650184-7cc9-47a7-8dd8-70444267dc97,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:27.195750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.221750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Made reservation on behalf of 73dc370c75ab42df98c43f1e3c0887e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:27.224780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.244203 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] device_id is not set on port a0c498ed-fc34-4d67-8876-ac34ea0888b5 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:27.257750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] device_id is not set on port e620c82f-03e7-4b8c-8925-bc88480d4ba6 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:27.266120 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=2fe74820-6fc2-45a6-9344-8f6da3a07469,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:27.286715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 2fe74820-6fc2-45a6-9344-8f6da3a07469 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:27.367396 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1fddb6e3-fa0d-4e8f-8135-cfd0fce58cf6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.1330020 Dec 10 14:26:27.368112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54756) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:27.370675 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.376392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0da30b9-7d47-4880-b56a-8bd298f27131 None None] Network 77457432-514b-48cd-95c7-0516e6ca0668 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:27.379003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': '2fe74820-6fc2-45a6-9344-8f6da3a07469', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:27.511891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ed28b29-9e27-4197-b5d2-919fb8870e23 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.532011 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Allocated IP 2001:db8::367 (77457432-514b-48cd-95c7-0516e6ca0668/a648a80e-9761-4658-b2e6-f0ee19b475b4/a0c498ed-fc34-4d67-8876-ac34ea0888b5) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:27.558372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ed28b29-9e27-4197-b5d2-919fb8870e23 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.564523 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5ed28b29-9e27-4197-b5d2-919fb8870e23 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/subnets/acea17da-7f1b-4834-9b60-5d797c3b126f HTTP/1.1" status: 204 len: 168 time: 0.9705963 Dec 10 14:26:27.564523 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Calling delete_port for fe998eab-939b-40bf-b774-7d0d0bdc7807 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:27.564828 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54760) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:27.566255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed28b29-9e27-4197-b5d2-919fb8870e23 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Subnet': ['ID=acea17da-7f1b-4834-9b60-5d797c3b126f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:27.596394 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:27.599764 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.646402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adc2d193-9401-46d4-93a9-7a332b29036a None None] Network 826f4ffe-6ffa-44c2-a055-d6d8b94c119d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:27.654138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-860e80d6-e750-45b2-9b51-d4438c7e23f4 None None] Provisioning complete for port f4650184-7cc9-47a7-8dd8-70444267dc97 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:27.655523 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-860e80d6-e750-45b2-9b51-d4438c7e23f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.671921 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54764) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:27.723571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.755313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54766) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:27.762562 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [-] 10.222.0.57 "GET / HTTP/1.1" status: 200 len: 248 time: 0.0026360 Dec 10 14:26:27.767101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54768) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:27.771730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.817962 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6ce0f243-8b4a-4a85-bf9a-f8ce67ae29f4 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=c49505f36ecb43908e4b23e23c4ebbbf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1411707 Dec 10 14:26:27.820567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54772) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:27.831929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e2b6bcb-8ab7-4eec-a52c-db0b16666eb5 None None] DHCP port deletion for 826f4ffe-6ffa-44c2-a055-d6d8b94c119d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:27.911694 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:27.981264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-17f69e4e-c447-487b-8c43-0f14c9b92cf4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.011827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-17f69e4e-c447-487b-8c43-0f14c9b92cf4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.016688 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Network 43123a64-63e8-41a8-a5f9-b7b478de3cbc is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:28.025896 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:28.038014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'Port': ['ID=e620c82f-03e7-4b8c-8925-bc88480d4ba6,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:28.040312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:28.041459 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:28.041963 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.063842 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1d9ed9a8-528b-49eb-afde-20111a22837b tempest-NetworksApiDiscovery-1128369237 tempest-NetworksApiDiscovery-1128369237-project] 10.222.0.57 "GET /v2.0/ HTTP/1.1" status: 200 len: 702 time: 0.2850945 Dec 10 14:26:28.063842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.098103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.111879 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event deleted for resources: {'Port': ['ID=fe998eab-939b-40bf-b774-7d0d0bdc7807,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:28.117236 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a08b8704-0041-4c53-8b14-b4d4d74d718f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 1.0615814 Dec 10 14:26:28.133891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54778) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:28.145887 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:28.151372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.168356 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c52a31ee-bec4-4926-823b-faadea9152fe None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:28.206910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['826f4ffe-6ffa-44c2-a055-d6d8b94c119d']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:28.215559 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e9ed48d8-bbe2-4975-ace2-eac9de3afd5d None None] Provisioning complete for port f4650184-7cc9-47a7-8dd8-70444267dc97 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:28.221637 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9ed48d8-bbe2-4975-ace2-eac9de3afd5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.243399 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cc4d61a3-bb09-4317-90f0-1e5bb5ebbe81') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:28.243399 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cc4d61a3-bb09-4317-90f0-1e5bb5ebbe81') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:28.255967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.264700 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.277661 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.298662 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.327166 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Releasing vlan 397 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:28.327577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:28.330844 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:28.333130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.347180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.368620 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e9ed48d8-bbe2-4975-ace2-eac9de3afd5d None None] Provisioning complete for port 9e947d7d-3e7d-4059-8b03-bc42b7f966c0 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:28.369217 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9ed48d8-bbe2-4975-ace2-eac9de3afd5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.423712 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e9ed48d8-bbe2-4975-ace2-eac9de3afd5d None None] Port 9e947d7d-3e7d-4059-8b03-bc42b7f966c0 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:28.429058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=3d99e95b-0bf6-4cec-9d8b-7b1d7eeda33b,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:28.455448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Network 77457432-514b-48cd-95c7-0516e6ca0668 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:28.478785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.486558 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.492964 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Port': ['ID=a0c498ed-fc34-4d67-8876-ac34ea0888b5,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:28.499523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:28.507730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:28.508717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:28.509826 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.545561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': 'e34420d9-18cb-4325-bbd8-5681e37c4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '2fe74820-6fc2-45a6-9344-8f6da3a07469'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:28.545939 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: 2fe74820-6fc2-45a6-9344-8f6da3a07469, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:28.551627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-17f69e4e-c447-487b-8c43-0f14c9b92cf4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.552675 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-17f69e4e-c447-487b-8c43-0f14c9b92cf4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.553939 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-17f69e4e-c447-487b-8c43-0f14c9b92cf4 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/34c9dfd3-eb20-4165-9430-a2ad888e4f49 HTTP/1.1" status: 204 len: 168 time: 0.7324462 Dec 10 14:26:28.556123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.566215 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-41abe85c-e486-4561-9da5-d6e47eabe54a None None] Provisioning complete for port 9e947d7d-3e7d-4059-8b03-bc42b7f966c0 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:28.566215 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-41abe85c-e486-4561-9da5-d6e47eabe54a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.566895 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f69e4e-c447-487b-8c43-0f14c9b92cf4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34c9dfd3-eb20-4165-9430-a2ad888e4f49,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:28.594177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.603637 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] 10.222.0.57 "DELETE /v2.0/networks/826f4ffe-6ffa-44c2-a055-d6d8b94c119d HTTP/1.1" status: 204 len: 168 time: 1.0351844 Dec 10 14:26:28.613472 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f5ad3b0b-a2cc-4068-bf2a-d191c00dde1d tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1007 time: 1.8850777 Dec 10 14:26:28.615474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54784) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:28.629645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4650184-7cc9-47a7-8dd8-70444267dc97 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:28.653306 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b902a445-daa2-470b-a4f7-12d829fb2a33 tempest-FloatingIPTestJSON-1250740132 tempest-FloatingIPTestJSON-1250740132-project] Pushing event deleted for resources: {'Network': ['ID=826f4ffe-6ffa-44c2-a055-d6d8b94c119d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:28.676183 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.676876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Fanout notify agent at l3_agent the message router_deleted on router 8495a697-fa67-4075-9473-6536f238aea6 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:28.684807 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] device_id is not set on port e620c82f-03e7-4b8c-8925-bc88480d4ba6 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:28.685713 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network 2fe74820-6fc2-45a6-9344-8f6da3a07469 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:28.695621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-41abe85c-e486-4561-9da5-d6e47eabe54a None None] Port 9e947d7d-3e7d-4059-8b03-bc42b7f966c0 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:28.699672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.707806 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.713060 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ca2efad9-d0db-4545-bd1b-ce6e099cbb14 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/8495a697-fa67-4075-9473-6536f238aea6 HTTP/1.1" status: 204 len: 168 time: 2.9223063 Dec 10 14:26:28.713238 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54786) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:28.717772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'router': {'name': 'tempest-snat-router-902226828', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': False}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:28.720335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port f4650184-7cc9-47a7-8dd8-70444267dc97 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:28.720891 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.751070 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.791614 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89df8df0-ab32-4608-9231-c006dab87c3b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:28.797870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89df8df0-ab32-4608-9231-c006dab87c3b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:28.806086 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89df8df0-ab32-4608-9231-c006dab87c3b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:28.807888 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-89df8df0-ab32-4608-9231-c006dab87c3b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2481 time: 0.1912513 Dec 10 14:26:28.810518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 2fe74820-6fc2-45a6-9344-8f6da3a07469) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:28.812919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54790) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:28.822735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd51616e-d00d-4b0e-876a-1f70869ba81c None None] Network 2fe74820-6fc2-45a6-9344-8f6da3a07469 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:28.839964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:28.840593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.888750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.889837 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.927156 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'Port': ['ID=e620c82f-03e7-4b8c-8925-bc88480d4ba6,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:28.932372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:28.932717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:28.933067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:28.936394 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54794) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:28.950142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:28.950625 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:28.953320 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 2 to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 Dec 10 14:26:28.961605 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-2fe74820-6fc2-45a6-9344-8f6da3a07469', 'network_id': '2fe74820-6fc2-45a6-9344-8f6da3a07469', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': '3d99e95b-0bf6-4cec-9d8b-7b1d7eeda33b'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:28.963239 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:28.973844 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:28.974189 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:28.974528 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:28.981874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:28.982352 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:28.984090 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 3 to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 Dec 10 14:26:29.015947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-69e0028a-1ea2-4808-9d85-3405269a3fc9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Deleting port a0c498ed-fc34-4d67-8876-ac34ea0888b5 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:29.017203 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-69e0028a-1ea2-4808-9d85-3405269a3fc9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.018370 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.024005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:29.024395 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:29.024736 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:29.030087 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:29.030687 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:29.034160 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b86512e7-45cc-4f9a-904c-92a399cbf474 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6581609 Dec 10 14:26:29.034283 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 4 to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 Dec 10 14:26:29.039794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54800) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:29.080783 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-4d8e6a50-83e9-44aa-b1b7-817c7aea8d84 None None] Provisioning complete for port a0c498ed-fc34-4d67-8876-ac34ea0888b5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:29.081158 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4d8e6a50-83e9-44aa-b1b7-817c7aea8d84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.085620 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:29.086212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:29.088200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:29.123423 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-69e0028a-1ea2-4808-9d85-3405269a3fc9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.138149 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-69e0028a-1ea2-4808-9d85-3405269a3fc9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Calling delete_port for a0c498ed-fc34-4d67-8876-ac34ea0888b5 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:29.154412 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-4d8e6a50-83e9-44aa-b1b7-817c7aea8d84 None None] Port a0c498ed-fc34-4d67-8876-ac34ea0888b5 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:29.161145 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Allocated IP 172.20.0.2 (2fe74820-6fc2-45a6-9344-8f6da3a07469/3d99e95b-0bf6-4cec-9d8b-7b1d7eeda33b/b55f7c6e-1833-47a5-9bf4-7946b0c365a4) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:29.181196 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:29.181707 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:29.195774 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 5 to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 Dec 10 14:26:29.249160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efa2e33f-1923-4a39-bc0d-ce945a63163c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.264531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:29.265063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:29.265533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:29.298061 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:29.298463 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:29.338723 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 6 to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 Dec 10 14:26:29.344346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-69e0028a-1ea2-4808-9d85-3405269a3fc9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.405856 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.412172 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:29.412516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:29.413109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:29.427858 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.432015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:29.438057 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:29.438057 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 7 to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 Dec 10 14:26:29.438467 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54810) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:29.453703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.476729 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:29.476908 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:29.477248 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:29.486991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69e0028a-1ea2-4808-9d85-3405269a3fc9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event deleted for resources: {'Port': ['ID=a0c498ed-fc34-4d67-8876-ac34ea0888b5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:29.536878 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:29.537221 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:29.544624 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.544832 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-69e0028a-1ea2-4808-9d85-3405269a3fc9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.548606 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 8 to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 Dec 10 14:26:29.552798 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-69e0028a-1ea2-4808-9d85-3405269a3fc9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "DELETE /v2.0/ports/a0c498ed-fc34-4d67-8876-ac34ea0888b5 HTTP/1.1" status: 204 len: 168 time: 0.7346454 Dec 10 14:26:29.552798 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54814) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:29.587728 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-92ba57e8-92f8-4cc0-a047-ddc1690291ce tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] GET failed (client error): The resource could not be found. Dec 10 14:26:29.589318 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-92ba57e8-92f8-4cc0-a047-ddc1690291ce tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "GET /v2.0/ports/a0c498ed-fc34-4d67-8876-ac34ea0888b5 HTTP/1.1" status: 404 len: 333 time: 0.0357726 Dec 10 14:26:29.594361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54816) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:29.602212 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'port': {'network_id': '77457432-514b-48cd-95c7-0516e6ca0668', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-961761905'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:29.612410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:29.613497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:29.614048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:29.617645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efa2e33f-1923-4a39-bc0d-ce945a63163c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.624142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.652676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Network 2fe74820-6fc2-45a6-9344-8f6da3a07469 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:29.657150 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:29.663646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:29.676831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Pushing event updated for resources: {'Port': ['ID=b55f7c6e-1833-47a5-9bf4-7946b0c365a4,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:29.684544 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:29.684883 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:29.699212 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 9 to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 Dec 10 14:26:29.741566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efa2e33f-1923-4a39-bc0d-ce945a63163c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.754980 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:29.755315 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:29.755652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:29.767234 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Attempting to bind port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:29.768209 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Attempting to bind port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'e34420d9-18cb-4325-bbd8-5681e37c4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '2fe74820-6fc2-45a6-9344-8f6da3a07469'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:29.768579 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Attempting to bind port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 on network 2fe74820-6fc2-45a6-9344-8f6da3a07469 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:29.786421 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:29.786917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Checking segment: {'id': 'e34420d9-18cb-4325-bbd8-5681e37c4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '2fe74820-6fc2-45a6-9344-8f6da3a07469'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:29.788359 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.788879 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Bound using segment: {'id': 'e34420d9-18cb-4325-bbd8-5681e37c4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '2fe74820-6fc2-45a6-9344-8f6da3a07469'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:29.789549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Bound port: b55f7c6e-1833-47a5-9bf4-7946b0c365a4, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e34420d9-18cb-4325-bbd8-5681e37c4aa8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '2fe74820-6fc2-45a6-9344-8f6da3a07469'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:29.790819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.815220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:29.815553 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:29.825343 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempt 10 to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 Dec 10 14:26:29.859852 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efa2e33f-1923-4a39-bc0d-ce945a63163c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea19ab1f-34ee-40b1-8731-3c814a59cee7,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:29.865250 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] For port b55f7c6e-1833-47a5-9bf4-7946b0c365a4, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:29.868785 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] For port b55f7c6e-1833-47a5-9bf4-7946b0c365a4, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b55f7c6e-1833-47a5-9bf4-7946b0c365a4,segment=NetworkSegment(e34420d9-18cb-4325-bbd8-5681e37c4aa8),segment_id=e34420d9-18cb-4325-bbd8-5681e37c4aa8)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:29.872568 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-efa2e33f-1923-4a39-bc0d-ce945a63163c admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=69f29fb42d6a4d8da610f12d7560a42d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9351497 Dec 10 14:26:29.875431 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54824) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:29.882080 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:29.882421 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:29.882753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempting to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:29.885347 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Made reservation on behalf of ef5003e8d7fc43dcb8d6e7196c2360d1 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:29.888205 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-673b020f-e636-4aa2-950c-8c8c2d63a06a admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=c2a7c581de164ccf910afaf96add3a69&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4468224 Dec 10 14:26:29.889748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.890916 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54826) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:29.898175 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:26:29.898443 dv-neutron-821401-2-hyperv neutron-server[103810]: ERROR neutron.plugins.ml2.managers [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Failed to bind port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on host hv-neutron-8214 for vnic_type normal using segments [{'id': 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '43123a64-63e8-41a8-a5f9-b7b478de3cbc'}] Dec 10 14:26:29.898824 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:29.926185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] device_id is not set on port edefb936-dcbf-4997-8dd3-1ffb180df86e yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:29.967111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.038419 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4fefcf-3375-4cd5-b214-a4c82cbd22b3 None None] Pushing event updated for resources: {'Port': ['ID=b55f7c6e-1833-47a5-9bf4-7946b0c365a4,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:30.068548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.121259 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] For port e620c82f-03e7-4b8c-8925-bc88480d4ba6, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:30.121831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attempted to set empty binding levels {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 10 14:26:30.123550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6305b69a-a855-4a90-b82a-7b899ec108d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.131965 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54830) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.181363 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=3d99e95b-0bf6-4cec-9d8b-7b1d7eeda33b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:30.208696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.305566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6305b69a-a855-4a90-b82a-7b899ec108d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.362259 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1bbf90e4-85c5-406f-801f-aa2647ece088 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.362857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-fc11f991-1c8f-4606-86c9-0fd5ddb74353 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] Request body: {'port': {'network_id': 'ff637e7c-5bb8-45dd-b0d9-d306f1f7cb3a', 'name': 'tempest-NetworksNegativeTestJSON-1720055791'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:30.367517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] In _notify_port_updated(), no bound segment for port e620c82f-03e7-4b8c-8925-bc88480d4ba6 on network 43123a64-63e8-41a8-a5f9-b7b478de3cbc {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:30.368415 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:30.369024 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.373514 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "PUT /v2.0/ports/e620c82f-03e7-4b8c-8925-bc88480d4ba6 HTTP/1.1" status: 200 len: 980 time: 2.2371399 Dec 10 14:26:30.377368 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54834) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.391553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.416610 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1bbf90e4-85c5-406f-801f-aa2647ece088 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.453823 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-fc11f991-1c8f-4606-86c9-0fd5ddb74353 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] POST failed (client error): The resource could not be found. Dec 10 14:26:30.454610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fc11f991-1c8f-4606-86c9-0fd5ddb74353 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:30.456626 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fc11f991-1c8f-4606-86c9-0fd5ddb74353 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 404 len: 339 time: 0.2994857 Dec 10 14:26:30.457479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Allocated IP 2001:db8::318 (77457432-514b-48cd-95c7-0516e6ca0668/a648a80e-9761-4658-b2e6-f0ee19b475b4/edefb936-dcbf-4997-8dd3-1ffb180df86e) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:30.465555 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54836) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.471862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.494099 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-a2a656ef-8b18-4ccb-98bb-46e4bb86b623 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:30.494618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a2a656ef-8b18-4ccb-98bb-46e4bb86b623 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:30.500880 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a2a656ef-8b18-4ccb-98bb-46e4bb86b623 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "DELETE /v2.0/networks/1563cd97-5e71-4890-855c-29ee3b0dcf98 HTTP/1.1" status: 404 len: 339 time: 0.0303593 Dec 10 14:26:30.502043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54838) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.544561 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-03bc3fb7-8651-4058-8584-e6704ca7d27b tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:30.545281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-03bc3fb7-8651-4058-8584-e6704ca7d27b tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:30.553268 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-03bc3fb7-8651-4058-8584-e6704ca7d27b tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "DELETE /v2.0/ports/618cf714-7225-4c53-82ee-b5e71ce880e4 HTTP/1.1" status: 404 len: 333 time: 0.0459991 Dec 10 14:26:30.556528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54840) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.594507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b55f7c6e-1833-47a5-9bf4-7946b0c365a4 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:30.596579 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-a72a9d61-3c3e-4b31-919f-8b972885045c tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:30.597173 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a72a9d61-3c3e-4b31-919f-8b972885045c tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:30.600678 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a72a9d61-3c3e-4b31-919f-8b972885045c tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "DELETE /v2.0/subnets/a0a96480-3970-49c3-98cc-7acf92a83ffe HTTP/1.1" status: 404 len: 337 time: 0.0457075 Dec 10 14:26:30.607501 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54842) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.632622 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b96d55e-6182-4c68-8c37-c857c262f47b tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] GET failed (client error): The resource could not be found. Dec 10 14:26:30.634812 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3b96d55e-6182-4c68-8c37-c857c262f47b tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "GET /v2.0/networks/d2b485a9-847d-4cc0-9d2a-7b4b70db9bcb HTTP/1.1" status: 404 len: 339 time: 0.0262108 Dec 10 14:26:30.638534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54844) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.664572 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-50aa2f0f-3760-4a11-8350-01db52c0a67c tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] GET failed (client error): The resource could not be found. Dec 10 14:26:30.666113 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-50aa2f0f-3760-4a11-8350-01db52c0a67c tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "GET /v2.0/ports/80b10038-ce1e-434a-89b9-043662cdaa51 HTTP/1.1" status: 404 len: 333 time: 0.0264509 Dec 10 14:26:30.669909 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1bbf90e4-85c5-406f-801f-aa2647ece088 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.671549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:30.672036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.672505 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1bbf90e4-85c5-406f-801f-aa2647ece088 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.675980 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1bbf90e4-85c5-406f-801f-aa2647ece088 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/ea19ab1f-34ee-40b1-8731-3c814a59cee7 HTTP/1.1" status: 204 len: 168 time: 0.7972162 Dec 10 14:26:30.678680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54846) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.751500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bbf90e4-85c5-406f-801f-aa2647ece088 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea19ab1f-34ee-40b1-8731-3c814a59cee7,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:30.762354 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd2e0823-fc6a-40e2-9334-fb1dcb9400d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event updated for resources: {'Port': ['ID=e620c82f-03e7-4b8c-8925-bc88480d4ba6,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:30.765948 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-ee210edd-36aa-4d4a-9ba9-a794e3e686eb tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] GET failed (client error): The resource could not be found. Dec 10 14:26:30.767354 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ee210edd-36aa-4d4a-9ba9-a794e3e686eb tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "GET /v2.0/subnets/daba11e3-71cf-4909-b56d-ef6bf9e16708 HTTP/1.1" status: 404 len: 337 time: 0.0872657 Dec 10 14:26:30.773342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.774019 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54850) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.781260 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2982d92a-4a89-4177-a9d6-9c1be341c4a4 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] Request body: {'network': {'name': 'new_name'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:30.783346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2fe74820-6fc2-45a6-9344-8f6da3a07469']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:30.816792 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e34420d9-18cb-4325-bbd8-5681e37c4aa8') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:30.817099 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e34420d9-18cb-4325-bbd8-5681e37c4aa8') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:30.821990 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-2982d92a-4a89-4177-a9d6-9c1be341c4a4 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] PUT failed (client error): The resource could not be found. Dec 10 14:26:30.826771 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2982d92a-4a89-4177-a9d6-9c1be341c4a4 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:30.826771 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2982d92a-4a89-4177-a9d6-9c1be341c4a4 tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "PUT /v2.0/networks/479c3051-fc0e-4a94-966d-be430f2baf03 HTTP/1.1" status: 404 len: 339 time: 0.0487046 Dec 10 14:26:30.828387 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54852) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.836147 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-abe22e28-2a4d-4ab2-8d67-881a6283242d tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] Request body: {'port': {'name': 'new_name'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:30.862176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.867666 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.886746 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-abe22e28-2a4d-4ab2-8d67-881a6283242d tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] PUT failed (client error): The resource could not be found. Dec 10 14:26:30.887750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-abe22e28-2a4d-4ab2-8d67-881a6283242d tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:30.892374 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-abe22e28-2a4d-4ab2-8d67-881a6283242d tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "PUT /v2.0/ports/29b29c78-7a72-4937-bb94-c17fea28dcfa HTTP/1.1" status: 404 len: 333 time: 0.0594237 Dec 10 14:26:30.895567 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54854) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:30.901230 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8cb048ee-0d0c-47ed-aa86-3305eb92a1ae tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] Request body: {'subnet': {'name': 'new_name'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:30.904796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.942328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 374 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:30.942773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:30.947148 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:30.952582 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port b55f7c6e-1833-47a5-9bf4-7946b0c365a4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b55f7c6e-1833-47a5-9bf4-7946b0c365a4,segment=NetworkSegment(e34420d9-18cb-4325-bbd8-5681e37c4aa8),segment_id=e34420d9-18cb-4325-bbd8-5681e37c4aa8)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:30.964925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.974614 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-8cb048ee-0d0c-47ed-aa86-3305eb92a1ae tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] PUT failed (client error): The resource could not be found. Dec 10 14:26:30.975077 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8cb048ee-0d0c-47ed-aa86-3305eb92a1ae tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:30.977482 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8cb048ee-0d0c-47ed-aa86-3305eb92a1ae tempest-NetworksNegativeTestJSON-1465571701 tempest-NetworksNegativeTestJSON-1465571701-project] 10.222.0.57 "PUT /v2.0/subnets/6070b5a0-a734-43f8-8b2a-242a30b27cac HTTP/1.1" status: 404 len: 337 time: 0.0817869 Dec 10 14:26:30.977482 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6305b69a-a855-4a90-b82a-7b899ec108d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.979759 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6305b69a-a855-4a90-b82a-7b899ec108d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:30.983013 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6305b69a-a855-4a90-b82a-7b899ec108d8 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/d901e9e8-16e3-4620-bd36-e8de3c079db8 HTTP/1.1" status: 204 len: 168 time: 1.0886714 Dec 10 14:26:31.037067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6305b69a-a855-4a90-b82a-7b899ec108d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d901e9e8-16e3-4620-bd36-e8de3c079db8,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:31.051461 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c314f6dd-a3e6-4b44-9688-04b4f20454b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Deleting port e620c82f-03e7-4b8c-8925-bc88480d4ba6 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:31.051802 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c314f6dd-a3e6-4b44-9688-04b4f20454b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.062537 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.080743 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.108569 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Allocated IP 172.26.2.120 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/0cbbc097-d2e9-4a1b-a256-924ea147fcf8) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:31.131899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:26:31.131899 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:26:31.131899 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': '2fe74820-6fc2-45a6-9344-8f6da3a07469'}] Dec 10 14:26:31.131899 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:26:31.133057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:26:31.138738 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.205409 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-c314f6dd-a3e6-4b44-9688-04b4f20454b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] For port e620c82f-03e7-4b8c-8925-bc88480d4ba6, host hv-neutron-8214, got binding levels [] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:31.205810 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c314f6dd-a3e6-4b44-9688-04b4f20454b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.221032 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=b55f7c6e-1833-47a5-9bf4-7946b0c365a4,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:31.225482 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c314f6dd-a3e6-4b44-9688-04b4f20454b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Calling delete_port for e620c82f-03e7-4b8c-8925-bc88480d4ba6 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:31.270099 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Network 77457432-514b-48cd-95c7-0516e6ca0668 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:31.298406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:31.304633 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:31.313644 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:31.314444 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.323563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.361675 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c465e25d-724e-4825-9886-6bc6f8a54db2 None None] Network 2fe74820-6fc2-45a6-9344-8f6da3a07469 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:31.362437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Port': ['ID=edefb936-dcbf-4997-8dd3-1ffb180df86e,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:31.448042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54862) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:31.448153 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-cab7041c-8a12-4788-97ef-66553092ae91 None None] Provisioning complete for port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:31.448153 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cab7041c-8a12-4788-97ef-66553092ae91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.450016 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1498f3e5-1272-416a-bc2c-3cc079002098 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 1.8538997 Dec 10 14:26:31.452331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-52766784-04de-47bd-b8f1-0b6f57c3d574 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::b5', 'mac_address': 'fa:16:3e:14:5a:ef'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:31.490292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c314f6dd-a3e6-4b44-9688-04b4f20454b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.500600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.560102 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54866) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:31.627208 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4e99e7b-2688-45e0-8a87-698594e72646 None None] DHCP port deletion for 2fe74820-6fc2-45a6-9344-8f6da3a07469 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:31.634601 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.647395 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:31.664197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:31.674166 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:31.681999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c314f6dd-a3e6-4b44-9688-04b4f20454b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.683583 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5cebf1f6-a75f-4610-a937-75d21983b909 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:31.687832 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c314f6dd-a3e6-4b44-9688-04b4f20454b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "DELETE /v2.0/ports/e620c82f-03e7-4b8c-8925-bc88480d4ba6 HTTP/1.1" status: 204 len: 168 time: 1.3022857 Dec 10 14:26:31.688331 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54874) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:31.710211 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f4e99e7b-2688-45e0-8a87-698594e72646 None None] Deleting port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:31.710751 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f4e99e7b-2688-45e0-8a87-698594e72646 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.736638 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-e44fa552-f1ae-46c1-95a3-f5ba282d1719 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] GET failed (client error): The resource could not be found. Dec 10 14:26:31.739237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52766784-04de-47bd-b8f1-0b6f57c3d574 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.743584 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e44fa552-f1ae-46c1-95a3-f5ba282d1719 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] 10.222.0.57 "GET /v2.0/ports/e620c82f-03e7-4b8c-8925-bc88480d4ba6 HTTP/1.1" status: 404 len: 333 time: 0.0540836 Dec 10 14:26:31.750713 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54878) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:31.757209 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event updated for resources: {'Port': ['ID=0cbbc097-d2e9-4a1b-a256-924ea147fcf8,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:31.778363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e740fdd-4ec7-4309-87b7-b5baa44d7482 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.799968 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e8dfe174-09be-48bc-a4f0-689ea5b0e0d2 None None] Provisioning complete for port edefb936-dcbf-4997-8dd3-1ffb180df86e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:31.800341 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e8dfe174-09be-48bc-a4f0-689ea5b0e0d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.843265 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f4e99e7b-2688-45e0-8a87-698594e72646 None None] For port b55f7c6e-1833-47a5-9bf4-7946b0c365a4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b55f7c6e-1833-47a5-9bf4-7946b0c365a4,segment=NetworkSegment(e34420d9-18cb-4325-bbd8-5681e37c4aa8),segment_id=e34420d9-18cb-4325-bbd8-5681e37c4aa8)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:31.843591 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f4e99e7b-2688-45e0-8a87-698594e72646 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.867233 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:31.870131 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f4e99e7b-2688-45e0-8a87-698594e72646 None None] Calling delete_port for b55f7c6e-1833-47a5-9bf4-7946b0c365a4 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:31.876269 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e8dfe174-09be-48bc-a4f0-689ea5b0e0d2 None None] Port edefb936-dcbf-4997-8dd3-1ffb180df86e cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:31.938516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c314f6dd-a3e6-4b44-9688-04b4f20454b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043772712-project-admin] Pushing event deleted for resources: {'Port': ['ID=e620c82f-03e7-4b8c-8925-bc88480d4ba6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:32.001203 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6eaa9bbb-f728-4d4b-9606-e56fd54d91c4 None None] Provisioning complete for port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:32.001912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6eaa9bbb-f728-4d4b-9606-e56fd54d91c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.011010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.021913 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e740fdd-4ec7-4309-87b7-b5baa44d7482 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.037527 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['43123a64-63e8-41a8-a5f9-b7b478de3cbc']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:32.038373 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6eaa9bbb-f728-4d4b-9606-e56fd54d91c4 None None] Port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:32.051994 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:32.051994 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd9fb5c1e-4a9f-433f-8c8a-4da5f824a58b') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:32.054319 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:32.054669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.055149 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f4e99e7b-2688-45e0-8a87-698594e72646 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.062453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.079357 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.086677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4e99e7b-2688-45e0-8a87-698594e72646 None None] Pushing event deleted for resources: {'Port': ['ID=b55f7c6e-1833-47a5-9bf4-7946b0c365a4,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:32.087462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e740fdd-4ec7-4309-87b7-b5baa44d7482 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.095360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4e99e7b-2688-45e0-8a87-698594e72646 None None] No DVR routers for this DVR port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:32.100225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Releasing vlan 353 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:32.100225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:32.119667 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:32.153682 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port b55f7c6e-1833-47a5-9bf4-7946b0c365a4, host dv-neutron-821401-2-hyperv, got binding levels [] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:32.157941 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.160756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52766784-04de-47bd-b8f1-0b6f57c3d574 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.182252 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e740fdd-4ec7-4309-87b7-b5baa44d7482 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=859de72c-13ab-452a-931f-60f719f10419,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:32.203147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for b55f7c6e-1833-47a5-9bf4-7946b0c365a4 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:32.211254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 was not found and therefore no delete operation was performed {{(pid=103810) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 10 14:26:32.213346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.214107 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2e740fdd-4ec7-4309-87b7-b5baa44d7482 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=2838eada6d0646b9baacf53b206182bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6506631 Dec 10 14:26:32.216828 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54888) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:32.250384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52766784-04de-47bd-b8f1-0b6f57c3d574 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.261334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=b55f7c6e-1833-47a5-9bf4-7946b0c365a4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:32.264882 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port b55f7c6e-1833-47a5-9bf4-7946b0c365a4 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:32.281041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d2abd061-96ea-41ac-8474-fa3c9ff62844 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.324690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d2abd061-96ea-41ac-8474-fa3c9ff62844 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.337737 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.350569 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-52766784-04de-47bd-b8f1-0b6f57c3d574 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] In _notify_port_updated(), no bound segment for port edefb936-dcbf-4997-8dd3-1ffb180df86e on network 77457432-514b-48cd-95c7-0516e6ca0668 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:32.351233 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.354568 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] 10.222.0.57 "DELETE /v2.0/networks/43123a64-63e8-41a8-a5f9-b7b478de3cbc HTTP/1.1" status: 204 len: 168 time: 0.6017079 Dec 10 14:26:32.360066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52766784-04de-47bd-b8f1-0b6f57c3d574 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:32.360814 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52766784-04de-47bd-b8f1-0b6f57c3d574 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.364991 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-52766784-04de-47bd-b8f1-0b6f57c3d574 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "PUT /v2.0/ports/edefb936-dcbf-4997-8dd3-1ffb180df86e HTTP/1.1" status: 200 len: 1001 time: 0.9177403 Dec 10 14:26:32.368927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54894) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:32.385175 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f289a552-679d-43c7-8689-f37674ecff26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1605469239-project] Pushing event deleted for resources: {'Network': ['ID=43123a64-63e8-41a8-a5f9-b7b478de3cbc,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:32.457554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.459495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52766784-04de-47bd-b8f1-0b6f57c3d574 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Port': ['ID=edefb936-dcbf-4997-8dd3-1ffb180df86e,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:32.465284 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.508625 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54896) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:32.546039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2fe74820-6fc2-45a6-9344-8f6da3a07469']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:32.563747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e34420d9-18cb-4325-bbd8-5681e37c4aa8') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:32.564052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e34420d9-18cb-4325-bbd8-5681e37c4aa8') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:32.602891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-bba1ed58-a4e0-4f0c-b688-cca2f21ba59b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Deleting port edefb936-dcbf-4997-8dd3-1ffb180df86e {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:32.603390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bba1ed58-a4e0-4f0c-b688-cca2f21ba59b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.619837 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.625051 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d2abd061-96ea-41ac-8474-fa3c9ff62844 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.628812 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d2abd061-96ea-41ac-8474-fa3c9ff62844 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.630235 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d2abd061-96ea-41ac-8474-fa3c9ff62844 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/859de72c-13ab-452a-931f-60f719f10419 HTTP/1.1" status: 204 len: 168 time: 0.4128516 Dec 10 14:26:32.650430 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.660342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b55f7c6e-1833-47a5-9bf4-7946b0c365a4 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:32.667207 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 374 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:32.667617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:32.671328 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:32.711978 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: b55f7c6e-1833-47a5-9bf4-7946b0c365a4 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:32.712435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b55f7c6e-1833-47a5-9bf4-7946b0c365a4 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:32.723135 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-286f27b5-48d0-4bb6-8618-7fa21075d468 None None] Provisioning complete for port edefb936-dcbf-4997-8dd3-1ffb180df86e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:32.724612 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-286f27b5-48d0-4bb6-8618-7fa21075d468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.748905 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bba1ed58-a4e0-4f0c-b688-cca2f21ba59b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.763167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-bba1ed58-a4e0-4f0c-b688-cca2f21ba59b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Calling delete_port for edefb936-dcbf-4997-8dd3-1ffb180df86e owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:32.771821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2abd061-96ea-41ac-8474-fa3c9ff62844 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=859de72c-13ab-452a-931f-60f719f10419,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:32.780580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'networks': [{'name': 'tempest-network--523666190'}, {'name': 'tempest-network--2146486434'}]} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:32.780927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'network': {'name': 'tempest-network--523666190'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:32.781404 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'network': {'name': 'tempest-network--2146486434'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:32.804531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-286f27b5-48d0-4bb6-8618-7fa21075d468 None None] Port edefb936-dcbf-4997-8dd3-1ffb180df86e cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:32.870014 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d1142eeb-ea1d-4821-ade2-8b49ff5e554d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.889310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.932565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Made reservation on behalf of 21f59c1b1be143f4a57bfe84466b4c08 for: {'network': 2} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:32.937022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.938861 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.955912 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.959089 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/2fe74820-6fc2-45a6-9344-8f6da3a07469 HTTP/1.1" status: 204 len: 168 time: 3.9170797 Dec 10 14:26:32.962616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54902) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:32.965074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:32.984723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9ffc0b8-9123-46c5-bc02-0889924537e8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=2fe74820-6fc2-45a6-9344-8f6da3a07469,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:33.006258 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bba1ed58-a4e0-4f0c-b688-cca2f21ba59b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.008302 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-87618040-095e-4eb1-9895-ec4b36721262 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] GET failed (client error): The resource could not be found. Dec 10 14:26:33.009796 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-87618040-095e-4eb1-9895-ec4b36721262 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/subnets/3d99e95b-0bf6-4cec-9d8b-7b1d7eeda33b HTTP/1.1" status: 404 len: 337 time: 0.0461466 Dec 10 14:26:33.014499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54906) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.061409 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bba1ed58-a4e0-4f0c-b688-cca2f21ba59b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event deleted for resources: {'Port': ['ID=edefb936-dcbf-4997-8dd3-1ffb180df86e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:33.065843 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-bcecf276-c65b-460e-85b4-cc832fc12f60 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:33.066370 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bcecf276-c65b-460e-85b4-cc832fc12f60 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:33.069549 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bcecf276-c65b-460e-85b4-cc832fc12f60 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/2fe74820-6fc2-45a6-9344-8f6da3a07469 HTTP/1.1" status: 404 len: 339 time: 0.0531561 Dec 10 14:26:33.074355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54908) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.122019 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54912) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.187818 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bba1ed58-a4e0-4f0c-b688-cca2f21ba59b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.192114 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bba1ed58-a4e0-4f0c-b688-cca2f21ba59b tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "DELETE /v2.0/ports/edefb936-dcbf-4997-8dd3-1ffb180df86e HTTP/1.1" status: 204 len: 168 time: 0.8202198 Dec 10 14:26:33.194911 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54918) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.235133 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-4be37e32-acbe-47e6-846e-84ab83632c26 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] GET failed (client error): The resource could not be found. Dec 10 14:26:33.241950 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4be37e32-acbe-47e6-846e-84ab83632c26 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "GET /v2.0/ports/edefb936-dcbf-4997-8dd3-1ffb180df86e HTTP/1.1" status: 404 len: 333 time: 0.0442145 Dec 10 14:26:33.242833 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54922) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.251846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'port': {'network_id': '77457432-514b-48cd-95c7-0516e6ca0668', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-2102364089'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:33.288282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.327937 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Router 927e1edc-6f94-4fcb-b106-f5be2e4ecc3d is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:26:33.358079 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f42e2cc0-fb34-4d20-a85f-788bc38ba2c3 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:33.362173 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f42e2cc0-fb34-4d20-a85f-788bc38ba2c3 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.2834041 Dec 10 14:26:33.362427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54926) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.400814 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.401195 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.412047 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-82acf784-e3fb-4428-af58-1bf92c2fa66f admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=98ab9e3fd19b478393c39883394fc9da&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2880168 Dec 10 14:26:33.416627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54928) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.453233 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-966c777e-a9de-43b6-82f3-990af7a1f71c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 207 time: 0.0866659 Dec 10 14:26:33.456669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54932) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.495720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'SecurityGroup': ['ID=061475b6-6995-407e-8a88-a1232905b5e2,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:33.498482 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] vlan segment allocate from pool success with {'vlan_id': 354, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:33.543392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.543738 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Added segment 276c7c73-6270-4fa9-8d08-95a8d8bfc280 of type vlan for network 78cf2fb0-6ba8-40cf-8891-1538ce2757c1 Dec 10 14:26:33.563319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a20cfb2b-25a8-497b-b954-93c63403abc3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.612199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a20cfb2b-25a8-497b-b954-93c63403abc3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.625680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-292d0774-761d-4d8e-b5ce-bf714ed3aa39 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:33.631947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-292d0774-761d-4d8e-b5ce-bf714ed3aa39 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:33.638600 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-292d0774-761d-4d8e-b5ce-bf714ed3aa39 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:33.645106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-292d0774-761d-4d8e-b5ce-bf714ed3aa39 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:33.646913 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-292d0774-761d-4d8e-b5ce-bf714ed3aa39 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2487 time: 0.1892707 Dec 10 14:26:33.651001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Made reservation on behalf of ef5003e8d7fc43dcb8d6e7196c2360d1 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:33.654607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.658909 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54938) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.748724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] device_id is not set on port 2645ca48-a3ab-4130-a457-46f32fd4f355 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:33.827161 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:33.843557 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.844313 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Sync routers for ids ['927e1edc-6f94-4fcb-b106-f5be2e4ecc3d'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:33.861525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Routers {'927e1edc-6f94-4fcb-b106-f5be2e4ecc3d'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:33.862357 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['927e1edc-6f94-4fcb-b106-f5be2e4ecc3d'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:33.875600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] vlan segment allocate from pool success with {'vlan_id': 370, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:33.887200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.887551 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Added segment 14815a8b-28b5-4937-82a1-17bdcbd9a7d3 of type vlan for network f8d14e65-6304-41aa-ad4b-98909754b53b Dec 10 14:26:33.891474 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-95273672-a0ea-4881-8f80-4439a0ec8eaf tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 576 time: 0.2305908 Dec 10 14:26:33.902030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54944) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.911505 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a20cfb2b-25a8-497b-b954-93c63403abc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.914360 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a20cfb2b-25a8-497b-b954-93c63403abc3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.915555 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a20cfb2b-25a8-497b-b954-93c63403abc3 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/3e8e1eb5-e2d3-4255-a76b-25aa6068784d HTTP/1.1" status: 204 len: 168 time: 0.4979293 Dec 10 14:26:33.963147 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a20cfb2b-25a8-497b-b954-93c63403abc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e8e1eb5-e2d3-4255-a76b-25aa6068784d,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:33.984456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Allocated IP 2001:db8::2d9 (77457432-514b-48cd-95c7-0516e6ca0668/a648a80e-9761-4658-b2e6-f0ee19b475b4/2645ca48-a3ab-4130-a457-46f32fd4f355) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:33.989688 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.992056 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3a0812af-afd9-49d2-b45b-9d1f065d7a9c tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 5.2779725 Dec 10 14:26:33.995358 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:33.997963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4cfa8f7-1883-407b-869c-0adc0d62ad63 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:33.998248 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54950) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:33.999617 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4cfa8f7-1883-407b-869c-0adc0d62ad63 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.001196 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b4cfa8f7-1883-407b-869c-0adc0d62ad63 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1446 time: 0.1055996 Dec 10 14:26:34.005704 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54952) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.082371 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1371290-f2b9-4a16-a57a-70b504e5d633 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.083849 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1371290-f2b9-4a16-a57a-70b504e5d633 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.089258 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c1371290-f2b9-4a16-a57a-70b504e5d633 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 403 time: 0.0787673 Dec 10 14:26:34.090307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54956) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.104069 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Set router 927e1edc-6f94-4fcb-b106-f5be2e4ecc3d gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:26:34.112755 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54958) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.198982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.199206 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.211240 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.217196 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.218094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.250109 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.362612 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Network': ['ID=78cf2fb0-6ba8-40cf-8891-1538ce2757c1,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:34.374607 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3ead4add-2c1c-4dbf-8ad1-9820234ae459 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/routers/927e1edc-6f94-4fcb-b106-f5be2e4ecc3d HTTP/1.1" status: 200 len: 908 time: 0.3735383 Dec 10 14:26:34.375530 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 78cf2fb0-6ba8-40cf-8891-1538ce2757c1 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:34.377279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54964) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.383363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'router': {'name': 'tempest-snat-router-902226828', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': True}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:34.400904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07236cbb-55f3-4e37-b64c-9dadacc33de9 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.402383 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-07236cbb-55f3-4e37-b64c-9dadacc33de9 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/networks/357dc108-37ad-4356-90e3-4bbd945fbb62 HTTP/1.1" status: 200 len: 800 time: 0.3100553 Dec 10 14:26:34.402598 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.406176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54966) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.413588 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-secgroup--1511664918'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:34.467590 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Network 77457432-514b-48cd-95c7-0516e6ca0668 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:34.472927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:34.476762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:34.483060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.483879 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.506010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.507048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.520992 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Network': ['ID=f8d14e65-6304-41aa-ad4b-98909754b53b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:34.541953 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network f8d14e65-6304-41aa-ad4b-98909754b53b details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:34.570361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.583958 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Port': ['ID=2645ca48-a3ab-4130-a457-46f32fd4f355,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:34.591839 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f96c606a-64d0-4b11-82b2-4d0399629fff tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1319 time: 2.0797136 Dec 10 14:26:34.596076 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54970) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.652678 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927e1edc-6f94-4fcb-b106-f5be2e4ecc3d', 'name': 'tempest-snat-router-902226828', 'tenant_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.120'}], 'enable_snat': False}, 'gw_port_id': '0cbbc097-d2e9-4a1b-a256-924ea147fcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:26:28Z', 'updated_at': '2021-12-10T14:26:32Z', 'revision_number': 3, 'project_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'gw_port': {'id': '0cbbc097-d2e9-4a1b-a256-924ea147fcf8', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:6b:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '927e1edc-6f94-4fcb-b106-f5be2e4ecc3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:26:30Z', 'updated_at': '2021-12-10T14:26:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:34.695290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.730205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Checking router: 927e1edc-6f94-4fcb-b106-f5be2e4ecc3d for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:26:34.730563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Updating router 927e1edc-6f94-4fcb-b106-f5be2e4ecc3d port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:26:34.770874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.771980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.790347 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1ee0749d-4556-4a58-9bf0-cc2e757b2d40 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/networks/357dc108-37ad-4356-90e3-4bbd945fbb62?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 316 time: 0.3830154 Dec 10 14:26:34.791131 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54972) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.795759 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2f81caca-9f73-4f1f-8011-2d97c14b4ac9 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 1.5504127 Dec 10 14:26:34.796808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54974) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.800033 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54976) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.833472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7fe0831e-a15a-4079-9b0a-420bbb98b833 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:14:5a:ef'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:34.904784 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-adb182cc-3f55-45aa-8fef-1fea881fae80 None None] Provisioning complete for port 2645ca48-a3ab-4130-a457-46f32fd4f355 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:34.905338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-adb182cc-3f55-45aa-8fef-1fea881fae80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.941102 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:34.941637 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-891f2eaf-37e7-4ea1-90bd-53d8b4eba58a admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=73dc370c75ab42df98c43f1e3c0887e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1422460 Dec 10 14:26:34.944684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54980) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.954959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6641acc4-73d7-4b79-8515-6828f2a05c05 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.963821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6641acc4-73d7-4b79-8515-6828f2a05c05 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.964176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-adb182cc-3f55-45aa-8fef-1fea881fae80 None None] Port 2645ca48-a3ab-4130-a457-46f32fd4f355 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:34.975844 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6641acc4-73d7-4b79-8515-6828f2a05c05 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.980570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db82642f-57fa-48ce-b5ff-087fa2478519 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.982083 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-db82642f-57fa-48ce-b5ff-087fa2478519 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/subnets/97be32d5-2672-4281-b1a7-9566e2dbf48c HTTP/1.1" status: 200 len: 811 time: 0.1826186 Dec 10 14:26:34.987853 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6641acc4-73d7-4b79-8515-6828f2a05c05 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:34.989941 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6641acc4-73d7-4b79-8515-6828f2a05c05 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2406 time: 0.3919771 Dec 10 14:26:34.992072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54982) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:34.995681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54984) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:35.108074 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-05e1c8f5-6fd2-4233-bfa9-e6c9a86a3154 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.126411 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.126649 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b09d92c-e934-41d0-82db-384d21ec4edb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:35.127958 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0b09d92c-e934-41d0-82db-384d21ec4edb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "GET /v2.0/subnets/97be32d5-2672-4281-b1a7-9566e2dbf48c?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.1264832 Dec 10 14:26:35.136590 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54986) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:35.152001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-937569900'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:35.175307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.195107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.200817 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-17f9c1d8-6202-4d9c-9501-b412d8857ad8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:35.202362 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-17f9c1d8-6202-4d9c-9501-b412d8857ad8 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1098 time: 0.1271572 Dec 10 14:26:35.203857 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.216060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3f964b-1d05-4287-9dfa-66ef7ea12fb6 req-0b3d4345-084c-442a-9bc6-bc191dde2bd5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:35.217206 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ee3f964b-1d05-4287-9dfa-66ef7ea12fb6 req-0b3d4345-084c-442a-9bc6-bc191dde2bd5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2405126 Dec 10 14:26:35.224562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de0feb20-cdba-4478-847f-bd7b53fdfc4c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.262489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de0feb20-cdba-4478-847f-bd7b53fdfc4c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.276630 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Attempting to bind port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:35.277093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.277218 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Attempting to bind port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:35.277582 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Attempting to bind port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:35.285461 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c15221c-ebb9-4266-88b1-3fa2e35d9f6e None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:35.292044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dcb3fa2-30cc-4617-abc9-39b7dc7e8361 None None] Pushing event updated for resources: {'Port': ['ID=0cbbc097-d2e9-4a1b-a256-924ea147fcf8,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:35.296308 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:35.298451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:35.298451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.298451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:35.298726 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Bound port: 0cbbc097-d2e9-4a1b-a256-924ea147fcf8, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:35.299052 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.337500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:35.340991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.367695 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] For port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:35.371629 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] For port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0cbbc097-d2e9-4a1b-a256-924ea147fcf8,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:35.396573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=eda32678-25c7-4c8e-a750-9470fafbb3cb,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:35.405740 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-bca8cadd-c6bf-48b0-b064-14f76348d406 None None] Provisioning complete for port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:35.406169 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bca8cadd-c6bf-48b0-b064-14f76348d406 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.436714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.439140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] vlan segment allocate from pool success with {'vlan_id': 398, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:35.441962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.447077 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7fe0831e-a15a-4079-9b0a-420bbb98b833 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.457319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.457694 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Added segment 8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f of type vlan for network ac4f38b7-26d4-4f20-847f-e773befe5bbf Dec 10 14:26:35.488174 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-bca8cadd-c6bf-48b0-b064-14f76348d406 None None] Port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:35.501287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3bad5a3b-5dc9-4a6c-99b2-95169460f689 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:35.515867 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Routers {'927e1edc-6f94-4fcb-b106-f5be2e4ecc3d'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:35.520458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['927e1edc-6f94-4fcb-b106-f5be2e4ecc3d'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:35.525701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['78cf2fb0-6ba8-40cf-8891-1538ce2757c1']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:35.559536 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ee3f964b-1d05-4287-9dfa-66ef7ea12fb6 req-bc197e8a-eb1f-4f5c-9a08-abc42986951e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3012745 Dec 10 14:26:35.567085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-3d339610-f2ff-4e69-be88-81d645049ff0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:35.567261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.570330 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-3d339610-f2ff-4e69-be88-81d645049ff0 service neutron] 10.222.0.39 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 912 time: 0.3532388 Dec 10 14:26:35.578207 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '276c7c73-6270-4fa9-8d08-95a8d8bfc280') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:35.578762 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '276c7c73-6270-4fa9-8d08-95a8d8bfc280') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:35.604372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.606254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.613937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dcb3fa2-30cc-4617-abc9-39b7dc7e8361 None None] Pushing event updated for resources: {'Port': ['ID=0cbbc097-d2e9-4a1b-a256-924ea147fcf8,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:35.670817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de0feb20-cdba-4478-847f-bd7b53fdfc4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.673468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de0feb20-cdba-4478-847f-bd7b53fdfc4c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.677574 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-de0feb20-cdba-4478-847f-bd7b53fdfc4c admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/4db5689d-1751-474c-b3a5-4963cf7388dc HTTP/1.1" status: 204 len: 168 time: 0.7263198 Dec 10 14:26:35.701245 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.709913 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.729692 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de0feb20-cdba-4478-847f-bd7b53fdfc4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4db5689d-1751-474c-b3a5-4963cf7388dc,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:35.739104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] Set router 927e1edc-6f94-4fcb-b106-f5be2e4ecc3d gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:26:35.778463 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.784995 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:35.786110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.797392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Releasing vlan 354 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:35.803158 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:35.834230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c7999051-140b-41f4-a02a-0044ad4d302b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:35.838583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.843359 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b03f308c-4c4f-4e27-88c7-a03fe786e981 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 1.7263830 Dec 10 14:26:35.884379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54990) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:35.885784 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.895662 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-d2cfa934-87fe-4ae5-9326-7067e1f2cc9c service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 1000 time: 0.3109915 Dec 10 14:26:35.934334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.948254 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.8013191 Dec 10 14:26:35.948694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c54f3481-9af7-470a-93c4-dc443b919ea8 None None] Provisioning complete for port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:35.949140 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c54f3481-9af7-470a-93c4-dc443b919ea8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:35.952082 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54992) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:35.954399 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378945e5-469a-4637-87d6-9d3ddadd4e03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Network': ['ID=ac4f38b7-26d4-4f20-847f-e773befe5bbf,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:35.959920 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'network_id': 'ac4f38b7-26d4-4f20-847f-e773befe5bbf', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8'], 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:36.005038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network ac4f38b7-26d4-4f20-847f-e773befe5bbf details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:36.055955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-eeaeef4f-7186-4d86-b245-8d7469cb4124 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:36.057447 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-eeaeef4f-7186-4d86-b245-8d7469cb4124 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 200 len: 850 time: 0.1011569 Dec 10 14:26:36.113824 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.118993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.122705 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/networks/78cf2fb0-6ba8-40cf-8891-1538ce2757c1 HTTP/1.1" status: 204 len: 168 time: 1.1259153 Dec 10 14:26:36.128646 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c6592ba2-b9f2-420f-8bd7-b317bf0c0027 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4539 time: 0.2405899 Dec 10 14:26:36.129250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 54994) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:36.138984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 54996) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:36.147022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-75872846-be2e-44ae-a749-61e89d9ed892 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-security--1149549987', 'description': 'tempest-security-description-1239637736'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:36.160758 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7fe0831e-a15a-4079-9b0a-420bbb98b833 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.168048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d91cff7-eac8-4834-a1e7-eb9665bdfa15 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Network': ['ID=78cf2fb0-6ba8-40cf-8891-1538ce2757c1,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:36.194383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-0234e7e8-75cb-4575-b3e7-9a9224cea5dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:36.194833 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-0234e7e8-75cb-4575-b3e7-9a9224cea5dc service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=1cc2d855-81bd-4d95-a565-455c7130be80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1256068 Dec 10 14:26:36.217024 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Allocated IP 172.26.2.45 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/85bca82c-85b8-46d1-b6dd-e32278f26e94) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:36.232290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927e1edc-6f94-4fcb-b106-f5be2e4ecc3d', 'name': 'tempest-snat-router-902226828', 'tenant_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.120'}], 'enable_snat': False}, 'gw_port_id': '0cbbc097-d2e9-4a1b-a256-924ea147fcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:26:28Z', 'updated_at': '2021-12-10T14:26:32Z', 'revision_number': 3, 'project_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'gw_port': {'id': '0cbbc097-d2e9-4a1b-a256-924ea147fcf8', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:6b:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '927e1edc-6f94-4fcb-b106-f5be2e4ecc3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:26:30Z', 'updated_at': '2021-12-10T14:26:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:36.296322 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.297310 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fb7e346-4d52-450d-8acd-b9391e3f3e72 None None] The sync data for ids ['927e1edc-6f94-4fcb-b106-f5be2e4ecc3d'] in dv-neutron-821401-2-hyperv is: [{'id': '927e1edc-6f94-4fcb-b106-f5be2e4ecc3d', 'name': 'tempest-snat-router-902226828', 'tenant_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.120'}], 'enable_snat': False}, 'gw_port_id': '0cbbc097-d2e9-4a1b-a256-924ea147fcf8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:26:28Z', 'updated_at': '2021-12-10T14:26:32Z', 'revision_number': 3, 'project_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'gw_port': {'id': '0cbbc097-d2e9-4a1b-a256-924ea147fcf8', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:6b:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '927e1edc-6f94-4fcb-b106-f5be2e4ecc3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:26:30Z', 'updated_at': '2021-12-10T14:26:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:36.307115 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c54f3481-9af7-470a-93c4-dc443b919ea8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.346425 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-e94e648c-aac0-4442-a2a9-9154553732ea service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1422970 Dec 10 14:26:36.348639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c54f3481-9af7-470a-93c4-dc443b919ea8 None None] For port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0cbbc097-d2e9-4a1b-a256-924ea147fcf8,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:36.352824 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7fe0831e-a15a-4079-9b0a-420bbb98b833 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.414563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c54f3481-9af7-470a-93c4-dc443b919ea8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.415447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-7fe0831e-a15a-4079-9b0a-420bbb98b833 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] In _notify_port_updated(), no bound segment for port 2645ca48-a3ab-4130-a457-46f32fd4f355 on network 77457432-514b-48cd-95c7-0516e6ca0668 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:36.422475 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7fe0831e-a15a-4079-9b0a-420bbb98b833 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:36.423204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7fe0831e-a15a-4079-9b0a-420bbb98b833 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.424700 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7fe0831e-a15a-4079-9b0a-420bbb98b833 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "PUT /v2.0/ports/2645ca48-a3ab-4130-a457-46f32fd4f355 HTTP/1.1" status: 200 len: 1003 time: 1.6038256 Dec 10 14:26:36.426660 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-75872846-be2e-44ae-a749-61e89d9ed892 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.471620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55004) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:36.496831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-75872846-be2e-44ae-a749-61e89d9ed892 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.497084 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Made reservation on behalf of 0f2de0215b794a388e54d6341b69691a for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:36.500592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.513956 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c54f3481-9af7-470a-93c4-dc443b919ea8 None None] Pushing event updated for resources: {'Port': ['ID=0cbbc097-d2e9-4a1b-a256-924ea147fcf8,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:36.554724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.565186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe0831e-a15a-4079-9b0a-420bbb98b833 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Port': ['ID=2645ca48-a3ab-4130-a457-46f32fd4f355,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:36.579038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-75872846-be2e-44ae-a749-61e89d9ed892 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.582649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-75872846-be2e-44ae-a749-61e89d9ed892 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.587250 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-75872846-be2e-44ae-a749-61e89d9ed892 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "PUT /v2.0/security-groups/c7999051-140b-41f4-a02a-0044ad4d302b HTTP/1.1" status: 200 len: 1795 time: 0.4441257 Dec 10 14:26:36.588015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55008) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:36.670148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75872846-be2e-44ae-a749-61e89d9ed892 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c7999051-140b-41f4-a02a-0044ad4d302b,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:36.697768 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-213aa8a6-a5d2-4240-9e04-fe7149781e38 req-9e0192ad-4b81-414c-9d98-fcdb7006965b service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3412287 Dec 10 14:26:36.721793 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ee9ce0d2-83a9-41a5-b127-43089184298d tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups/c7999051-140b-41f4-a02a-0044ad4d302b HTTP/1.1" status: 200 len: 1795 time: 0.1227098 Dec 10 14:26:36.722144 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55014) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:36.863479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5d4fecba-6b3b-4153-b578-7ac73b7a1461 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.876448 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c1c5963f-77b0-4e95-b6bd-7e473cc93268 None None] Provisioning complete for port 2645ca48-a3ab-4130-a457-46f32fd4f355 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:36.877242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c1c5963f-77b0-4e95-b6bd-7e473cc93268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.904137 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5d4fecba-6b3b-4153-b578-7ac73b7a1461 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:36.937951 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c1c5963f-77b0-4e95-b6bd-7e473cc93268 None None] Port 2645ca48-a3ab-4130-a457-46f32fd4f355 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:37.103642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5d4fecba-6b3b-4153-b578-7ac73b7a1461 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.106555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5d4fecba-6b3b-4153-b578-7ac73b7a1461 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.107735 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5d4fecba-6b3b-4153-b578-7ac73b7a1461 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/c7999051-140b-41f4-a02a-0044ad4d302b HTTP/1.1" status: 204 len: 168 time: 0.3846672 Dec 10 14:26:37.111322 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55020) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:37.139204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4fecba-6b3b-4153-b578-7ac73b7a1461 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7999051-140b-41f4-a02a-0044ad4d302b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:37.187158 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-df866a0e-32cb-4642-8c86-a8796c68b0d0 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0720980 Dec 10 14:26:37.188897 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55024) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:37.214661 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-583d0b32-245b-4c83-9917-3a7112183450 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] delete failed (client error): The resource could not be found. Dec 10 14:26:37.219690 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-583d0b32-245b-4c83-9917-3a7112183450 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/c7999051-140b-41f4-a02a-0044ad4d302b HTTP/1.1" status: 404 len: 347 time: 0.0259218 Dec 10 14:26:37.221245 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55026) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:37.226303 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-3a40c52d-eb4f-4934-80c6-d8ea72bcaa56 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-secgroup--424894830'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:37.258955 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.ipam_backend_mixin [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Performing IP validity checks on allocation pools {{(pid=103811) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 10 14:26:37.259586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.ipam_backend_mixin [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103811) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 10 14:26:37.356115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a40c52d-eb4f-4934-80c6-d8ea72bcaa56 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.372651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.426737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55030) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:37.429209 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49bbc317-533b-4376-855c-34c7d5e99b69 req-52f49065-8662-4799-993a-5f4c861a5b2c tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:37.431376 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-49bbc317-533b-4376-855c-34c7d5e99b69 req-52f49065-8662-4799-993a-5f4c861a5b2c tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.3426597 Dec 10 14:26:37.455988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.480249 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a40c52d-eb4f-4934-80c6-d8ea72bcaa56 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.535655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1db289b2-10bb-4fe9-ad7f-44a7afc315d8 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Deleting port 2645ca48-a3ab-4130-a457-46f32fd4f355 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:37.536511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1db289b2-10bb-4fe9-ad7f-44a7afc315d8 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.544348 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.547212 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f8d14e65-6304-41aa-ad4b-98909754b53b']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:37.577039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairTestJSON-test-network-594056830'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:37.581359 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a40c52d-eb4f-4934-80c6-d8ea72bcaa56 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.584205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '14815a8b-28b5-4937-82a1-17bdcbd9a7d3') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:37.584366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '14815a8b-28b5-4937-82a1-17bdcbd9a7d3') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:37.635932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a40c52d-eb4f-4934-80c6-d8ea72bcaa56 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fd0b8c69-e0aa-4df3-ae60-2ef8c7f1eee2,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:37.637157 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.651137 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-49bbc317-533b-4376-855c-34c7d5e99b69 req-1d209127-b19d-4a97-b0e2-1ccf5c15b8fc tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2043848 Dec 10 14:26:37.681706 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Made reservation on behalf of a92f38bb4fde4f96868f58279fc34db3 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:37.685949 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.692972 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.698445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.704536 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.737208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a40c52d-eb4f-4934-80c6-d8ea72bcaa56 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.741575 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3a40c52d-eb4f-4934-80c6-d8ea72bcaa56 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.5191727 Dec 10 14:26:37.743361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55034) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:37.749674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-536ca319-e8cf-4020-bb03-8b01f2e51f1b tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': 'fd0b8c69-e0aa-4df3-ae60-2ef8c7f1eee2', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:37.760191 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Releasing vlan 370 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:37.760947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:37.763603 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:37.776364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:37.803256 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.836855 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-536ca319-e8cf-4020-bb03-8b01f2e51f1b tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.847057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.848962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:37.851697 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:37.865669 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23db4828-100d-4eee-9d70-f43bf23559ba None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:37.867107 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1db289b2-10bb-4fe9-ad7f-44a7afc315d8 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:37.896767 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] vlan segment allocate from pool success with {'vlan_id': 384, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:37.940776 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event updated for resources: {'Port': ['ID=85bca82c-85b8-46d1-b6dd-e32278f26e94,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:37.947408 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1db289b2-10bb-4fe9-ad7f-44a7afc315d8 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Calling delete_port for 2645ca48-a3ab-4130-a457-46f32fd4f355 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:37.977770 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-808948d3-8180-4dc3-a785-ded8aed13512 None None] Provisioning complete for port 85bca82c-85b8-46d1-b6dd-e32278f26e94 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:37.978272 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-808948d3-8180-4dc3-a785-ded8aed13512 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.020369 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-808948d3-8180-4dc3-a785-ded8aed13512 None None] Port 85bca82c-85b8-46d1-b6dd-e32278f26e94 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:38.038464 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.096228 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.100718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.104619 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/networks/f8d14e65-6304-41aa-ad4b-98909754b53b HTTP/1.1" status: 204 len: 168 time: 1.9187741 Dec 10 14:26:38.116377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55036) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:38.168338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1aa69db7-f656-4b3a-96a8-f668f6504a7c,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:38.179008 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.179275 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Added segment 16e64123-5fe0-41d3-b895-16b2f9a10070 of type vlan for network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 Dec 10 14:26:38.197383 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be451314-581c-4adb-a05a-3b240f3af8e0 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Network': ['ID=f8d14e65-6304-41aa-ad4b-98909754b53b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:38.239771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-536ca319-e8cf-4020-bb03-8b01f2e51f1b tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.241004 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.263285 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=aef4f84d-d8f6-4cb2-af74-084a63caee64,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:38.315481 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-536ca319-e8cf-4020-bb03-8b01f2e51f1b tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.331455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536ca319-e8cf-4020-bb03-8b01f2e51f1b tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d7081ca0-4640-4a0b-a3bd-37d5ccb5a473,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:38.343682 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.349694 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:38.350995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.400270 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Checking segment: {'id': '8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'ac4f38b7-26d4-4f20-847f-e773befe5bbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:38.400648 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network hostable DHCP agents. Network: ac4f38b7-26d4-4f20-847f-e773befe5bbf, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:38.409192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-536ca319-e8cf-4020-bb03-8b01f2e51f1b tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.410587 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-536ca319-e8cf-4020-bb03-8b01f2e51f1b tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6662807 Dec 10 14:26:38.413930 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5d83cc1-1aae-4d3c-9a4d-b64696bff607 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:38.417836 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55038) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:38.420666 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5d83cc1-1aae-4d3c-9a4d-b64696bff607 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:38.422294 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c5d83cc1-1aae-4d3c-9a4d-b64696bff607 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.2764564 Dec 10 14:26:38.429460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55040) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:38.439562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-152118002'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:38.445510 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 793 time: 1.0176601 Dec 10 14:26:38.448407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55042) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:38.453354 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'subnet': {'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:38.460082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afa4b65d-ea45-4175-9cba-168ab5457218 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Network': ['ID=9740484b-2f0c-4ec8-b8a4-2516743e88b3,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:38.472137 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:38.512910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-438168d2-4986-4572-8a7d-f03984de0800 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.524875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1db289b2-10bb-4fe9-ad7f-44a7afc315d8 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.532061 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-438168d2-4986-4572-8a7d-f03984de0800 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.560253 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Network ac4f38b7-26d4-4f20-847f-e773befe5bbf is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:38.563363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db289b2-10bb-4fe9-ad7f-44a7afc315d8 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event deleted for resources: {'Port': ['ID=2645ca48-a3ab-4130-a457-46f32fd4f355,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:38.566141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.621851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Made reservation on behalf of 21f59c1b1be143f4a57bfe84466b4c08 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:38.625509 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.640930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:38.662374 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1db289b2-10bb-4fe9-ad7f-44a7afc315d8 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.663913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-438168d2-4986-4572-8a7d-f03984de0800 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.666600 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1db289b2-10bb-4fe9-ad7f-44a7afc315d8 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "DELETE /v2.0/ports/2645ca48-a3ab-4130-a457-46f32fd4f355 HTTP/1.1" status: 204 len: 168 time: 2.1923587 Dec 10 14:26:38.669713 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55044) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:38.676120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-438168d2-4986-4572-8a7d-f03984de0800 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.691247 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-438168d2-4986-4572-8a7d-f03984de0800 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/d7081ca0-4640-4a0b-a3bd-37d5ccb5a473 HTTP/1.1" status: 204 len: 168 time: 0.2716351 Dec 10 14:26:38.692407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438168d2-4986-4572-8a7d-f03984de0800 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=d7081ca0-4640-4a0b-a3bd-37d5ccb5a473,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:38.694582 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55048) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:38.703680 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-79a2c763-ac33-4c55-8a55-d2a17c6ca118 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] GET failed (client error): The resource could not be found. Dec 10 14:26:38.705381 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-79a2c763-ac33-4c55-8a55-d2a17c6ca118 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "GET /v2.0/ports/2645ca48-a3ab-4130-a457-46f32fd4f355 HTTP/1.1" status: 404 len: 333 time: 0.0319886 Dec 10 14:26:38.708805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Made reservation on behalf of a92f38bb4fde4f96868f58279fc34db3 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:38.713955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.718975 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55050) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:38.720610 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, ac4f38b7-26d4-4f20-847f-e773befe5bbf) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:38.736752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:38.740411 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.746070 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0218df3f-4791-409a-a2d2-caf62af77254 None None] Network ac4f38b7-26d4-4f20-847f-e773befe5bbf requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:38.756862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'port': {'network_id': '77457432-514b-48cd-95c7-0516e6ca0668', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1740883626'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:38.766724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] vlan segment allocate from pool success with {'vlan_id': 391, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:38.840039 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-30111146-bcba-4cc0-9988-e08c952ab492 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1441131 Dec 10 14:26:38.840942 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55052) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:38.844091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.844447 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Added segment 7056d828-c15e-4eff-a7e6-17ba9fc8e4bd of type vlan for network 7f359b16-f43f-42d5-add5-01d2cda3e391 Dec 10 14:26:38.854987 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:38.855424 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.889913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.894508 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d2a9b234-6467-4abf-bcfc-ff19a4408c31 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 872 time: 2.9410388 Dec 10 14:26:38.901441 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55054) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:38.910180 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-6ccad468-dbfb-4d25-b0b6-8013e553c914 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.2'}], 'dns_nameservers': ['7.8.8.8', '7.8.4.4'], 'gateway_ip': '172.20.0.2', 'enable_dhcp': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:38.965365 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.978545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-ac4f38b7-26d4-4f20-847f-e773befe5bbf', 'network_id': 'ac4f38b7-26d4-4f20-847f-e773befe5bbf', 'project_id': '0f2de0215b794a388e54d6341b69691a', 'fixed_ips': [{'subnet_id': 'aef4f84d-d8f6-4cb2-af74-084a63caee64'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:38.979423 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:38.992022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecea54bc-9548-4cb6-ac9d-471308251883 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.032282 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0bad20-016c-4655-9cbd-603ae9b2591d req-a8875e49-d82a-4929-a1ae-27c6ad845231 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:39.033858 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8b0bad20-016c-4655-9cbd-603ae9b2591d req-a8875e49-d82a-4929-a1ae-27c6ad845231 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2505236 Dec 10 14:26:39.073473 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecea54bc-9548-4cb6-ac9d-471308251883 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.127644 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Allocated IP 172.20.0.3 (ac4f38b7-26d4-4f20-847f-e773befe5bbf/aef4f84d-d8f6-4cb2-af74-084a63caee64/6cea4e86-40fb-4825-b140-c7fad0901b5d) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:39.172189 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8b0bad20-016c-4655-9cbd-603ae9b2591d req-93f37a33-d03e-474e-9344-bfef4498bcc0 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1188149 Dec 10 14:26:39.172405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ccad468-dbfb-4d25-b0b6-8013e553c914 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-127044008'] for subnet, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.175144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.181544 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:39.181685 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.210267 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.230008 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.286810 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecea54bc-9548-4cb6-ac9d-471308251883 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.290302 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecea54bc-9548-4cb6-ac9d-471308251883 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.294237 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ecea54bc-9548-4cb6-ac9d-471308251883 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/fd0b8c69-e0aa-4df3-ae60-2ef8c7f1eee2 HTTP/1.1" status: 204 len: 168 time: 0.4443254 Dec 10 14:26:39.296693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55058) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:39.300282 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Made reservation on behalf of ef5003e8d7fc43dcb8d6e7196c2360d1 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:39.303812 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.316390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecea54bc-9548-4cb6-ac9d-471308251883 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd0b8c69-e0aa-4df3-ae60-2ef8c7f1eee2,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:39.319237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Subnet': ['ID=6fb5370c-8342-469c-9924-bdb358134f2c,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:39.323994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Checking segment: {'id': '16e64123-5fe0-41d3-b895-16b2f9a10070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:39.324312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Network hostable DHCP agents. Network: 9740484b-2f0c-4ec8-b8a4-2516743e88b3, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:39.342095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Network': ['ID=7f359b16-f43f-42d5-add5-01d2cda3e391,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:39.361450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 7f359b16-f43f-42d5-add5-01d2cda3e391 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:39.394221 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] device_id is not set on port a4186d0e-eb7c-4762-a48c-22d94b0cbb7b yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:39.408596 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-60b82ddd-5b7d-4498-b200-a05f3267e502 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.9766707 Dec 10 14:26:39.414032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55060) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:39.415529 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:39.428184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-2064786459'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:39.460368 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dad928a9-072e-4f8a-845a-ca7bfa55a474 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1611357 Dec 10 14:26:39.466712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55062) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:39.469836 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4883424c-0c48-4960-97ea-956c05374118 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-secgroup--1410503795'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:39.477495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 9740484b-2f0c-4ec8-b8a4-2516743e88b3) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:39.483374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:39.483374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-569440'] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.498084 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81b69085-8240-4364-b9a6-2157a2530a9a None None] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:39.516566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Made reservation on behalf of 21f59c1b1be143f4a57bfe84466b4c08 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:39.520439 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.551562 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] vlan segment allocate from pool success with {'vlan_id': 364, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:39.562463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.562807 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Added segment b555f9f3-cdf8-45d9-8627-b2f6363a5a77 of type vlan for network 26c2f5be-cb64-41a8-82a6-d606724194b4 Dec 10 14:26:39.572812 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.577878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Allocated IP 2001:db8::1cd (77457432-514b-48cd-95c7-0516e6ca0668/a648a80e-9761-4658-b2e6-f0ee19b475b4/a4186d0e-eb7c-4762-a48c-22d94b0cbb7b) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:39.581431 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1afb6ac5-30fc-4681-a98a-c9793950f57e tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1319566 Dec 10 14:26:39.582055 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55064) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:39.603995 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Router 17fff750-1d78-4334-a941-52bd05fe7de6 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:26:39.608565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'port': {'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3', 'name': 'tempest-AllowedAddressPairTestJSON-1398883597'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:39.636185 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-9740484b-2f0c-4ec8-b8a4-2516743e88b3', 'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3', 'project_id': 'a92f38bb4fde4f96868f58279fc34db3', 'fixed_ips': [{'subnet_id': '6fb5370c-8342-469c-9924-bdb358134f2c'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:39.636294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.652147 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.678834 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.704024 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4883424c-0c48-4960-97ea-956c05374118 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.748851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Network ac4f38b7-26d4-4f20-847f-e773befe5bbf is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:39.754881 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:39.762751 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Pushing event updated for resources: {'Port': ['ID=6cea4e86-40fb-4825-b140-c7fad0901b5d,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:39.765388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:39.806574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:39.818502 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Sync routers for ids ['17fff750-1d78-4334-a941-52bd05fe7de6'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:39.831691 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Routers {'17fff750-1d78-4334-a941-52bd05fe7de6'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:39.832833 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['17fff750-1d78-4334-a941-52bd05fe7de6'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:39.877278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Attempting to bind port 6cea4e86-40fb-4825-b140-c7fad0901b5d on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:39.877956 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Attempting to bind port 6cea4e86-40fb-4825-b140-c7fad0901b5d by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'ac4f38b7-26d4-4f20-847f-e773befe5bbf'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:39.878553 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Attempting to bind port 6cea4e86-40fb-4825-b140-c7fad0901b5d on network ac4f38b7-26d4-4f20-847f-e773befe5bbf {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:39.898421 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:39.899142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Checking segment: {'id': '8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'ac4f38b7-26d4-4f20-847f-e773befe5bbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:39.899735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.900285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Bound using segment: {'id': '8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'ac4f38b7-26d4-4f20-847f-e773befe5bbf'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:39.900928 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Bound port: 6cea4e86-40fb-4825-b140-c7fad0901b5d, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'ac4f38b7-26d4-4f20-847f-e773befe5bbf'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:39.901503 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.917825 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Allocated IP 172.20.0.2 (9740484b-2f0c-4ec8-b8a4-2516743e88b3/6fb5370c-8342-469c-9924-bdb358134f2c/3942045b-a9d6-4a71-a419-5e9d3e04b72a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:39.931867 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4883424c-0c48-4960-97ea-956c05374118 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.939478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.947355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:39.948626 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:39.971291 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Set router 17fff750-1d78-4334-a941-52bd05fe7de6 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:26:40.070587 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] For port 6cea4e86-40fb-4825-b140-c7fad0901b5d, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:40.080561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Network': ['ID=26c2f5be-cb64-41a8-82a6-d606724194b4,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:40.087516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4883424c-0c48-4960-97ea-956c05374118 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.095630 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] For port 6cea4e86-40fb-4825-b140-c7fad0901b5d, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6cea4e86-40fb-4825-b140-c7fad0901b5d,segment=NetworkSegment(8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f),segment_id=8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:40.103533 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 26c2f5be-cb64-41a8-82a6-d606724194b4 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:40.193660 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4883424c-0c48-4960-97ea-956c05374118 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a20c850f-8d28-4190-ae80-d6c0385bb82f,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:40.212773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.218220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.239679 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17fff750-1d78-4334-a941-52bd05fe7de6', 'name': 'tempest-snat-router-902226828', 'tenant_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.45'}], 'enable_snat': True}, 'gw_port_id': '85bca82c-85b8-46d1-b6dd-e32278f26e94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:26:34Z', 'updated_at': '2021-12-10T14:26:38Z', 'revision_number': 3, 'project_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'gw_port': {'id': '85bca82c-85b8-46d1-b6dd-e32278f26e94', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:da:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17fff750-1d78-4334-a941-52bd05fe7de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.45', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:26:35Z', 'updated_at': '2021-12-10T14:26:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:40.252485 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Made reservation on behalf of a92f38bb4fde4f96868f58279fc34db3 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:40.257773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.279362 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Checking router: 17fff750-1d78-4334-a941-52bd05fe7de6 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:26:40.279723 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Updating router 17fff750-1d78-4334-a941-52bd05fe7de6 port 85bca82c-85b8-46d1-b6dd-e32278f26e94 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:26:40.307972 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] device_id is not set on port 29eaa4b9-4a9e-4745-9066-c749bfa6fecd yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:40.311003 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.331325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.335172 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9ec87410-3b5c-44d5-9e7e-d28f561c7779 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 905 time: 5.9535816 Dec 10 14:26:40.337281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55066) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:40.375821 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f9af19c-2c1d-4381-ad5a-f09241b8a727 None None] Pushing event updated for resources: {'Port': ['ID=6cea4e86-40fb-4825-b140-c7fad0901b5d,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:40.402685 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.439327 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4883424c-0c48-4960-97ea-956c05374118 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.440850 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4883424c-0c48-4960-97ea-956c05374118 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.9745512 Dec 10 14:26:40.441619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ccad468-dbfb-4d25-b0b6-8013e553c914 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8745562688988', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-127408590'] for subnet, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.448800 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-46f549d9-8873-4571-80e0-d49b84fb23ef tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.0293398 Dec 10 14:26:40.449301 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55068) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:40.459313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55070) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:40.462987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-84e88dad-975a-472b-a3ef-cb7b1c945e1e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': 'a20c850f-8d28-4190-ae80-d6c0385bb82f', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:40.498064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.500873 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'ports': [{'network_id': '7f359b16-f43f-42d5-add5-01d2cda3e391', 'name': 'tempest-port--374163001', 'admin_state_up': True}, {'network_id': '26c2f5be-cb64-41a8-82a6-d606724194b4', 'admin_state_up': False}]} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:40.502128 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'port': {'network_id': '7f359b16-f43f-42d5-add5-01d2cda3e391', 'name': 'tempest-port--374163001', 'admin_state_up': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:40.502128 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'port': {'network_id': '26c2f5be-cb64-41a8-82a6-d606724194b4', 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:40.510417 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.573121 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Port': ['ID=a4186d0e-eb7c-4762-a48c-22d94b0cbb7b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:40.579262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:40.614190 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:40.618714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:40.642161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Network 77457432-514b-48cd-95c7-0516e6ca0668 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:40.648915 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:40.658611 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e208a279-b674-4377-a37d-585e12e97554 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/routers/17fff750-1d78-4334-a941-52bd05fe7de6 HTTP/1.1" status: 200 len: 906 time: 0.3196607 Dec 10 14:26:40.662361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55072) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:40.662361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:40.667282 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:40.667962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.699532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Allocated IP 172.20.0.14 (9740484b-2f0c-4ec8-b8a4-2516743e88b3/6fb5370c-8342-469c-9924-bdb358134f2c/29eaa4b9-4a9e-4745-9066-c749bfa6fecd) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:40.701563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Pushing event updated for resources: {'Port': ['ID=3942045b-a9d6-4a71-a419-5e9d3e04b72a,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:40.716486 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.749051 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Attempting to bind port 3942045b-a9d6-4a71-a419-5e9d3e04b72a on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:40.749446 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Attempting to bind port 3942045b-a9d6-4a71-a419-5e9d3e04b72a by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '16e64123-5fe0-41d3-b895-16b2f9a10070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:40.749845 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Attempting to bind port 3942045b-a9d6-4a71-a419-5e9d3e04b72a on network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:40.756394 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:40.756958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Checking segment: {'id': '16e64123-5fe0-41d3-b895-16b2f9a10070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:40.757373 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.757801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Bound using segment: {'id': '16e64123-5fe0-41d3-b895-16b2f9a10070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:40.758312 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Bound port: 3942045b-a9d6-4a71-a419-5e9d3e04b72a, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '16e64123-5fe0-41d3-b895-16b2f9a10070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:40.759240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.791408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ccad468-dbfb-4d25-b0b6-8013e553c914 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:40.793289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ccad468-dbfb-4d25-b0b6-8013e553c914 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.793392 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6ccad468-dbfb-4d25-b0b6-8013e553c914 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "PUT /v2.0/subnets/aef4f84d-d8f6-4cb2-af74-084a63caee64 HTTP/1.1" status: 200 len: 877 time: 1.8904541 Dec 10 14:26:40.802309 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55074) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:40.812475 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.858123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.885680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] For port 3942045b-a9d6-4a71-a419-5e9d3e04b72a, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:40.893135 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] For port 3942045b-a9d6-4a71-a419-5e9d3e04b72a, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3942045b-a9d6-4a71-a419-5e9d3e04b72a,segment=NetworkSegment(16e64123-5fe0-41d3-b895-16b2f9a10070),segment_id=16e64123-5fe0-41d3-b895-16b2f9a10070)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:40.902018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-203058ba-6dbc-4c86-8716-282882490505 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:40.903613 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Attempting to bind port 85bca82c-85b8-46d1-b6dd-e32278f26e94 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:40.904839 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Attempting to bind port 85bca82c-85b8-46d1-b6dd-e32278f26e94 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:40.905459 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Attempting to bind port 85bca82c-85b8-46d1-b6dd-e32278f26e94 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:40.917944 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58e2509d-c6b8-44d8-898a-616e2d6d8b63 None None] Pushing event updated for resources: {'Port': ['ID=85bca82c-85b8-46d1-b6dd-e32278f26e94,revision_number=2']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:40.934161 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:40.934540 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:40.934945 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.935383 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:40.935870 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Bound port: 85bca82c-85b8-46d1-b6dd-e32278f26e94, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:40.936286 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.947800 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:40.968244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ccad468-dbfb-4d25-b0b6-8013e553c914 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event updated for resources: {'Subnet': ['ID=aef4f84d-d8f6-4cb2-af74-084a63caee64,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:40.984157 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3adb5966-4f2c-4387-a0f7-f5616925b86d None None] Provisioning complete for port 85bca82c-85b8-46d1-b6dd-e32278f26e94 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:40.984526 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3adb5966-4f2c-4387-a0f7-f5616925b86d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.003997 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-84e88dad-975a-472b-a3ef-cb7b1c945e1e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.004960 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8d02af38-9154-4e45-a44e-0a39030de57c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 2.2559428 Dec 10 14:26:41.005851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55076) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:41.016954 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'port': {'network_id': '77457432-514b-48cd-95c7-0516e6ca0668', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-928782016'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:41.037728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.044695 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] For port 85bca82c-85b8-46d1-b6dd-e32278f26e94, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:41.052551 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] For port 85bca82c-85b8-46d1-b6dd-e32278f26e94, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=85bca82c-85b8-46d1-b6dd-e32278f26e94,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:41.107455 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3adb5966-4f2c-4387-a0f7-f5616925b86d None None] Port 85bca82c-85b8-46d1-b6dd-e32278f26e94 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:41.127868 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.150105 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.175121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a3e4be-ffc4-4394-8113-34f580035a6d None None] Pushing event updated for resources: {'Port': ['ID=3942045b-a9d6-4a71-a419-5e9d3e04b72a,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:41.177858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b17023f-282d-4b97-a805-d4a0904e8cf2 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:41.210104 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Routers {'17fff750-1d78-4334-a941-52bd05fe7de6'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:41.211217 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['17fff750-1d78-4334-a941-52bd05fe7de6'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:41.234280 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e9cbc081-1786-42ff-9eed-d60492548cda None None] Provisioning complete for port 85bca82c-85b8-46d1-b6dd-e32278f26e94 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:41.234985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9cbc081-1786-42ff-9eed-d60492548cda None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.256057 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58e2509d-c6b8-44d8-898a-616e2d6d8b63 None None] Pushing event updated for resources: {'Port': ['ID=85bca82c-85b8-46d1-b6dd-e32278f26e94,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:41.281857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-84e88dad-975a-472b-a3ef-cb7b1c945e1e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.296613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Made reservation on behalf of ef5003e8d7fc43dcb8d6e7196c2360d1 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:41.296854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting port 6cea4e86-40fb-4825-b140-c7fad0901b5d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:41.297081 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.302596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.348489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.359188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Made reservation on behalf of 21f59c1b1be143f4a57bfe84466b4c08 for: {'port': 2} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:41.367575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] device_id is not set on port 49b59e9a-54d8-4a7b-adf9-84b5e28f6636 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:41.367788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.374004 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] Set router 17fff750-1d78-4334-a941-52bd05fe7de6 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:26:41.376526 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9cbc081-1786-42ff-9eed-d60492548cda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.395503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-84e88dad-975a-472b-a3ef-cb7b1c945e1e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.420770 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e9cbc081-1786-42ff-9eed-d60492548cda None None] For port 85bca82c-85b8-46d1-b6dd-e32278f26e94, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=85bca82c-85b8-46d1-b6dd-e32278f26e94,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:41.440222 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.484964 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84e88dad-975a-472b-a3ef-cb7b1c945e1e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c0038136-0a46-47a0-8904-52fedd13882c,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:41.485229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Deleting port 85bca82c-85b8-46d1-b6dd-e32278f26e94 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:41.485630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.503052 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9cbc081-1786-42ff-9eed-d60492548cda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.577661 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e9cbc081-1786-42ff-9eed-d60492548cda None None] Provisioning complete for port a4186d0e-eb7c-4762-a48c-22d94b0cbb7b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:41.578037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9cbc081-1786-42ff-9eed-d60492548cda None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.583029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9cbc081-1786-42ff-9eed-d60492548cda None None] Pushing event updated for resources: {'Port': ['ID=85bca82c-85b8-46d1-b6dd-e32278f26e94,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:41.624556 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] For port 6cea4e86-40fb-4825-b140-c7fad0901b5d, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6cea4e86-40fb-4825-b140-c7fad0901b5d,segment=NetworkSegment(8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f),segment_id=8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:41.625130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.641971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Calling delete_port for 6cea4e86-40fb-4825-b140-c7fad0901b5d owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:41.644342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e9cbc081-1786-42ff-9eed-d60492548cda None None] Port a4186d0e-eb7c-4762-a48c-22d94b0cbb7b cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:41.700459 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-84e88dad-975a-472b-a3ef-cb7b1c945e1e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.702760 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-84e88dad-975a-472b-a3ef-cb7b1c945e1e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.2439938 Dec 10 14:26:41.714712 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55078) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:41.724931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3f18f1b6-20a7-4d62-9b09-298c8756e3fa tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': 'a20c850f-8d28-4190-ae80-d6c0385bb82f', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:41.738746 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17fff750-1d78-4334-a941-52bd05fe7de6', 'name': 'tempest-snat-router-902226828', 'tenant_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.45'}], 'enable_snat': True}, 'gw_port_id': '85bca82c-85b8-46d1-b6dd-e32278f26e94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:26:34Z', 'updated_at': '2021-12-10T14:26:38Z', 'revision_number': 3, 'project_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'gw_port': {'id': '85bca82c-85b8-46d1-b6dd-e32278f26e94', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:da:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17fff750-1d78-4334-a941-52bd05fe7de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.45', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:26:35Z', 'updated_at': '2021-12-10T14:26:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:41.757565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] For port 85bca82c-85b8-46d1-b6dd-e32278f26e94, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=85bca82c-85b8-46d1-b6dd-e32278f26e94,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:41.757878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.780609 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a42ca7a-3fca-402f-a8be-dad6c8eaaedd None None] The sync data for ids ['17fff750-1d78-4334-a941-52bd05fe7de6'] in dv-neutron-821401-2-hyperv is: [{'id': '17fff750-1d78-4334-a941-52bd05fe7de6', 'name': 'tempest-snat-router-902226828', 'tenant_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.45'}], 'enable_snat': True}, 'gw_port_id': '85bca82c-85b8-46d1-b6dd-e32278f26e94', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:26:34Z', 'updated_at': '2021-12-10T14:26:38Z', 'revision_number': 3, 'project_id': 'f9aa01fe07354a7bb501a9f380ddaed8', 'gw_port': {'id': '85bca82c-85b8-46d1-b6dd-e32278f26e94', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:da:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17fff750-1d78-4334-a941-52bd05fe7de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.45', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:26:35Z', 'updated_at': '2021-12-10T14:26:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:41.790519 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Calling delete_port for 85bca82c-85b8-46d1-b6dd-e32278f26e94 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:41.821952 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] device_id is not set on port b27060a7-4728-4744-af24-eb568858b3db yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:41.822151 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Allocated IP 2001:db8::8c (77457432-514b-48cd-95c7-0516e6ca0668/a648a80e-9761-4658-b2e6-f0ee19b475b4/49b59e9a-54d8-4a7b-adf9-84b5e28f6636) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:41.835473 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.891570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f18f1b6-20a7-4d62-9b09-298c8756e3fa tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:41.923392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:41.934367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:41.944559 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:41.953343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Port': ['ID=29eaa4b9-4a9e-4745-9066-c749bfa6fecd,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:42.039448 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55fb12b3-5cde-4dc3-90ce-26dddadff232 None None] Network ac4f38b7-26d4-4f20-847f-e773befe5bbf requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:42.048889 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f18f1b6-20a7-4d62-9b09-298c8756e3fa tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.076051 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:42.076704 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.127922 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f18f1b6-20a7-4d62-9b09-298c8756e3fa tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.130022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.139570 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-164a9f08-57d4-42cf-954c-9a3b5c623697 None None] Provisioning complete for port 6cea4e86-40fb-4825-b140-c7fad0901b5d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:42.139570 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-164a9f08-57d4-42cf-954c-9a3b5c623697 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.172026 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f18f1b6-20a7-4d62-9b09-298c8756e3fa tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=38ee6c6d-5d45-449c-9b05-707960c156a7,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:42.172116 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.203081 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-164a9f08-57d4-42cf-954c-9a3b5c623697 None None] Port 6cea4e86-40fb-4825-b140-c7fad0901b5d was deleted so its status cannot be updated. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Dec 10 14:26:42.270257 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] device_id is not set on port 4126cca7-f391-45ba-a57c-8df88e6b3b46 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:42.299601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f18f1b6-20a7-4d62-9b09-298c8756e3fa tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.315982 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3f18f1b6-20a7-4d62-9b09-298c8756e3fa tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5861683 Dec 10 14:26:42.315982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.323308 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7c0d319e-a955-4eca-8d61-275124048227 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.7370253 Dec 10 14:26:42.330203 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55082) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:42.331245 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55080) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:42.338848 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Port': ['ID=6cea4e86-40fb-4825-b140-c7fad0901b5d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:42.351436 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'port': {'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3', 'name': 'tempest-AllowedAddressPairTestJSON-1265889843', 'allowed_address_pairs': [{'ip_address': '172.20.0.14', 'mac_address': 'fa:16:3e:92:12:43'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:42.356162 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0bf82064-ec5d-40a2-8904-8b6fc77e2416 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': 'a20c850f-8d28-4190-ae80-d6c0385bb82f', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:42.385824 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event deleted for resources: {'Port': ['ID=85bca82c-85b8-46d1-b6dd-e32278f26e94,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:42.522373 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.551468 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11a75dd6-6d14-4923-b5a3-cad83eaa743a None None] Network ac4f38b7-26d4-4f20-847f-e773befe5bbf requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:42.641009 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.656255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33465d51-29ff-4179-89a2-2686f280ab2b None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:42.679157 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3942045b-a9d6-4a71-a419-5e9d3e04b72a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:42.699074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No DVR routers for this DVR port 6cea4e86-40fb-4825-b140-c7fad0901b5d on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:42.718261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.811766 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bf82064-ec5d-40a2-8904-8b6fc77e2416 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.818345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3942045b-a9d6-4a71-a419-5e9d3e04b72a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:42.818740 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.839609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.858083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67d09fc7-9326-4f1b-9f19-b2698d14f10a None None] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:42.865678 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Network 77457432-514b-48cd-95c7-0516e6ca0668 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:42.869162 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.889318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:42.890993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Port': ['ID=49b59e9a-54d8-4a7b-adf9-84b5e28f6636,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:42.902489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:42.923663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:42.924532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.929153 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:42.965119 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bf82064-ec5d-40a2-8904-8b6fc77e2416 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.085147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Port': ['ID=b27060a7-4728-4744-af24-eb568858b3db,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:43.096053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-5653af8f-f902-4602-8c89-90fedf5445cc None None] Provisioning complete for port 3942045b-a9d6-4a71-a419-5e9d3e04b72a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:43.097358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5653af8f-f902-4602-8c89-90fedf5445cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.110469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bf82064-ec5d-40a2-8904-8b6fc77e2416 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.128581 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Made reservation on behalf of a92f38bb4fde4f96868f58279fc34db3 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:43.144775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.148222 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Checking segment: {'id': '7056d828-c15e-4eff-a7e6-17ba9fc8e4bd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '7f359b16-f43f-42d5-add5-01d2cda3e391'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:43.148675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Network hostable DHCP agents. Network: 7f359b16-f43f-42d5-add5-01d2cda3e391, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:43.151089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.169987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.176112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf82064-ec5d-40a2-8904-8b6fc77e2416 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dafa6fb1-ec42-417a-a992-5f00645b008d,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:43.227776 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-de5bb201-f9f7-4529-8e36-428e7d61f685 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 942 time: 2.2157159 Dec 10 14:26:43.228974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55084) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:43.234966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3e8c8ca0-6b6a-4a22-b799-53bdffd795da tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::b5', 'mac_address': 'fa:16:3e:14:5a:ef'}, {'ip_address': '2001:db8::1cd', 'mac_address': 'fa:16:3e:f0:61:0c'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:43.236289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=aef4f84d-d8f6-4cb2-af74-084a63caee64,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:43.284478 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bf82064-ec5d-40a2-8904-8b6fc77e2416 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.285932 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0bf82064-ec5d-40a2-8904-8b6fc77e2416 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.9513152 Dec 10 14:26:43.290247 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55086) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:43.374823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.375415 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 17fff750-1d78-4334-a941-52bd05fe7de6 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:43.381950 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.386418 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6f2aa427-b391-4647-89aa-c8c18db86f48 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "DELETE /v2.0/routers/17fff750-1d78-4334-a941-52bd05fe7de6 HTTP/1.1" status: 204 len: 168 time: 2.7006314 Dec 10 14:26:43.387285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-025a4eaa-6603-4bce-a7d2-28210fb01a5e None None] Network ac4f38b7-26d4-4f20-847f-e773befe5bbf requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:43.392266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55088) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:43.465848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.497286 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3e8c8ca0-6b6a-4a22-b799-53bdffd795da tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.526571 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 3942045b-a9d6-4a71-a419-5e9d3e04b72a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3942045b-a9d6-4a71-a419-5e9d3e04b72a,segment=NetworkSegment(16e64123-5fe0-41d3-b895-16b2f9a10070),segment_id=16e64123-5fe0-41d3-b895-16b2f9a10070)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:43.573682 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5653af8f-f902-4602-8c89-90fedf5445cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.607490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.612631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c5766509-961a-49c4-b98c-9a91cd922cb4 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': 'a20c850f-8d28-4190-ae80-d6c0385bb82f', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:43.637803 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Network 7f359b16-f43f-42d5-add5-01d2cda3e391 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:43.659780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.665877 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7cf6c22-5c47-45e6-adb5-080c48c2ba7c None None] DHCP port deletion for ac4f38b7-26d4-4f20-847f-e773befe5bbf request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:43.667928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.700719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ac4f38b7-26d4-4f20-847f-e773befe5bbf']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:43.715511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:43.715859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e39ea8c-a14b-49f0-8cd2-d52b4ca4ca7f') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:43.745351 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.751003 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.760829 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=3942045b-a9d6-4a71-a419-5e9d3e04b72a,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:43.770722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 7f359b16-f43f-42d5-add5-01d2cda3e391) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:43.780134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-5653af8f-f902-4602-8c89-90fedf5445cc None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:26:43.780529 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-5653af8f-f902-4602-8c89-90fedf5445cc None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:26:43.791785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:43.792692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.801232 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2d3c061-2583-4165-ab48-9054e51be2b9 None None] Network 7f359b16-f43f-42d5-add5-01d2cda3e391 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:43.840463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.843280 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] device_id is not set on port 7f0791da-cb98-4060-b15c-950a83735706 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:43.878503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 398 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:43.878859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:43.882968 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:43.902015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:43.947432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3e8c8ca0-6b6a-4a22-b799-53bdffd795da tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.004427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c5766509-961a-49c4-b98c-9a91cd922cb4 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.010558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Port': ['ID=4126cca7-f391-45ba-a57c-8df88e6b3b46,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:44.052732 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3e8c8ca0-6b6a-4a22-b799-53bdffd795da tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.072796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Checking segment: {'id': 'b555f9f3-cdf8-45d9-8627-b2f6363a5a77', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '26c2f5be-cb64-41a8-82a6-d606724194b4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:44.073156 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Network hostable DHCP agents. Network: 26c2f5be-cb64-41a8-82a6-d606724194b4, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:44.093670 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-3e8c8ca0-6b6a-4a22-b799-53bdffd795da tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] In _notify_port_updated(), no bound segment for port 49b59e9a-54d8-4a7b-adf9-84b5e28f6636 on network 77457432-514b-48cd-95c7-0516e6ca0668 {{(pid=103811) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:44.098518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e8c8ca0-6b6a-4a22-b799-53bdffd795da tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:44.099653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3e8c8ca0-6b6a-4a22-b799-53bdffd795da tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.103115 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3e8c8ca0-6b6a-4a22-b799-53bdffd795da tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "PUT /v2.0/ports/49b59e9a-54d8-4a7b-adf9-84b5e28f6636 HTTP/1.1" status: 200 len: 1065 time: 0.8705268 Dec 10 14:26:44.105337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55090) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:44.105501 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.121511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.127959 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/ac4f38b7-26d4-4f20-847f-e773befe5bbf HTTP/1.1" status: 204 len: 168 time: 3.3159561 Dec 10 14:26:44.139389 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55092) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:44.150125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e8c8ca0-6b6a-4a22-b799-53bdffd795da tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event updated for resources: {'Port': ['ID=49b59e9a-54d8-4a7b-adf9-84b5e28f6636,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:44.177853 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Deleting port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:44.178199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.186252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da580a53-be20-4b79-98fd-ce0b304032d7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=ac4f38b7-26d4-4f20-847f-e773befe5bbf,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:44.198722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Allocated IP 172.20.0.12 (9740484b-2f0c-4ec8-b8a4-2516743e88b3/6fb5370c-8342-469c-9924-bdb358134f2c/7f0791da-cb98-4060-b15c-950a83735706) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:44.203570 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-3643f25d-6466-4754-a6bb-f88cd57d4f37 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:44.204040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3643f25d-6466-4754-a6bb-f88cd57d4f37 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:44.207229 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3643f25d-6466-4754-a6bb-f88cd57d4f37 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/aef4f84d-d8f6-4cb2-af74-084a63caee64 HTTP/1.1" status: 404 len: 337 time: 0.0583589 Dec 10 14:26:44.214721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55094) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:44.236352 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c5766509-961a-49c4-b98c-9a91cd922cb4 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.248029 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-145947e8-88c7-45d2-8605-a4b1d93d9bb3 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:44.248536 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-145947e8-88c7-45d2-8605-a4b1d93d9bb3 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:44.251725 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-145947e8-88c7-45d2-8605-a4b1d93d9bb3 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/ac4f38b7-26d4-4f20-847f-e773befe5bbf HTTP/1.1" status: 404 len: 339 time: 0.0337167 Dec 10 14:26:44.260410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55096) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:44.307510 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-c2be415f-1939-46be-97d7-e1f078d53b50 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Deleting port 49b59e9a-54d8-4a7b-adf9-84b5e28f6636 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:44.308247 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c2be415f-1939-46be-97d7-e1f078d53b50 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.308773 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-9cc6b852-528d-4ab3-b59a-3a2fa7ea05a1 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:44.309838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9cc6b852-528d-4ab3-b59a-3a2fa7ea05a1 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:44.319382 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9cc6b852-528d-4ab3-b59a-3a2fa7ea05a1 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/3d99e95b-0bf6-4cec-9d8b-7b1d7eeda33b HTTP/1.1" status: 404 len: 337 time: 0.0564523 Dec 10 14:26:44.320093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55098) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:44.348460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Network 26c2f5be-cb64-41a8-82a6-d606724194b4 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:44.350451 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c5766509-961a-49c4-b98c-9a91cd922cb4 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.386881 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-d7a1a741-0d1f-4df3-b7ba-16ee327f2074 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:44.387436 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d7a1a741-0d1f-4df3-b7ba-16ee327f2074 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:44.392178 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d7a1a741-0d1f-4df3-b7ba-16ee327f2074 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/2fe74820-6fc2-45a6-9344-8f6da3a07469 HTTP/1.1" status: 404 len: 339 time: 0.0534234 Dec 10 14:26:44.401571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55100) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:44.408906 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5766509-961a-49c4-b98c-9a91cd922cb4 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e7db240-c6e7-419e-9a73-a17438e08485,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:44.459169 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f16e8ccc-04d9-4273-a2a8-067f99f7ce97 None None] Provisioning complete for port 49b59e9a-54d8-4a7b-adf9-84b5e28f6636 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:44.465378 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f16e8ccc-04d9-4273-a2a8-067f99f7ce97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.482602 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 26c2f5be-cb64-41a8-82a6-d606724194b4) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:44.484692 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] For port 0cbbc097-d2e9-4a1b-a256-924ea147fcf8, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0cbbc097-d2e9-4a1b-a256-924ea147fcf8,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:44.485000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.488698 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:44.495081 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:44.499423 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Calling delete_port for 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:44.499968 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:44.500930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.501118 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f16e8ccc-04d9-4273-a2a8-067f99f7ce97 None None] Port 49b59e9a-54d8-4a7b-adf9-84b5e28f6636 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:44.503508 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-038946cb-fd17-41bb-9bda-434f43094347 None None] Network 26c2f5be-cb64-41a8-82a6-d606724194b4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:44.511561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c5766509-961a-49c4-b98c-9a91cd922cb4 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.512759 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c5766509-961a-49c4-b98c-9a91cd922cb4 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.9075103 Dec 10 14:26:44.519021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55102) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:44.524277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-23f09616-c30b-4581-8958-23bd87b32ca2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': 'a20c850f-8d28-4190-ae80-d6c0385bb82f', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:44.548820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.554751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.561018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f16e8ccc-04d9-4273-a2a8-067f99f7ce97 None None] Provisioning complete for port 29eaa4b9-4a9e-4745-9066-c749bfa6fecd triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:44.561623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f16e8ccc-04d9-4273-a2a8-067f99f7ce97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.597982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c2be415f-1939-46be-97d7-e1f078d53b50 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.617009 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0264cc11-d02c-4543-959b-7620279cde44 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1449 time: 4.1428578 Dec 10 14:26:44.621141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55104) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:44.623600 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f16e8ccc-04d9-4273-a2a8-067f99f7ce97 None None] Port 29eaa4b9-4a9e-4745-9066-c749bfa6fecd cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:44.623808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-c2be415f-1939-46be-97d7-e1f078d53b50 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Calling delete_port for 49b59e9a-54d8-4a7b-adf9-84b5e28f6636 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:44.642633 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f16e8ccc-04d9-4273-a2a8-067f99f7ce97 None None] Provisioning complete for port 3942045b-a9d6-4a71-a419-5e9d3e04b72a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:44.642633 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f16e8ccc-04d9-4273-a2a8-067f99f7ce97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.680833 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.760595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-23f09616-c30b-4581-8958-23bd87b32ca2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.767415 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:44.778723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f6f2a06-7f5c-483f-b6de-702d1b897552 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:44.784901 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f6f2a06-7f5c-483f-b6de-702d1b897552 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:44.786611 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2f6f2a06-7f5c-483f-b6de-702d1b897552 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1444 time: 0.1643248 Dec 10 14:26:44.794058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Port': ['ID=7f0791da-cb98-4060-b15c-950a83735706,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:44.797056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:44.799176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55106) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:44.819674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:44.836688 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3942045b-a9d6-4a71-a419-5e9d3e04b72a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:44.904218 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3942045b-a9d6-4a71-a419-5e9d3e04b72a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:44.904857 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.955989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-23f09616-c30b-4581-8958-23bd87b32ca2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.965324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:44.966587 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:44.995747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b2c12a76-a360-4535-a575-66f05b5e2c07 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Deleting port b27060a7-4728-4744-af24-eb568858b3db {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:44.996525 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b2c12a76-a360-4535-a575-66f05b5e2c07 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.017086 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6cea4e86-40fb-4825-b140-c7fad0901b5d no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:45.040998 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 6cea4e86-40fb-4825-b140-c7fad0901b5d {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:45.041358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6cea4e86-40fb-4825-b140-c7fad0901b5d not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:45.041812 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 85bca82c-85b8-46d1-b6dd-e32278f26e94 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:45.064424 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-23f09616-c30b-4581-8958-23bd87b32ca2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.073039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 85bca82c-85b8-46d1-b6dd-e32278f26e94 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:45.073557 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 85bca82c-85b8-46d1-b6dd-e32278f26e94 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:45.082663 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-218f95f4-2436-4280-94ba-2dc35b000039 None None] Provisioning complete for port 7f0791da-cb98-4060-b15c-950a83735706 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:45.083450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-218f95f4-2436-4280-94ba-2dc35b000039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.090584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b2c12a76-a360-4535-a575-66f05b5e2c07 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.103365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23f09616-c30b-4581-8958-23bd87b32ca2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1529d9c8-0276-43fc-9355-1978e0d34b8f,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:45.109214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b2c12a76-a360-4535-a575-66f05b5e2c07 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Calling delete_port for b27060a7-4728-4744-af24-eb568858b3db owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:45.113803 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-36abee9e-d82f-4897-a6b4-2fbdde37a26a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1000 time: 2.7686400 Dec 10 14:26:45.116448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55108) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.131445 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-218f95f4-2436-4280-94ba-2dc35b000039 None None] Port 7f0791da-cb98-4060-b15c-950a83735706 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:45.172298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.187862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-23f09616-c30b-4581-8958-23bd87b32ca2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.189050 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-23f09616-c30b-4581-8958-23bd87b32ca2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 772 time: 0.6685464 Dec 10 14:26:45.193885 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55110) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.207194 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9ddf0294-56c5-4f80-b9f2-88a181652931']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:45.220444 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e48b4c5-905c-447e-96f3-8d1a73159c97') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:45.220765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e48b4c5-905c-447e-96f3-8d1a73159c97') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:45.237539 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44214800-07ee-4026-a1e5-4578c0a4bdee tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:45.244110 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44214800-07ee-4026-a1e5-4578c0a4bdee tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:45.250223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44214800-07ee-4026-a1e5-4578c0a4bdee tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:45.254575 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-44214800-07ee-4026-a1e5-4578c0a4bdee tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2469 time: 0.1344883 Dec 10 14:26:45.254733 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.260715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55112) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.270895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b57360b-5139-47c7-8672-ced52493e039 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.281176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.289201 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 393 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:45.289650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:45.295347 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:45.307503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b57360b-5139-47c7-8672-ced52493e039 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.381295 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-2b8f8323-31fb-4d4c-95d2-bcf170758cea tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Deleting port 7f0791da-cb98-4060-b15c-950a83735706 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:45.381661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2b8f8323-31fb-4d4c-95d2-bcf170758cea tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.389895 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.420616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event deleted for resources: {'Port': ['ID=0cbbc097-d2e9-4a1b-a256-924ea147fcf8,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:45.428058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b2c12a76-a360-4535-a575-66f05b5e2c07 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.439143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cd8bd4d-22fd-41d4-a673-b014abd0f9ac None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:45.467846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c12a76-a360-4535-a575-66f05b5e2c07 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Port': ['ID=b27060a7-4728-4744-af24-eb568858b3db,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:45.471391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.475916 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b57360b-5139-47c7-8672-ced52493e039 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.478225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.485669 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/9ddf0294-56c5-4f80-b9f2-88a181652931 HTTP/1.1" status: 204 len: 168 time: 1.0801365 Dec 10 14:26:45.486012 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b57360b-5139-47c7-8672-ced52493e039 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.487110 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4b57360b-5139-47c7-8672-ced52493e039 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/1529d9c8-0276-43fc-9355-1978e0d34b8f HTTP/1.1" status: 204 len: 168 time: 0.2910323 Dec 10 14:26:45.488432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55114) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.494913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b2c12a76-a360-4535-a575-66f05b5e2c07 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.498151 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b2c12a76-a360-4535-a575-66f05b5e2c07 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/ports/b27060a7-4728-4744-af24-eb568858b3db HTTP/1.1" status: 204 len: 168 time: 0.6956332 Dec 10 14:26:45.501989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55116) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.504079 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55118) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.518311 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b57360b-5139-47c7-8672-ced52493e039 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=1529d9c8-0276-43fc-9355-1978e0d34b8f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:45.529406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c2be415f-1939-46be-97d7-e1f078d53b50 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.533587 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b132b947-1cd7-464f-9c00-d1213968f72c tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=9ddf0294-56c5-4f80-b9f2-88a181652931,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:45.534692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2b8f8323-31fb-4d4c-95d2-bcf170758cea tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.550741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-2b8f8323-31fb-4d4c-95d2-bcf170758cea tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Calling delete_port for 7f0791da-cb98-4060-b15c-950a83735706 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:45.586745 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fecd45fb-4efb-4893-8acf-547b2d7ed6d1 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5751 time: 0.0812302 Dec 10 14:26:45.586950 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55120) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.601634 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-02aec6dd-7ee9-4ac5-b4ff-f84677b8ba22 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:45.602622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-02aec6dd-7ee9-4ac5-b4ff-f84677b8ba22 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:45.605694 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-02aec6dd-7ee9-4ac5-b4ff-f84677b8ba22 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/663276bf-95ca-4adc-a51e-ba7c0585f104 HTTP/1.1" status: 404 len: 337 time: 0.1133521 Dec 10 14:26:45.608176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.610367 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55122) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.627812 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2be415f-1939-46be-97d7-e1f078d53b50 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event deleted for resources: {'Port': ['ID=49b59e9a-54d8-4a7b-adf9-84b5e28f6636,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:45.654938 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-59fbd38b-f002-4354-a957-14e3f1c81cc7 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.667218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-59fbd38b-f002-4354-a957-14e3f1c81cc7 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.734295 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-bdb747f3-b2ae-4669-901a-4c3a91af9608 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:45.734908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bdb747f3-b2ae-4669-901a-4c3a91af9608 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:45.738183 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bdb747f3-b2ae-4669-901a-4c3a91af9608 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/0d5d465c-7c22-4460-bec0-9f82527dd175 HTTP/1.1" status: 404 len: 339 time: 0.1245258 Dec 10 14:26:45.740770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55124) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.771985 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-08e2e77d-ca1e-4cf6-abed-4bce7395a084 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:45.772433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-08e2e77d-ca1e-4cf6-abed-4bce7395a084 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:45.776103 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-08e2e77d-ca1e-4cf6-abed-4bce7395a084 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/80b1af56-f290-4199-a044-f456fb3c2007 HTTP/1.1" status: 404 len: 337 time: 0.0341675 Dec 10 14:26:45.778779 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55126) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.793161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.793401 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-59fbd38b-f002-4354-a957-14e3f1c81cc7 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.801313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.812283 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-59fbd38b-f002-4354-a957-14e3f1c81cc7 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.813397 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-59fbd38b-f002-4354-a957-14e3f1c81cc7 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/9e7db240-c6e7-419e-9a73-a17438e08485 HTTP/1.1" status: 204 len: 168 time: 0.2255709 Dec 10 14:26:45.818579 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55128) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.821219 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-004c8422-d99c-4a6e-a709-4bffaaa105cb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:45.821776 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-004c8422-d99c-4a6e-a709-4bffaaa105cb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:45.825023 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-004c8422-d99c-4a6e-a709-4bffaaa105cb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/61cd8ab1-c210-4b89-8018-e6c2f32e1e85 HTTP/1.1" status: 404 len: 339 time: 0.0451174 Dec 10 14:26:45.830680 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59fbd38b-f002-4354-a957-14e3f1c81cc7 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9e7db240-c6e7-419e-9a73-a17438e08485,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:45.833677 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55130) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.875007 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-22cab6d7-8d16-40ac-a5a4-11dfc8c71cdb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:45.875463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-22cab6d7-8d16-40ac-a5a4-11dfc8c71cdb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:45.878518 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-22cab6d7-8d16-40ac-a5a4-11dfc8c71cdb tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/a81d921c-3a7c-4e52-9114-93ef4fb5979f HTTP/1.1" status: 404 len: 337 time: 0.0437126 Dec 10 14:26:45.884091 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55132) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.909906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4059cbd1-e3c2-4022-b5f3-27848b7a2a89 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Deleting port 4126cca7-f391-45ba-a57c-8df88e6b3b46 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:45.910157 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4059cbd1-e3c2-4022-b5f3-27848b7a2a89 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.913377 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-07e2ad09-4d84-493e-b0ad-1bfe0a0b43ab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:45.913904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-07e2ad09-4d84-493e-b0ad-1bfe0a0b43ab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:45.918006 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-07e2ad09-4d84-493e-b0ad-1bfe0a0b43ab tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/36c1aa98-7802-48a7-aee3-174f9dc199a3 HTTP/1.1" status: 404 len: 339 time: 0.0316048 Dec 10 14:26:45.930778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55134) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.933643 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7abbbe45-7b12-43ff-9324-57801304b8d2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5205 time: 0.1136055 Dec 10 14:26:45.936554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2b8f8323-31fb-4d4c-95d2-bcf170758cea tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:45.936752 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55136) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:45.979485 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b8f8323-31fb-4d4c-95d2-bcf170758cea tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event deleted for resources: {'Port': ['ID=7f0791da-cb98-4060-b15c-950a83735706,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:46.010600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20d65762-6731-4858-a76a-af771b805358 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.025822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20d65762-6731-4858-a76a-af771b805358 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.029630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.029630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 927e1edc-6f94-4fcb-b106-f5be2e4ecc3d {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:46.031414 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-55b095f7-2f67-4ce0-8a2c-38c66597990e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.032162 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-55b095f7-2f67-4ce0-8a2c-38c66597990e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.037300 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-55b095f7-2f67-4ce0-8a2c-38c66597990e tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/0e71c03c-67ca-4b85-9270-5f0aa43e07dc HTTP/1.1" status: 404 len: 337 time: 0.0909979 Dec 10 14:26:46.038304 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.043391 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-53ab5331-966e-4fee-a31d-8034e82b8dba tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "DELETE /v2.0/routers/927e1edc-6f94-4fcb-b106-f5be2e4ecc3d HTTP/1.1" status: 204 len: 168 time: 2.6458006 Dec 10 14:26:46.043503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55138) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.056337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55140) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.061982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c2be415f-1939-46be-97d7-e1f078d53b50 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.065193 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c2be415f-1939-46be-97d7-e1f078d53b50 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "DELETE /v2.0/ports/49b59e9a-54d8-4a7b-adf9-84b5e28f6636 HTTP/1.1" status: 204 len: 168 time: 1.9591913 Dec 10 14:26:46.069599 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55142) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.076619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-2003249461', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:46.087573 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-c4bde910-4cc9-49be-ba08-e802f6b2cef0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.088090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c4bde910-4cc9-49be-ba08-e802f6b2cef0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.099023 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c4bde910-4cc9-49be-ba08-e802f6b2cef0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/e3d7af68-e53b-41d1-a8cc-bb38d6273466 HTTP/1.1" status: 404 len: 339 time: 0.0486882 Dec 10 14:26:46.099470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55144) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.101500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4059cbd1-e3c2-4022-b5f3-27848b7a2a89 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.117926 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-61ba635b-18ae-4287-b165-797419c66879 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] GET failed (client error): The resource could not be found. Dec 10 14:26:46.121920 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-61ba635b-18ae-4287-b165-797419c66879 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "GET /v2.0/ports/49b59e9a-54d8-4a7b-adf9-84b5e28f6636 HTTP/1.1" status: 404 len: 333 time: 0.0486972 Dec 10 14:26:46.124648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55146) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.143341 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-513a3b48-550e-4cd7-8a35-3b584bdb428a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.143810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-513a3b48-550e-4cd7-8a35-3b584bdb428a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.149882 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-513a3b48-550e-4cd7-8a35-3b584bdb428a tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/e50fdcba-8d26-4f3c-ab15-d9579a0c9ea0 HTTP/1.1" status: 404 len: 337 time: 0.0420551 Dec 10 14:26:46.149882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4059cbd1-e3c2-4022-b5f3-27848b7a2a89 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Calling delete_port for 4126cca7-f391-45ba-a57c-8df88e6b3b46 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:46.153717 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55148) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.178198 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-6379f798-fc0a-45d7-bc09-602c9bd1f1ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.179172 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6379f798-fc0a-45d7-bc09-602c9bd1f1ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.188619 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6379f798-fc0a-45d7-bc09-602c9bd1f1ac tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/2e6064ab-419c-4cc1-b3c6-34a9bdf153e1 HTTP/1.1" status: 404 len: 339 time: 0.0348444 Dec 10 14:26:46.188928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55150) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.219078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20d65762-6731-4858-a76a-af771b805358 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.230388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20d65762-6731-4858-a76a-af771b805358 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.233889 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-20d65762-6731-4858-a76a-af771b805358 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/dafa6fb1-ec42-417a-a992-5f00645b008d HTTP/1.1" status: 204 len: 168 time: 0.2938449 Dec 10 14:26:46.255589 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55152) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.255878 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-33733947-af32-4092-ad8a-eb696ae61858 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.255878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-33733947-af32-4092-ad8a-eb696ae61858 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.257905 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-33733947-af32-4092-ad8a-eb696ae61858 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/d31206a9-bbed-4429-9335-9ab9960519df HTTP/1.1" status: 404 len: 337 time: 0.0679388 Dec 10 14:26:46.261524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55154) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.270591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.271868 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.284267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2b8f8323-31fb-4d4c-95d2-bcf170758cea tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.284458 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-2e2490d1-66b4-4911-9c9d-74fbc62ccfd7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.284458 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2e2490d1-66b4-4911-9c9d-74fbc62ccfd7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.286211 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2b8f8323-31fb-4d4c-95d2-bcf170758cea tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "DELETE /v2.0/ports/7f0791da-cb98-4060-b15c-950a83735706 HTTP/1.1" status: 204 len: 168 time: 1.0245535 Dec 10 14:26:46.289759 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2e2490d1-66b4-4911-9c9d-74fbc62ccfd7 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/f82bd24c-4a5b-4462-8ceb-3efb26395cb0 HTTP/1.1" status: 404 len: 339 time: 0.0249491 Dec 10 14:26:46.290015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20d65762-6731-4858-a76a-af771b805358 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=dafa6fb1-ec42-417a-a992-5f00645b008d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:46.290015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55156) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.290824 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55158) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.327053 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-a73aaac7-e993-450f-adab-237c94a83cf1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] GET failed (client error): The resource could not be found. Dec 10 14:26:46.328493 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a73aaac7-e993-450f-adab-237c94a83cf1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "GET /v2.0/ports/7f0791da-cb98-4060-b15c-950a83735706 HTTP/1.1" status: 404 len: 333 time: 0.0343425 Dec 10 14:26:46.331263 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-e704cedc-d8db-41ce-a631-a980403238c8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.331885 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e704cedc-d8db-41ce-a631-a980403238c8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.335465 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e704cedc-d8db-41ce-a631-a980403238c8 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/ce685e7c-4ca1-4eb0-bf8f-eecb2b704f72 HTTP/1.1" status: 404 len: 337 time: 0.0409465 Dec 10 14:26:46.336372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55160) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.342594 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55162) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.343278 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'port': {'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3', 'name': 'tempest-AllowedAddressPairTestJSON-906384534'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:46.400597 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.403888 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-d9dca083-26f4-4708-b959-6723138a5229 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.403888 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d9dca083-26f4-4708-b959-6723138a5229 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.409098 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d9dca083-26f4-4708-b959-6723138a5229 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/80ed8bcc-d9fb-4550-905e-9a7504be053d HTTP/1.1" status: 404 len: 339 time: 0.0632594 Dec 10 14:26:46.409739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55164) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.418706 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1ac72765-a991-44a5-b656-9e2d745ef06c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.1646461 Dec 10 14:26:46.422527 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55166) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.439340 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-808e01d5-b362-4ee9-972b-d1b39559055a tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Deleting port a4186d0e-eb7c-4762-a48c-22d94b0cbb7b {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:46.439673 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-808e01d5-b362-4ee9-972b-d1b39559055a tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.442930 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-e7376250-ee49-4955-a162-c04c77619a03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.443390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e7376250-ee49-4955-a162-c04c77619a03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.447033 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e7376250-ee49-4955-a162-c04c77619a03 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/c6e1c79a-9957-495f-96fb-c42c91a0eaa3 HTTP/1.1" status: 404 len: 337 time: 0.0363545 Dec 10 14:26:46.450052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55168) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.481203 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4059cbd1-e3c2-4022-b5f3-27848b7a2a89 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.489563 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-12786a0d-b84f-492c-a0e7-5af84faaa1d0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] DELETE failed (client error): The resource could not be found. Dec 10 14:26:46.490097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-12786a0d-b84f-492c-a0e7-5af84faaa1d0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:26:46.496137 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-12786a0d-b84f-492c-a0e7-5af84faaa1d0 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/84024f34-a33f-481f-86bf-3e9ad911dc0a HTTP/1.1" status: 404 len: 339 time: 0.0426517 Dec 10 14:26:46.496300 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d3804e9b-a447-4d96-b1f4-1463c684ef43 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.497553 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55170) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.535966 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d3804e9b-a447-4d96-b1f4-1463c684ef43 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.561437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4059cbd1-e3c2-4022-b5f3-27848b7a2a89 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Port': ['ID=4126cca7-f391-45ba-a57c-8df88e6b3b46,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:46.571721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4059cbd1-e3c2-4022-b5f3-27848b7a2a89 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.574909 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4059cbd1-e3c2-4022-b5f3-27848b7a2a89 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/ports/4126cca7-f391-45ba-a57c-8df88e6b3b46 HTTP/1.1" status: 204 len: 168 time: 1.0641608 Dec 10 14:26:46.580025 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55172) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.616458 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-091a8252-96c3-4aba-8f65-3c97e2e86cbd tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0352800 Dec 10 14:26:46.624934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55174) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.630259 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1539960712'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:46.638637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-49b52f4f-7839-4c0e-8231-1a747e02b682 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Deleting subnet 97be32d5-2672-4281-b1a7-9566e2dbf48c {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:26:46.644634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-49b52f4f-7839-4c0e-8231-1a747e02b682 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.674478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.690274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-808e01d5-b362-4ee9-972b-d1b39559055a tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.690542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-49b52f4f-7839-4c0e-8231-1a747e02b682 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.696595 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:46.704336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-808e01d5-b362-4ee9-972b-d1b39559055a tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Calling delete_port for a4186d0e-eb7c-4762-a48c-22d94b0cbb7b owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:46.714693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Made reservation on behalf of a92f38bb4fde4f96868f58279fc34db3 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:46.715459 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d3804e9b-a447-4d96-b1f4-1463c684ef43 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.718003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:46.728942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.729387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0cbbc097-d2e9-4a1b-a256-924ea147fcf8 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:46.729502 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d3804e9b-a447-4d96-b1f4-1463c684ef43 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.729502 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d3804e9b-a447-4d96-b1f4-1463c684ef43 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/38ee6c6d-5d45-449c-9b05-707960c156a7 HTTP/1.1" status: 204 len: 168 time: 0.2987347 Dec 10 14:26:46.729502 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55176) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.763710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] device_id is not set on port 10ddfb90-8809-4529-890d-c871c5923314 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:46.781925 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3804e9b-a447-4d96-b1f4-1463c684ef43 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=38ee6c6d-5d45-449c-9b05-707960c156a7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:46.821836 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Made reservation on behalf of 21f59c1b1be143f4a57bfe84466b4c08 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:46.825238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.879275 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ea0b44f6-a62e-4a67-901b-965928b52051 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.1504235 Dec 10 14:26:46.880245 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-49b52f4f-7839-4c0e-8231-1a747e02b682 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.883274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55178) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:46.926148 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] vlan segment allocate from pool success with {'vlan_id': 363, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:46.951625 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-79d824bd-9a9b-466d-83fc-63478283f8a5 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.965075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-79d824bd-9a9b-466d-83fc-63478283f8a5 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.967609 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:46.967956 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Added segment 2bea0bf6-e96a-44fe-9645-978724cb2867 of type vlan for network 4bc931a4-473a-4336-8f47-eb1dee452621 Dec 10 14:26:46.981529 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Allocated IP 172.20.0.3 (9740484b-2f0c-4ec8-b8a4-2516743e88b3/6fb5370c-8342-469c-9924-bdb358134f2c/10ddfb90-8809-4529-890d-c871c5923314) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:47.030607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.053158 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-808e01d5-b362-4ee9-972b-d1b39559055a tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.109990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-79d824bd-9a9b-466d-83fc-63478283f8a5 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.116619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-808e01d5-b362-4ee9-972b-d1b39559055a tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event deleted for resources: {'Port': ['ID=a4186d0e-eb7c-4762-a48c-22d94b0cbb7b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:47.121340 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-79d824bd-9a9b-466d-83fc-63478283f8a5 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.125320 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-79d824bd-9a9b-466d-83fc-63478283f8a5 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/c0038136-0a46-47a0-8904-52fedd13882c HTTP/1.1" status: 204 len: 168 time: 0.2379651 Dec 10 14:26:47.126317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55180) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:47.133029 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79d824bd-9a9b-466d-83fc-63478283f8a5 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=c0038136-0a46-47a0-8904-52fedd13882c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:47.151573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-49b52f4f-7839-4c0e-8231-1a747e02b682 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.156042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.189228 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-808e01d5-b362-4ee9-972b-d1b39559055a tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.192636 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-808e01d5-b362-4ee9-972b-d1b39559055a tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "DELETE /v2.0/ports/a4186d0e-eb7c-4762-a48c-22d94b0cbb7b HTTP/1.1" status: 204 len: 168 time: 1.0685682 Dec 10 14:26:47.194841 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.195826 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b52f4f-7839-4c0e-8231-1a747e02b682 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Subnet': ['ID=97be32d5-2672-4281-b1a7-9566e2dbf48c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:47.196286 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55182) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:47.209923 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06bb11f3-572b-4429-95d7-56c9e255537c None None] Network 357dc108-37ad-4356-90e3-4bbd945fbb62 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:47.233063 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-c2e3602b-bed2-4c52-92ea-15bab66f5791 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] GET failed (client error): The resource could not be found. Dec 10 14:26:47.240022 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c2e3602b-bed2-4c52-92ea-15bab66f5791 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "GET /v2.0/ports/a4186d0e-eb7c-4762-a48c-22d94b0cbb7b HTTP/1.1" status: 404 len: 333 time: 0.0366750 Dec 10 14:26:47.242676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-49b52f4f-7839-4c0e-8231-1a747e02b682 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.242852 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55184) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:47.242992 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-49b52f4f-7839-4c0e-8231-1a747e02b682 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/subnets/97be32d5-2672-4281-b1a7-9566e2dbf48c HTTP/1.1" status: 204 len: 168 time: 0.7406199 Dec 10 14:26:47.248213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55186) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:47.255033 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2f4ce710-d7db-44f7-8dae-50d6b6ed7696 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1250877 Dec 10 14:26:47.256119 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.261831 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:47.262502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.264751 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55188) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:47.387073 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.398012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Network': ['ID=4bc931a4-473a-4336-8f47-eb1dee452621,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:47.419903 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 4bc931a4-473a-4336-8f47-eb1dee452621 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:47.459981 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a04269c7-470e-47a7-9364-0ac5b2af683b None None] DHCP port deletion for 357dc108-37ad-4356-90e3-4bbd945fbb62 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:47.460594 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9740544f-9390-4345-b29a-2200bc67a487 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.8344986 Dec 10 14:26:47.461236 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55190) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:47.473935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1762667860'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:47.483398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a1eb63ea-4572-40f7-92d4-c4a6debb338f tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.521279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a1eb63ea-4572-40f7-92d4-c4a6debb338f tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.539146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-a04269c7-470e-47a7-9364-0ac5b2af683b None None] Deleting port 18ed8287-5c50-47b2-9269-4d49db12c7e7 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:47.540353 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a04269c7-470e-47a7-9364-0ac5b2af683b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.573165 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.613267 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Made reservation on behalf of 21f59c1b1be143f4a57bfe84466b4c08 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:47.616558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a04269c7-470e-47a7-9364-0ac5b2af683b None None] For port 18ed8287-5c50-47b2-9269-4d49db12c7e7, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=18ed8287-5c50-47b2-9269-4d49db12c7e7,segment=NetworkSegment(58bcc0c4-9e6d-488e-bce3-f832de1cf6fc),segment_id=58bcc0c4-9e6d-488e-bce3-f832de1cf6fc)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:47.616750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.616964 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a04269c7-470e-47a7-9364-0ac5b2af683b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.631472 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-a04269c7-470e-47a7-9364-0ac5b2af683b None None] Calling delete_port for 18ed8287-5c50-47b2-9269-4d49db12c7e7 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:47.655674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:47.660049 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Port': ['ID=10ddfb90-8809-4529-890d-c871c5923314,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:47.665579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:47.667983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:47.676064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a1eb63ea-4572-40f7-92d4-c4a6debb338f tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.678740 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a1eb63ea-4572-40f7-92d4-c4a6debb338f tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.682882 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a1eb63ea-4572-40f7-92d4-c4a6debb338f tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/a20c850f-8d28-4190-ae80-d6c0385bb82f HTTP/1.1" status: 204 len: 168 time: 0.4096997 Dec 10 14:26:47.706411 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.706959 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55192) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:47.718442 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] vlan segment allocate from pool success with {'vlan_id': 398, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:47.749666 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1eb63ea-4572-40f7-92d4-c4a6debb338f tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a20c850f-8d28-4190-ae80-d6c0385bb82f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:47.763399 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.763747 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Added segment e8456d12-0906-46d5-8c06-3e62dfd849de of type vlan for network 428f326b-b157-4e88-b8e0-0838be6e3c65 Dec 10 14:26:47.787658 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a04269c7-470e-47a7-9364-0ac5b2af683b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.793176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:47.793891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.806136 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a04269c7-470e-47a7-9364-0ac5b2af683b None None] No DVR routers for this DVR port 18ed8287-5c50-47b2-9269-4d49db12c7e7 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:47.819879 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] The port '18ed8287-5c50-47b2-9269-4d49db12c7e7' was deleted {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 10 14:26:47.848649 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a04269c7-470e-47a7-9364-0ac5b2af683b None None] Pushing event deleted for resources: {'Port': ['ID=18ed8287-5c50-47b2-9269-4d49db12c7e7,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:47.849404 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.854603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Allocated IP 172.26.2.249 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/c05df3c4-d79e-4e7f-bfbf-00cd5bed6fa3) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:47.855809 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e75e85f0-f59e-4803-a08b-1cb4fc633823 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1448770 Dec 10 14:26:47.863031 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55194) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:47.869356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9b52aa2c-c013-4d86-9f9e-44de29039864 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-secgroup--906383310'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:47.948278 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b9f205c5-af1d-436d-8282-87cbeb8701a3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 1.6086302 Dec 10 14:26:47.952770 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55196) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:47.964129 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ec57f453-28ca-488e-b259-c31f1d0ee719 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.14', 'mac_address': 'fa:16:3e:92:12:43'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:47.973933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.979467 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:47.980051 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:47.999078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-439f9fed-21c6-4289-87ed-ebd7336df21c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Deleting port 9e947d7d-3e7d-4059-8b03-bc42b7f966c0 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:47.999484 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-439f9fed-21c6-4289-87ed-ebd7336df21c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.014781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-fd0325df-4b0c-4dea-b61a-cbb3d0886cc8 None None] Provisioning complete for port 10ddfb90-8809-4529-890d-c871c5923314 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:48.015693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fd0325df-4b0c-4dea-b61a-cbb3d0886cc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.052201 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-fd0325df-4b0c-4dea-b61a-cbb3d0886cc8 None None] Port 10ddfb90-8809-4529-890d-c871c5923314 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:48.056524 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.089765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Network': ['ID=428f326b-b157-4e88-b8e0-0838be6e3c65,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:48.102234 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 428f326b-b157-4e88-b8e0-0838be6e3c65 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:48.102425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['357dc108-37ad-4356-90e3-4bbd945fbb62']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:48.121975 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b52aa2c-c013-4d86-9f9e-44de29039864 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.124854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '58bcc0c4-9e6d-488e-bce3-f832de1cf6fc') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:48.125112 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '58bcc0c4-9e6d-488e-bce3-f832de1cf6fc') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:48.155662 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.177493 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-795a8b4f-8d86-49d9-a3d7-54b3b74192d6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.6969223 Dec 10 14:26:48.177713 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.203971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-439f9fed-21c6-4289-87ed-ebd7336df21c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.212702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.223326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-439f9fed-21c6-4289-87ed-ebd7336df21c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Calling delete_port for 9e947d7d-3e7d-4059-8b03-bc42b7f966c0 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:48.223775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ec57f453-28ca-488e-b259-c31f1d0ee719 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.230660 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Releasing vlan 379 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:48.231078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:48.234228 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:48.306346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b52aa2c-c013-4d86-9f9e-44de29039864 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.314624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.392607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b52aa2c-c013-4d86-9f9e-44de29039864 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.397004 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:48.404353 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:48.411848 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:48.434191 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event updated for resources: {'Port': ['ID=c05df3c4-d79e-4e7f-bfbf-00cd5bed6fa3,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:48.438206 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f30c5fdd-6fb3-47eb-b87c-9947d5cfcba2 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:48.450818 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b52aa2c-c013-4d86-9f9e-44de29039864 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=056cb05d-3607-4283-8224-d94e54956175,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:48.479774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.491834 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.495809 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] 10.222.0.57 "DELETE /v2.0/networks/357dc108-37ad-4356-90e3-4bbd945fbb62 HTTP/1.1" status: 204 len: 168 time: 1.2197404 Dec 10 14:26:48.499805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ec57f453-28ca-488e-b259-c31f1d0ee719 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.508636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b52aa2c-c013-4d86-9f9e-44de29039864 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.514919 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9b52aa2c-c013-4d86-9f9e-44de29039864 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.6508737 Dec 10 14:26:48.515553 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55200) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:48.521620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6543acbe-98fd-4676-ad1f-03632a5396ca tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': '056cb05d-3607-4283-8224-d94e54956175', 'direction': 'ingress', 'protocol': 17}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:48.575934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ec57f453-28ca-488e-b259-c31f1d0ee719 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.577173 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-397adeae-eee5-483f-a247-022754c321b6 tempest-NetworksTest-776324652 tempest-NetworksTest-776324652-project] Pushing event deleted for resources: {'Network': ['ID=357dc108-37ad-4356-90e3-4bbd945fbb62,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:48.597325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-dbbc2ea7-99c9-4d1c-9415-7dbafbbccde3 None None] Provisioning complete for port c05df3c4-d79e-4e7f-bfbf-00cd5bed6fa3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:48.598024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-dbbc2ea7-99c9-4d1c-9415-7dbafbbccde3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.656504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 18ed8287-5c50-47b2-9269-4d49db12c7e7 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:48.667586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6543acbe-98fd-4676-ad1f-03632a5396ca tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.699919 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-439f9fed-21c6-4289-87ed-ebd7336df21c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.724862 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 18ed8287-5c50-47b2-9269-4d49db12c7e7 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:48.725198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 18ed8287-5c50-47b2-9269-4d49db12c7e7 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:48.748484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-dbbc2ea7-99c9-4d1c-9415-7dbafbbccde3 None None] Port c05df3c4-d79e-4e7f-bfbf-00cd5bed6fa3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:48.765705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439f9fed-21c6-4289-87ed-ebd7336df21c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event deleted for resources: {'Port': ['ID=9e947d7d-3e7d-4059-8b03-bc42b7f966c0,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:48.844509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-439f9fed-21c6-4289-87ed-ebd7336df21c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.847972 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-439f9fed-21c6-4289-87ed-ebd7336df21c tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "DELETE /v2.0/ports/9e947d7d-3e7d-4059-8b03-bc42b7f966c0 HTTP/1.1" status: 204 len: 168 time: 1.6066461 Dec 10 14:26:48.851011 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55202) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:48.869307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec57f453-28ca-488e-b259-c31f1d0ee719 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Port': ['ID=10ddfb90-8809-4529-890d-c871c5923314,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:48.873842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-ec57f453-28ca-488e-b259-c31f1d0ee719 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] In _notify_port_updated(), no bound segment for port 10ddfb90-8809-4529-890d-c871c5923314 on network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 {{(pid=103811) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:48.880027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec57f453-28ca-488e-b259-c31f1d0ee719 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:48.880817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ec57f453-28ca-488e-b259-c31f1d0ee719 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:48.884941 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ec57f453-28ca-488e-b259-c31f1d0ee719 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "PUT /v2.0/ports/10ddfb90-8809-4529-890d-c871c5923314 HTTP/1.1" status: 200 len: 993 time: 0.9286346 Dec 10 14:26:48.886430 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55204) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:48.951931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6543acbe-98fd-4676-ad1f-03632a5396ca tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.013810 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-d582014f-b1fe-48e9-ba50-bcb7b800b112 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Deleting subnet a648a80e-9761-4658-b2e6-f0ee19b475b4 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:26:49.026478 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0ee13006-2455-4ff8-8881-0ff4f37eccd0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Deleting port 10ddfb90-8809-4529-890d-c871c5923314 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:49.026937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0ee13006-2455-4ff8-8881-0ff4f37eccd0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.029588 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d582014f-b1fe-48e9-ba50-bcb7b800b112 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.094149 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6543acbe-98fd-4676-ad1f-03632a5396ca tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.108604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.171106 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d582014f-b1fe-48e9-ba50-bcb7b800b112 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.173289 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0ee13006-2455-4ff8-8881-0ff4f37eccd0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.183375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2ea738a9-6349-4640-8eb7-a55577159c3a None None] Provisioning complete for port 10ddfb90-8809-4529-890d-c871c5923314 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:49.183917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2ea738a9-6349-4640-8eb7-a55577159c3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.195385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55208) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:49.207125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0ee13006-2455-4ff8-8881-0ff4f37eccd0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Calling delete_port for 10ddfb90-8809-4529-890d-c871c5923314 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:49.212699 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6543acbe-98fd-4676-ad1f-03632a5396ca tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d09a9bcd-2396-4365-968c-cfd5f00f3c64,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:49.238132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2ea738a9-6349-4640-8eb7-a55577159c3a None None] Port 10ddfb90-8809-4529-890d-c871c5923314 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:49.275288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6543acbe-98fd-4676-ad1f-03632a5396ca tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.280291 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6543acbe-98fd-4676-ad1f-03632a5396ca tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.7637541 Dec 10 14:26:49.283033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55212) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:49.386728 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-57918dfc-b0f7-4e30-be01-315d9be6e58c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.425547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-57918dfc-b0f7-4e30-be01-315d9be6e58c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.428900 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d582014f-b1fe-48e9-ba50-bcb7b800b112 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.481817 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3609ac0d-e42c-4acc-8cd4-8b9c26ebed3e admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=0f2de0215b794a388e54d6341b69691a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2826734 Dec 10 14:26:49.485194 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55214) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:49.532820 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.558014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-30ea2890-c248-4797-ae82-ccb974ff1ed5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.581158 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-30ea2890-c248-4797-ae82-ccb974ff1ed5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.589688 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0ee13006-2455-4ff8-8881-0ff4f37eccd0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.635926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee13006-2455-4ff8-8881-0ff4f37eccd0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event deleted for resources: {'Port': ['ID=10ddfb90-8809-4529-890d-c871c5923314,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:49.651089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-57918dfc-b0f7-4e30-be01-315d9be6e58c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.653687 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-57918dfc-b0f7-4e30-be01-315d9be6e58c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.657656 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-57918dfc-b0f7-4e30-be01-315d9be6e58c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/056cb05d-3607-4283-8224-d94e54956175 HTTP/1.1" status: 204 len: 168 time: 0.3735616 Dec 10 14:26:49.658266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55216) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:49.708469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57918dfc-b0f7-4e30-be01-315d9be6e58c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=056cb05d-3607-4283-8224-d94e54956175,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:49.711896 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d582014f-b1fe-48e9-ba50-bcb7b800b112 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.742087 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d582014f-b1fe-48e9-ba50-bcb7b800b112 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event deleted for resources: {'Subnet': ['ID=a648a80e-9761-4658-b2e6-f0ee19b475b4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:49.762335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d582014f-b1fe-48e9-ba50-bcb7b800b112 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.767299 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d582014f-b1fe-48e9-ba50-bcb7b800b112 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "DELETE /v2.0/subnets/a648a80e-9761-4658-b2e6-f0ee19b475b4 HTTP/1.1" status: 204 len: 168 time: 0.9141409 Dec 10 14:26:49.769799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55218) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:49.775099 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-607a280d-0e12-40f1-a822-956192ac50a2 None None] Network 77457432-514b-48cd-95c7-0516e6ca0668 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:49.818641 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7cb12aa3-85b7-4ae7-b38f-1ac6ccda076f tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1369843 Dec 10 14:26:49.819254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55220) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:49.844481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-58c3f3d1-2c81-4c6c-bf64-4f88a36c212e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-secgroup--820529873'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:49.879679 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0ee13006-2455-4ff8-8881-0ff4f37eccd0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:49.886248 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0ee13006-2455-4ff8-8881-0ff4f37eccd0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "DELETE /v2.0/ports/10ddfb90-8809-4529-890d-c871c5923314 HTTP/1.1" status: 204 len: 168 time: 0.9989054 Dec 10 14:26:49.886936 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55222) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:49.912848 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-6cfe8e09-9e56-4de8-9923-da589a347523 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] GET failed (client error): The resource could not be found. Dec 10 14:26:49.920351 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6cfe8e09-9e56-4de8-9923-da589a347523 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "GET /v2.0/ports/10ddfb90-8809-4529-890d-c871c5923314 HTTP/1.1" status: 404 len: 333 time: 0.0322316 Dec 10 14:26:49.921369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55224) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:49.925832 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'port': {'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3', 'name': 'tempest-AllowedAddressPairTestJSON-447786782'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:49.929348 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.019226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Deleting port f4650184-7cc9-47a7-8dd8-70444267dc97 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:50.019575 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.047442 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3cbbaeb-8145-4a42-9adc-033761e1d20a None None] DHCP port deletion for 77457432-514b-48cd-95c7-0516e6ca0668 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:50.088764 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] For port f4650184-7cc9-47a7-8dd8-70444267dc97, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4650184-7cc9-47a7-8dd8-70444267dc97,segment=NetworkSegment(636ba934-3565-4c09-b7f6-90de379fe518),segment_id=636ba934-3565-4c09-b7f6-90de379fe518)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:50.089142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.103320 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Calling delete_port for f4650184-7cc9-47a7-8dd8-70444267dc97 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:50.136288 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b3cbbaeb-8145-4a42-9adc-033761e1d20a None None] Deleting port f4650184-7cc9-47a7-8dd8-70444267dc97 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:50.136686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b3cbbaeb-8145-4a42-9adc-033761e1d20a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.175740 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Router 2ec2eb93-7c95-47f2-b8b4-324cfda47ab5 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:26:50.215888 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b3cbbaeb-8145-4a42-9adc-033761e1d20a None None] For port f4650184-7cc9-47a7-8dd8-70444267dc97, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4650184-7cc9-47a7-8dd8-70444267dc97,segment=NetworkSegment(636ba934-3565-4c09-b7f6-90de379fe518),segment_id=636ba934-3565-4c09-b7f6-90de379fe518)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:50.217140 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b3cbbaeb-8145-4a42-9adc-033761e1d20a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.233288 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b3cbbaeb-8145-4a42-9adc-033761e1d20a None None] Calling delete_port for f4650184-7cc9-47a7-8dd8-70444267dc97 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:50.325259 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:50.345801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a908433d-c3b0-4e67-a863-871b21b9d07b None None] Sync routers for ids ['2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:50.359450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a908433d-c3b0-4e67-a863-871b21b9d07b None None] Routers {'2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:50.360453 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a908433d-c3b0-4e67-a863-871b21b9d07b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:50.396306 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a908433d-c3b0-4e67-a863-871b21b9d07b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:50.402337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-58c3f3d1-2c81-4c6c-bf64-4f88a36c212e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.404978 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-30ea2890-c248-4797-ae82-ccb974ff1ed5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.405745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a908433d-c3b0-4e67-a863-871b21b9d07b None None] Routers {'2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:50.406413 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a908433d-c3b0-4e67-a863-871b21b9d07b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:50.407419 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-30ea2890-c248-4797-ae82-ccb974ff1ed5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.409857 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-30ea2890-c248-4797-ae82-ccb974ff1ed5 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/ad7facc8-a096-49a5-b569-3841ca31a295 HTTP/1.1" status: 204 len: 168 time: 0.9236686 Dec 10 14:26:50.436297 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ea2890-c248-4797-ae82-ccb974ff1ed5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad7facc8-a096-49a5-b569-3841ca31a295,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:50.437914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.448992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55228) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:50.450297 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a908433d-c3b0-4e67-a863-871b21b9d07b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:50.450913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a908433d-c3b0-4e67-a863-871b21b9d07b None None] The sync data for ids ['2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:50.451731 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5cc35267-d238-485d-90fd-ebf5295c602e tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 889 time: 4.3901420 Dec 10 14:26:50.462240 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2553f728-39b3-4101-88d3-f1544c6a9eff tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': False}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:50.463652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.478335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b3cbbaeb-8145-4a42-9adc-033761e1d20a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.504831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] No DVR routers for this DVR port f4650184-7cc9-47a7-8dd8-70444267dc97 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:50.547528 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3cbbaeb-8145-4a42-9adc-033761e1d20a None None] Pushing event deleted for resources: {'Port': ['ID=f4650184-7cc9-47a7-8dd8-70444267dc97,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:50.552568 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3cbbaeb-8145-4a42-9adc-033761e1d20a None None] No DVR routers for this DVR port f4650184-7cc9-47a7-8dd8-70444267dc97 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:50.602821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event deleted for resources: {'Port': ['ID=f4650184-7cc9-47a7-8dd8-70444267dc97,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:50.643929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4650184-7cc9-47a7-8dd8-70444267dc97 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:50.656690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-58c3f3d1-2c81-4c6c-bf64-4f88a36c212e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.673561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Made reservation on behalf of a92f38bb4fde4f96868f58279fc34db3 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:50.673561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.677631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.689345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: f4650184-7cc9-47a7-8dd8-70444267dc97 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:50.689884 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4650184-7cc9-47a7-8dd8-70444267dc97 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:50.710108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['77457432-514b-48cd-95c7-0516e6ca0668']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:50.721756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '636ba934-3565-4c09-b7f6-90de379fe518') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:50.722260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '636ba934-3565-4c09-b7f6-90de379fe518') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:50.730237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] device_id is not set on port 78f50eb4-4bf3-4fe1-bc75-90b72f83a197 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:50.737512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.751699 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.759158 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Releasing vlan 368 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:50.759763 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:50.763058 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:50.779063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-58c3f3d1-2c81-4c6c-bf64-4f88a36c212e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.892198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58c3f3d1-2c81-4c6c-bf64-4f88a36c212e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c9f9da1a-512b-4c11-a2f5-390c011586c1,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:50.907202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-58c3f3d1-2c81-4c6c-bf64-4f88a36c212e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.908425 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-58c3f3d1-2c81-4c6c-bf64-4f88a36c212e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.0695992 Dec 10 14:26:50.914298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55232) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:50.922603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d274d4c7-59b5-4798-bba3-ae75cc52e737 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-secgroup--546184939'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:50.931995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.947497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:50.955007 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] 10.222.0.57 "DELETE /v2.0/networks/77457432-514b-48cd-95c7-0516e6ca0668 HTTP/1.1" status: 204 len: 168 time: 1.1808593 Dec 10 14:26:50.987385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408f8cf3-c5c9-4feb-aeb8-8dc11604dc48 tempest-AllowedAddressPairIpV6TestJSON-1470648258 tempest-AllowedAddressPairIpV6TestJSON-1470648258-project] Pushing event deleted for resources: {'Network': ['ID=77457432-514b-48cd-95c7-0516e6ca0668,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:51.029590 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Allocated IP 172.20.0.5 (9740484b-2f0c-4ec8-b8a4-2516743e88b3/6fb5370c-8342-469c-9924-bdb358134f2c/78f50eb4-4bf3-4fe1-bc75-90b72f83a197) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:51.044020 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2553f728-39b3-4101-88d3-f1544c6a9eff tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.091509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d274d4c7-59b5-4798-bba3-ae75cc52e737 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.159381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d274d4c7-59b5-4798-bba3-ae75cc52e737 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.228850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d274d4c7-59b5-4798-bba3-ae75cc52e737 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.251778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.287018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d274d4c7-59b5-4798-bba3-ae75cc52e737 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=84191f1f-86f7-4585-b20b-ada6b6a0ce71,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:51.345242 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d274d4c7-59b5-4798-bba3-ae75cc52e737 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.359272 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d274d4c7-59b5-4798-bba3-ae75cc52e737 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.4289808 Dec 10 14:26:51.359627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55246) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:51.364291 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a907b9bb-fa09-407d-b1f1-122c29fbe3e8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': 'c9f9da1a-512b-4c11-a2f5-390c011586c1', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '84191f1f-86f7-4585-b20b-ada6b6a0ce71', 'remote_ip_prefix': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:51.375208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.408308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:51.414027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:51.438460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:51.452517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55250) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:51.473955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a907b9bb-fa09-407d-b1f1-122c29fbe3e8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.519410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55254) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:51.528789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'subnets': [{'network_id': '4bc931a4-473a-4336-8f47-eb1dee452621', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--1135944697', 'ip_version': 6}, {'network_id': '428f326b-b157-4e88-b8e0-0838be6e3c65', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}]} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:51.529337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'subnet': {'network_id': '4bc931a4-473a-4336-8f47-eb1dee452621', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--1135944697', 'ip_version': 6}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:51.531170 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Request body: {'subnet': {'network_id': '428f326b-b157-4e88-b8e0-0838be6e3c65', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:51.561882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Port': ['ID=78f50eb4-4bf3-4fe1-bc75-90b72f83a197,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:51.579592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:51.580249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.686160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a907b9bb-fa09-407d-b1f1-122c29fbe3e8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.701241 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e6a541a7-07af-470e-a7cb-2852bf413976 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 1.7792983 Dec 10 14:26:51.717109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55260) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:51.725708 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5515cad7-8dca-4ca5-b4d6-91eee882d26d tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:92:12:43'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:51.794041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-64c41cc6-b359-4fcd-9245-f6f4d45fc037 None None] Provisioning complete for port 78f50eb4-4bf3-4fe1-bc75-90b72f83a197 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:51.795047 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-64c41cc6-b359-4fcd-9245-f6f4d45fc037 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.799997 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a907b9bb-fa09-407d-b1f1-122c29fbe3e8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.800572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2553f728-39b3-4101-88d3-f1544c6a9eff tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.804613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2553f728-39b3-4101-88d3-f1544c6a9eff tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:51.835360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-64c41cc6-b359-4fcd-9245-f6f4d45fc037 None None] Port 78f50eb4-4bf3-4fe1-bc75-90b72f83a197 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:51.864895 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:26:51.906327 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55264) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:51.941090 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2553f728-39b3-4101-88d3-f1544c6a9eff tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Router 2ec2eb93-7c95-47f2-b8b4-324cfda47ab5 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:26:52.045626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-436df718-3f79-4240-a688-3971909272c1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:52.046623 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-436df718-3f79-4240-a688-3971909272c1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 10 14:26:52.047110 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-436df718-3f79-4240-a688-3971909272c1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): There was a conflict when trying to complete your request. Dec 10 14:26:52.048084 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-436df718-3f79-4240-a688-3971909272c1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.1405778 Dec 10 14:26:52.053256 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55268) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.058514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--1508817567'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:52.089186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2553f728-39b3-4101-88d3-f1544c6a9eff tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:52.093877 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2553f728-39b3-4101-88d3-f1544c6a9eff tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.095030 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2553f728-39b3-4101-88d3-f1544c6a9eff tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "PUT /v2.0/routers/2ec2eb93-7c95-47f2-b8b4-324cfda47ab5 HTTP/1.1" status: 200 len: 926 time: 1.6440434 Dec 10 14:26:52.099372 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87c9a318-7c22-4c8e-9804-4e47e2ddb0d2 None None] Sync routers for ids ['2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:52.101712 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55270) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.111452 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87c9a318-7c22-4c8e-9804-4e47e2ddb0d2 None None] Routers {'2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:52.112299 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-87c9a318-7c22-4c8e-9804-4e47e2ddb0d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:52.145023 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.146485 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-87c9a318-7c22-4c8e-9804-4e47e2ddb0d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:52.156284 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87c9a318-7c22-4c8e-9804-4e47e2ddb0d2 None None] Routers {'2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:52.157097 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-87c9a318-7c22-4c8e-9804-4e47e2ddb0d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:52.159121 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.161355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a907b9bb-fa09-407d-b1f1-122c29fbe3e8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=af899f83-23ba-4677-a87e-8d028c6380e9,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:52.188617 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-16066690-ff3b-4031-b966-fdb7e486bdce admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=ef5003e8d7fc43dcb8d6e7196c2360d1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7322319 Dec 10 14:26:52.193625 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-87c9a318-7c22-4c8e-9804-4e47e2ddb0d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:52.194304 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87c9a318-7c22-4c8e-9804-4e47e2ddb0d2 None None] The sync data for ids ['2ec2eb93-7c95-47f2-b8b4-324cfda47ab5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:52.198566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55272) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.221979 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a907b9bb-fa09-407d-b1f1-122c29fbe3e8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.223177 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a907b9bb-fa09-407d-b1f1-122c29fbe3e8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.8628416 Dec 10 14:26:52.231292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55274) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.316464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5515cad7-8dca-4ca5-b4d6-91eee882d26d tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.344820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98567123-c835-48e7-ac42-a5d1b79d0287 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.357052 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0e02b728-a3e8-494e-a3be-ef558ab65f7a tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/routers/2ec2eb93-7c95-47f2-b8b4-324cfda47ab5 HTTP/1.1" status: 200 len: 926 time: 0.2508686 Dec 10 14:26:52.357236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Made reservation on behalf of 21f59c1b1be143f4a57bfe84466b4c08 for: {'subnet': 2} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:52.359088 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.359440 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.363999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55276) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.367280 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98567123-c835-48e7-ac42-a5d1b79d0287 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.370356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.385953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4f898a0b-7872-4458-925f-5cceaea9bb4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.415100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4f898a0b-7872-4458-925f-5cceaea9bb4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.441385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.466828 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98567123-c835-48e7-ac42-a5d1b79d0287 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.471244 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98567123-c835-48e7-ac42-a5d1b79d0287 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.472609 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-98567123-c835-48e7-ac42-a5d1b79d0287 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/af899f83-23ba-4677-a87e-8d028c6380e9 HTTP/1.1" status: 204 len: 168 time: 0.2410214 Dec 10 14:26:52.479730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55278) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.502123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98567123-c835-48e7-ac42-a5d1b79d0287 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=af899f83-23ba-4677-a87e-8d028c6380e9,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:52.506097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e0478651-0295-4615-a8fa-b4ac4a717cd0,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:52.542914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.577401 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4f898a0b-7872-4458-925f-5cceaea9bb4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.580276 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4f898a0b-7872-4458-925f-5cceaea9bb4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.581490 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4f898a0b-7872-4458-925f-5cceaea9bb4e admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/d0676ab8-4c5b-4205-a745-76b991c37160 HTTP/1.1" status: 204 len: 168 time: 0.3785934 Dec 10 14:26:52.585957 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbaf0dd0-1404-4b6b-8b0e-9478a2350537 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:52.591496 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fbaf0dd0-1404-4b6b-8b0e-9478a2350537 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=2ec2eb93-7c95-47f2-b8b4-324cfda47ab5&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2187877 Dec 10 14:26:52.591681 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55282) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.600972 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f898a0b-7872-4458-925f-5cceaea9bb4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0676ab8-4c5b-4205-a745-76b991c37160,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:52.620650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.630677 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-01940c15-a5ac-4ef8-9d01-dc90128d0702 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.1462455 Dec 10 14:26:52.636556 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55284) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.700288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2142ed6f-30e0-44b1-bd91-cda693b66c20,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:52.718570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94403fc2-93c8-4521-8d60-1ecf32743e00 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:52.722131 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-94403fc2-93c8-4521-8d60-1ecf32743e00 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 881 time: 0.1287024 Dec 10 14:26:52.723379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55286) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.749688 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-156e1787-c8f1-4195-8496-2c37b04118d9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=2ec2eb93-7c95-47f2-b8b4-324cfda47ab5 HTTP/1.1" status: 200 len: 205 time: 0.0250604 Dec 10 14:26:52.752339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55288) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.762178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.774014 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-09c67791-412b-44e0-b0a9-ec91151b3d71 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.7084723 Dec 10 14:26:52.785592 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55290) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:52.790398 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-79038ece-5d39-4f0a-a909-9e0d7bc64699 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '2142ed6f-30e0-44b1-bd91-cda693b66c20', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:52.818279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5515cad7-8dca-4ca5-b4d6-91eee882d26d tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.828117 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a10f8d5-d484-4076-9d07-cfa61a248b07 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.867014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.912097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a10f8d5-d484-4076-9d07-cfa61a248b07 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.915571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5515cad7-8dca-4ca5-b4d6-91eee882d26d tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:52.987324 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.034773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-79038ece-5d39-4f0a-a909-9e0d7bc64699 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.082561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5515cad7-8dca-4ca5-b4d6-91eee882d26d tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Port': ['ID=78f50eb4-4bf3-4fe1-bc75-90b72f83a197,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:53.114897 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5515cad7-8dca-4ca5-b4d6-91eee882d26d tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] In _notify_port_updated(), no bound segment for port 78f50eb4-4bf3-4fe1-bc75-90b72f83a197 on network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:53.120601 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5515cad7-8dca-4ca5-b4d6-91eee882d26d tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:53.121862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Deleting port c05df3c4-d79e-4e7f-bfbf-00cd5bed6fa3 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:53.121985 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5515cad7-8dca-4ca5-b4d6-91eee882d26d tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.122078 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.125540 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5515cad7-8dca-4ca5-b4d6-91eee882d26d tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "PUT /v2.0/ports/78f50eb4-4bf3-4fe1-bc75-90b72f83a197 HTTP/1.1" status: 200 len: 995 time: 1.4073806 Dec 10 14:26:53.127639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55300) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:53.179783 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a10f8d5-d484-4076-9d07-cfa61a248b07 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.182495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a10f8d5-d484-4076-9d07-cfa61a248b07 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.186098 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3a10f8d5-d484-4076-9d07-cfa61a248b07 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/84191f1f-86f7-4585-b20b-ada6b6a0ce71 HTTP/1.1" status: 204 len: 168 time: 0.5461555 Dec 10 14:26:53.190072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55302) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:53.250521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a10f8d5-d484-4076-9d07-cfa61a248b07 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=84191f1f-86f7-4585-b20b-ada6b6a0ce71,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:53.254379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.276558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-79038ece-5d39-4f0a-a909-9e0d7bc64699 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.277748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Calling delete_port for c05df3c4-d79e-4e7f-bfbf-00cd5bed6fa3 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:53.300614 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1d4258b0-f304-4623-aca3-f80a4c917a01 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4538 time: 0.1087549 Dec 10 14:26:53.303216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55306) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:53.332761 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-79038ece-5d39-4f0a-a909-9e0d7bc64699 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.357371 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79038ece-5d39-4f0a-a909-9e0d7bc64699 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=93378519-a057-45fa-b99f-90889bb9c425,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:53.362844 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-92dd5627-b557-4c46-a8c9-1976d48ad2e4 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Deleting port 78f50eb4-4bf3-4fe1-bc75-90b72f83a197 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:53.363204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92dd5627-b557-4c46-a8c9-1976d48ad2e4 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.370039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f640b975-4f26-4314-934a-dfc9df83798d None None] Provisioning complete for port 78f50eb4-4bf3-4fe1-bc75-90b72f83a197 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:53.370577 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f640b975-4f26-4314-934a-dfc9df83798d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.409665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f640b975-4f26-4314-934a-dfc9df83798d None None] Port 78f50eb4-4bf3-4fe1-bc75-90b72f83a197 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:53.420255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.470457 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-79038ece-5d39-4f0a-a909-9e0d7bc64699 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.470656 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-79038ece-5d39-4f0a-a909-9e0d7bc64699 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6839569 Dec 10 14:26:53.475881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55310) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:53.478354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e13bd5cb-69b5-4cfd-8758-d965896174c1 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.482690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-42fdb65b-9432-4a0b-9b98-f5b573bad1ea tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '2142ed6f-30e0-44b1-bd91-cda693b66c20', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:53.510206 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92dd5627-b557-4c46-a8c9-1976d48ad2e4 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.530385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e13bd5cb-69b5-4cfd-8758-d965896174c1 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.531195 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Subnet': ['ID=6aa9eb90-1e15-4c1e-8396-2eb4ff2f486b,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:53.544538 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-92dd5627-b557-4c46-a8c9-1976d48ad2e4 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Calling delete_port for 78f50eb4-4bf3-4fe1-bc75-90b72f83a197 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:53.559328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Checking segment: {'id': '2bea0bf6-e96a-44fe-9645-978724cb2867', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '4bc931a4-473a-4336-8f47-eb1dee452621'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:53.559696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Network hostable DHCP agents. Network: 4bc931a4-473a-4336-8f47-eb1dee452621, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:53.606625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-42fdb65b-9432-4a0b-9b98-f5b573bad1ea tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.685168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Network 4bc931a4-473a-4336-8f47-eb1dee452621 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:53.744056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 4bc931a4-473a-4336-8f47-eb1dee452621) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:53.748584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.758085 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e5159d7-59ca-4682-a73c-ab8f4abfaaea None None] Network 4bc931a4-473a-4336-8f47-eb1dee452621 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:53.787637 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55318) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:53.799172 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92dd5627-b557-4c46-a8c9-1976d48ad2e4 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.890825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92dd5627-b557-4c46-a8c9-1976d48ad2e4 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event deleted for resources: {'Port': ['ID=78f50eb4-4bf3-4fe1-bc75-90b72f83a197,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:53.900299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-4bc931a4-473a-4336-8f47-eb1dee452621', 'network_id': '4bc931a4-473a-4336-8f47-eb1dee452621', 'project_id': '21f59c1b1be143f4a57bfe84466b4c08', 'fixed_ips': [{'subnet_id': '6aa9eb90-1e15-4c1e-8396-2eb4ff2f486b'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:53.902217 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.975936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-968524430'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:53.992000 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event updated for resources: {'Subnet': ['ID=2d88cac7-a781-4e93-9229-1575cc0f3d6c,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:53.995080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e13bd5cb-69b5-4cfd-8758-d965896174c1 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:53.998358 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e13bd5cb-69b5-4cfd-8758-d965896174c1 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.000394 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e13bd5cb-69b5-4cfd-8758-d965896174c1 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/c9f9da1a-512b-4c11-a2f5-390c011586c1 HTTP/1.1" status: 204 len: 168 time: 0.6957214 Dec 10 14:26:54.004213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55322) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.014510 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Checking segment: {'id': 'e8456d12-0906-46d5-8c06-3e62dfd849de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '428f326b-b157-4e88-b8e0-0838be6e3c65'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:54.014950 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Network hostable DHCP agents. Network: 428f326b-b157-4e88-b8e0-0838be6e3c65, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:54.018794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92dd5627-b557-4c46-a8c9-1976d48ad2e4 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.022304 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-92dd5627-b557-4c46-a8c9-1976d48ad2e4 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "DELETE /v2.0/ports/78f50eb4-4bf3-4fe1-bc75-90b72f83a197 HTTP/1.1" status: 204 len: 168 time: 0.8926146 Dec 10 14:26:54.026394 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55324) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.029022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e13bd5cb-69b5-4cfd-8758-d965896174c1 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9f9da1a-512b-4c11-a2f5-390c011586c1,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:54.030877 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.090539 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-42fdb65b-9432-4a0b-9b98-f5b573bad1ea tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): There was a conflict when trying to complete your request. Dec 10 14:26:54.090866 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Allocated IP 2001:db8::1 (4bc931a4-473a-4336-8f47-eb1dee452621/6aa9eb90-1e15-4c1e-8396-2eb4ff2f486b/c1547b71-0904-4e89-a8c6-be3cd30ee759) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:54.092068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Network 428f326b-b157-4e88-b8e0-0838be6e3c65 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:54.092263 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-42fdb65b-9432-4a0b-9b98-f5b573bad1ea tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.6149678 Dec 10 14:26:54.094071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event deleted for resources: {'Port': ['ID=c05df3c4-d79e-4e7f-bfbf-00cd5bed6fa3,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:54.103600 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55326) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.103600 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-56c8a810-a35a-4e16-8a45-5f3decbb0b0b tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] GET failed (client error): The resource could not be found. Dec 10 14:26:54.104882 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-56c8a810-a35a-4e16-8a45-5f3decbb0b0b tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "GET /v2.0/ports/78f50eb4-4bf3-4fe1-bc75-90b72f83a197 HTTP/1.1" status: 404 len: 333 time: 0.0772123 Dec 10 14:26:54.115912 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55328) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.123992 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'port': {'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3', 'name': 'tempest-AllowedAddressPairTestJSON-392921284'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:54.189936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:54.193406 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.198981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 428f326b-b157-4e88-b8e0-0838be6e3c65) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:54.203004 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e3271f2f-e580-43ca-9189-f1386698db00 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1949711 Dec 10 14:26:54.203531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:54.204005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:54.204623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.211114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55330) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.217642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-986cd272-149f-4248-8e14-36f983c540a8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-secgroup--1886009218'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:54.225170 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.247838 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.274818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.280114 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1089c966-43db-4c32-a284-32d91eaeeb86 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:54.284385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1a65abe-4462-403f-97be-f54085667c4a None None] Network 428f326b-b157-4e88-b8e0-0838be6e3c65 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:54.299837 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-193008fc-4df0-46a2-ad1b-65062cca3042 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1476 time: 2.7749655 Dec 10 14:26:54.301439 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55332) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.311240 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-23b73291-6dca-40b1-bde0-b45beb9119b0 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.351188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.378242 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.384622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.401880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Network 4bc931a4-473a-4336-8f47-eb1dee452621 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:54.402815 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-23b73291-6dca-40b1-bde0-b45beb9119b0 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.407253 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:54.407928 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da44de33-278c-49ff-b0dc-d0e9ed4e77fa tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:54.411598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:54.415267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da44de33-278c-49ff-b0dc-d0e9ed4e77fa tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:54.417373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da44de33-278c-49ff-b0dc-d0e9ed4e77fa tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:54.419242 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-da44de33-278c-49ff-b0dc-d0e9ed4e77fa tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2102 time: 0.1167061 Dec 10 14:26:54.430343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55334) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.444090 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Pushing event updated for resources: {'Port': ['ID=c1547b71-0904-4e89-a8c6-be3cd30ee759,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:54.453891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-986cd272-149f-4248-8e14-36f983c540a8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.461725 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-428f326b-b157-4e88-b8e0-0838be6e3c65', 'network_id': '428f326b-b157-4e88-b8e0-0838be6e3c65', 'project_id': '21f59c1b1be143f4a57bfe84466b4c08', 'fixed_ips': [{'subnet_id': '2d88cac7-a781-4e93-9229-1575cc0f3d6c'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:54.462555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.462711 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.514555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-78dc7c00-c277-419f-8f4b-e219ca5065b3 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Deleting subnet 6aa9eb90-1e15-4c1e-8396-2eb4ff2f486b {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:26:54.518953 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78dc7c00-c277-419f-8f4b-e219ca5065b3 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.525296 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Attempting to bind port c1547b71-0904-4e89-a8c6-be3cd30ee759 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:54.525696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Attempting to bind port c1547b71-0904-4e89-a8c6-be3cd30ee759 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '2bea0bf6-e96a-44fe-9645-978724cb2867', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '4bc931a4-473a-4336-8f47-eb1dee452621'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:54.526060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Attempting to bind port c1547b71-0904-4e89-a8c6-be3cd30ee759 on network 4bc931a4-473a-4336-8f47-eb1dee452621 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:54.537725 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:54.537986 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.540026 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Checking segment: {'id': '2bea0bf6-e96a-44fe-9645-978724cb2867', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '4bc931a4-473a-4336-8f47-eb1dee452621'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:54.540176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Fanout notify agent at l3_agent the message router_deleted on router 2ec2eb93-7c95-47f2-b8b4-324cfda47ab5 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:26:54.540262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.540262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Bound using segment: {'id': '2bea0bf6-e96a-44fe-9645-978724cb2867', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '4bc931a4-473a-4336-8f47-eb1dee452621'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:54.540262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Bound port: c1547b71-0904-4e89-a8c6-be3cd30ee759, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2bea0bf6-e96a-44fe-9645-978724cb2867', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '4bc931a4-473a-4336-8f47-eb1dee452621'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:54.540262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.547062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.552153 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e44eba9f-a6e5-4512-8bf8-03f4b81d8cf9 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/2ec2eb93-7c95-47f2-b8b4-324cfda47ab5 HTTP/1.1" status: 204 len: 168 time: 1.7987595 Dec 10 14:26:54.555730 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55336) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.560231 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0b24aa22-53e9-4974-83ec-0575914808ef tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-624770275', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:54.563646 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Made reservation on behalf of a92f38bb4fde4f96868f58279fc34db3 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:54.567143 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.569281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.572620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-986cd272-149f-4248-8e14-36f983c540a8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.577487 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-23b73291-6dca-40b1-bde0-b45beb9119b0 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.580250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-23b73291-6dca-40b1-bde0-b45beb9119b0 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.581380 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-23b73291-6dca-40b1-bde0-b45beb9119b0 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/2142ed6f-30e0-44b1-bd91-cda693b66c20 HTTP/1.1" status: 204 len: 168 time: 0.4746401 Dec 10 14:26:54.587370 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55338) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.607440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23b73291-6dca-40b1-bde0-b45beb9119b0 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2142ed6f-30e0-44b1-bd91-cda693b66c20,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:54.613239 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78dc7c00-c277-419f-8f4b-e219ca5065b3 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.622115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-986cd272-149f-4248-8e14-36f983c540a8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.651018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] vlan segment allocate from pool success with {'vlan_id': 360, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:54.656639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] device_id is not set on port 225eaa37-bb79-4860-aa3f-8433aeee1697 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:54.671440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-986cd272-149f-4248-8e14-36f983c540a8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=43673d45-8555-4729-b7be-c54ee6d1692d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:54.677656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a0e30f60-2598-4f87-8a94-0fe3189b4960,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:54.682260 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d8b74b6c-b045-49bc-a6dd-0e5fc967ee43 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0870507 Dec 10 14:26:54.682790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55340) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.688210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8d1a8aaa-6785-485c-a2a4-9b95c38e4246 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--1064457658'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:54.700829 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b24aa22-53e9-4974-83ec-0575914808ef tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.701992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b24aa22-53e9-4974-83ec-0575914808ef tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.712142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.712142 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added segment d4c98e4f-31a7-4749-9370-604db6aa94b9 of type vlan for network 974a50ab-ab5c-449b-b2d5-182064cd08ee Dec 10 14:26:54.759204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] For port c1547b71-0904-4e89-a8c6-be3cd30ee759, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:54.762883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b24aa22-53e9-4974-83ec-0575914808ef tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.763878 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] For port c1547b71-0904-4e89-a8c6-be3cd30ee759, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c1547b71-0904-4e89-a8c6-be3cd30ee759,segment=NetworkSegment(2bea0bf6-e96a-44fe-9645-978724cb2867),segment_id=2bea0bf6-e96a-44fe-9645-978724cb2867)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:54.771126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Allocated IP 2001:db8:0:1::1 (428f326b-b157-4e88-b8e0-0838be6e3c65/2d88cac7-a781-4e93-9229-1575cc0f3d6c/b96aa976-95f6-4aca-89eb-2d7f219db9c7) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:54.781093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-986cd272-149f-4248-8e14-36f983c540a8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.782779 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-986cd272-149f-4248-8e14-36f983c540a8 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5704238 Dec 10 14:26:54.797244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.802174 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55342) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:54.807130 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c88a45f1-fcf3-4b00-b7d4-72cd47830753 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': '43673d45-8555-4729-b7be-c54ee6d1692d', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:54.880628 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Allocated IP 172.20.0.11 (9740484b-2f0c-4ec8-b8a4-2516743e88b3/6fb5370c-8342-469c-9924-bdb358134f2c/225eaa37-bb79-4860-aa3f-8433aeee1697) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:54.880898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b24aa22-53e9-4974-83ec-0575914808ef tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.924375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.932307 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.932879 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d1a8aaa-6785-485c-a2a4-9b95c38e4246 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.938271 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78dc7c00-c277-419f-8f4b-e219ca5065b3 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.976272 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:54.982605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:54.983540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.007745 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d1a8aaa-6785-485c-a2a4-9b95c38e4246 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.035432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b24aa22-53e9-4974-83ec-0575914808ef tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.038983 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0b24aa22-53e9-4974-83ec-0575914808ef tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.4794474 Dec 10 14:26:55.040647 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55344) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:55.045555 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:55.089698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d1a8aaa-6785-485c-a2a4-9b95c38e4246 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.114276 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.125789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Network': ['ID=974a50ab-ab5c-449b-b2d5-182064cd08ee,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:55.157240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Network 428f326b-b157-4e88-b8e0-0838be6e3c65 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:55.159448 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 974a50ab-ab5c-449b-b2d5-182064cd08ee details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:55.176707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.203992 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:55.208245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:55.223259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9dff534-fa66-43f2-902d-85588a22abf1 None None] Pushing event updated for resources: {'Port': ['ID=c1547b71-0904-4e89-a8c6-be3cd30ee759,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:55.237486 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-03524042-faf5-4b1a-ae3b-f504ef68ba71 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 1.4477973 Dec 10 14:26:55.242224 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55346) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:55.243060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c88a45f1-fcf3-4b00-b7d4-72cd47830753 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.245057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-302322838'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:55.260733 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1a8aaa-6785-485c-a2a4-9b95c38e4246 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=03d8acd3-3a13-48d6-8c33-0ec72480ad55,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:55.265828 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.267351 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78dc7c00-c277-419f-8f4b-e219ca5065b3 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.304725 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d1a8aaa-6785-485c-a2a4-9b95c38e4246 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.308319 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8d1a8aaa-6785-485c-a2a4-9b95c38e4246 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6218793 Dec 10 14:26:55.314704 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55348) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:55.353807 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Pushing event updated for resources: {'Port': ['ID=b96aa976-95f6-4aca-89eb-2d7f219db9c7,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:55.357341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78dc7c00-c277-419f-8f4b-e219ca5065b3 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Subnet': ['ID=6aa9eb90-1e15-4c1e-8396-2eb4ff2f486b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:55.360963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0b756d92-c28b-4892-a275-01b52f8cd960 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '03d8acd3-3a13-48d6-8c33-0ec72480ad55', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:55.361903 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78dc7c00-c277-419f-8f4b-e219ca5065b3 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.362299 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-0b756d92-c28b-4892-a275-01b52f8cd960 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Dec 10 14:26:55.362817 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-0b756d92-c28b-4892-a275-01b52f8cd960 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:26:55.371098 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0b756d92-c28b-4892-a275-01b52f8cd960 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0485139 Dec 10 14:26:55.371226 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-78dc7c00-c277-419f-8f4b-e219ca5065b3 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/subnets/6aa9eb90-1e15-4c1e-8396-2eb4ff2f486b HTTP/1.1" status: 204 len: 168 time: 0.9338307 Dec 10 14:26:55.371326 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55350) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:55.371326 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55352) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:55.373075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Attempting to bind port b96aa976-95f6-4aca-89eb-2d7f219db9c7 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:55.373677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Attempting to bind port b96aa976-95f6-4aca-89eb-2d7f219db9c7 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'e8456d12-0906-46d5-8c06-3e62dfd849de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '428f326b-b157-4e88-b8e0-0838be6e3c65'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:55.374272 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Attempting to bind port b96aa976-95f6-4aca-89eb-2d7f219db9c7 on network 428f326b-b157-4e88-b8e0-0838be6e3c65 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:55.378092 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:55.382477 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:55.386613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.387001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:55.388231 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:55.389202 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Checking segment: {'id': 'e8456d12-0906-46d5-8c06-3e62dfd849de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '428f326b-b157-4e88-b8e0-0838be6e3c65'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:55.389691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Port': ['ID=225eaa37-bb79-4860-aa3f-8433aeee1697,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:55.390039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.390656 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Bound using segment: {'id': 'e8456d12-0906-46d5-8c06-3e62dfd849de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '428f326b-b157-4e88-b8e0-0838be6e3c65'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:55.393722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Bound port: b96aa976-95f6-4aca-89eb-2d7f219db9c7, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e8456d12-0906-46d5-8c06-3e62dfd849de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '428f326b-b157-4e88-b8e0-0838be6e3c65'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:55.394134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.433254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:55.443784 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.493387 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:55.494603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.500139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] For port b96aa976-95f6-4aca-89eb-2d7f219db9c7, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:55.504802 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] For port b96aa976-95f6-4aca-89eb-2d7f219db9c7, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b96aa976-95f6-4aca-89eb-2d7f219db9c7,segment=NetworkSegment(e8456d12-0906-46d5-8c06-3e62dfd849de),segment_id=e8456d12-0906-46d5-8c06-3e62dfd849de)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:55.513232 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] vlan segment allocate from pool success with {'vlan_id': 374, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:26:55.528502 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.529172 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added segment 2d65ed04-f305-436f-85c3-d65e7a13667a of type vlan for network da18baf2-2036-4c07-8911-6bae9632cc69 Dec 10 14:26:55.540930 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-f5f5deec-1121-4739-a6c7-33a936e224c6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Deleting subnet 2d88cac7-a781-4e93-9229-1575cc0f3d6c {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:26:55.555347 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5f5deec-1121-4739-a6c7-33a936e224c6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.561018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.572862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c88a45f1-fcf3-4b00-b7d4-72cd47830753 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.592499 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.607001 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-93200ac0-b2b5-43a5-9893-692025ead5cb tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.4898288 Dec 10 14:26:55.617068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55354) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:55.630587 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'port': {'network_id': '9740484b-2f0c-4ec8-b8a4-2516743e88b3', 'name': 'tempest-AllowedAddressPairTestJSON-537483845'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:55.667262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ba4fe0-ed30-44b0-8e27-a10da06c27f3 None None] Pushing event updated for resources: {'Port': ['ID=b96aa976-95f6-4aca-89eb-2d7f219db9c7,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:55.709783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c88a45f1-fcf3-4b00-b7d4-72cd47830753 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.724762 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.resource_extend [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 10 14:26:55.732182 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-02d75e7e-9494-4da5-9287-8836926192bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.766249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5f5deec-1121-4739-a6c7-33a936e224c6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.806481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c88a45f1-fcf3-4b00-b7d4-72cd47830753 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=63a424e7-0b47-489b-ae76-d6f409f3a678,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:55.812527 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.818605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:55.819224 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.828696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-02d75e7e-9494-4da5-9287-8836926192bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.896833 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Made reservation on behalf of a92f38bb4fde4f96868f58279fc34db3 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:55.900465 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.904159 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-eac18444-4335-4ad8-9852-d91f2594000e None None] Provisioning complete for port 225eaa37-bb79-4860-aa3f-8433aeee1697 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:55.905365 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eac18444-4335-4ad8-9852-d91f2594000e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.926259 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Network': ['ID=da18baf2-2036-4c07-8911-6bae9632cc69,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:55.938962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] device_id is not set on port 4a0a5247-c579-483d-9b33-5a067151c7d7 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:26:55.949353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c88a45f1-fcf3-4b00-b7d4-72cd47830753 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.949353 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c88a45f1-fcf3-4b00-b7d4-72cd47830753 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 1.1449261 Dec 10 14:26:55.950310 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5f5deec-1121-4739-a6c7-33a936e224c6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:55.951170 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55356) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:55.972412 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network da18baf2-2036-4c07-8911-6bae9632cc69 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:26:55.975909 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-55d94c92-b14a-4322-9427-9324cc725e2c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.7322314 Dec 10 14:26:55.983194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55358) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:55.988538 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'subnet': {'network_id': '974a50ab-ab5c-449b-b2d5-182064cd08ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:56.045261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-02d75e7e-9494-4da5-9287-8836926192bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.047925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-02d75e7e-9494-4da5-9287-8836926192bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.051545 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-02d75e7e-9494-4da5-9287-8836926192bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/03d8acd3-3a13-48d6-8c33-0ec72480ad55 HTTP/1.1" status: 204 len: 168 time: 0.6769946 Dec 10 14:26:56.064975 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55360) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:56.066299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-eac18444-4335-4ad8-9852-d91f2594000e None None] Port 225eaa37-bb79-4860-aa3f-8433aeee1697 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:56.130735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02d75e7e-9494-4da5-9287-8836926192bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=03d8acd3-3a13-48d6-8c33-0ec72480ad55,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:56.175305 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5f5deec-1121-4739-a6c7-33a936e224c6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.180166 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.226024 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.230335 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5f5deec-1121-4739-a6c7-33a936e224c6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Subnet': ['ID=2d88cac7-a781-4e93-9229-1575cc0f3d6c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:56.239122 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5f5deec-1121-4739-a6c7-33a936e224c6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.245825 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f5f5deec-1121-4739-a6c7-33a936e224c6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/subnets/2d88cac7-a781-4e93-9229-1575cc0f3d6c HTTP/1.1" status: 204 len: 168 time: 0.8724332 Dec 10 14:26:56.250447 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55362) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:56.355368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf120cdf-2724-4649-9c21-68fe55c97adc tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:56.356889 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cf120cdf-2724-4649-9c21-68fe55c97adc tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1054485 Dec 10 14:26:56.375347 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55364) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:56.440065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d4b87b28-1d36-44c0-805e-3f32d2a84751 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.468729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Allocated IP 172.26.2.209 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/70806e6a-039c-4324-a277-89f398ae7255) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:56.479649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d4b87b28-1d36-44c0-805e-3f32d2a84751 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.488831 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.560790 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d2797e7e-3cd0-4f9f-ac9b-e8916a85d2ac tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.4339628 Dec 10 14:26:56.562857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Allocated IP 172.20.0.9 (9740484b-2f0c-4ec8-b8a4-2516743e88b3/6fb5370c-8342-469c-9924-bdb358134f2c/4a0a5247-c579-483d-9b33-5a067151c7d7) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:56.568978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55366) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:56.574226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ebb91606-a20c-49a9-bee8-7ef3645c03bc tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--381069533'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:56.593730 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30220f95-cade-49b3-bf2d-a7a115106483 None None] Network 4bc931a4-473a-4336-8f47-eb1dee452621 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:56.624559 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d4b87b28-1d36-44c0-805e-3f32d2a84751 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.631901 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d4b87b28-1d36-44c0-805e-3f32d2a84751 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.631901 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d4b87b28-1d36-44c0-805e-3f32d2a84751 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/63a424e7-0b47-489b-ae76-d6f409f3a678 HTTP/1.1" status: 204 len: 168 time: 0.6786835 Dec 10 14:26:56.635665 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55368) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:56.659747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4b87b28-1d36-44c0-805e-3f32d2a84751 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=63a424e7-0b47-489b-ae76-d6f409f3a678,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:56.696127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:56.699624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.728143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c1547b71-0904-4e89-a8c6-be3cd30ee759 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:56.731682 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.750290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Deleting port b96aa976-95f6-4aca-89eb-2d7f219db9c7 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:56.750636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.797794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e3487ab0-d510-4a1c-b1b4-d81d31fb0bd0 None None] Provisioning complete for port c1547b71-0904-4e89-a8c6-be3cd30ee759 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:56.797794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e3487ab0-d510-4a1c-b1b4-d81d31fb0bd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.854196 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ebb91606-a20c-49a9-bee8-7ef3645c03bc tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.858241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c1547b71-0904-4e89-a8c6-be3cd30ee759 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:56.865704 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.895273 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-97b8e638-63f7-43ef-ace6-f82cbb2f3fb1 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2530406 Dec 10 14:26:56.901927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55370) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:56.904767 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] For port b96aa976-95f6-4aca-89eb-2d7f219db9c7, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b96aa976-95f6-4aca-89eb-2d7f219db9c7,segment=NetworkSegment(e8456d12-0906-46d5-8c06-3e62dfd849de),segment_id=e8456d12-0906-46d5-8c06-3e62dfd849de)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:56.905145 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.908669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.928940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Calling delete_port for b96aa976-95f6-4aca-89eb-2d7f219db9c7 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:56.941945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd4e0bb9-8944-4673-b326-9ffb71e8ca09 None None] DHCP port deletion for 4bc931a4-473a-4336-8f47-eb1dee452621 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:56.960028 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e3487ab0-d510-4a1c-b1b4-d81d31fb0bd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:56.999110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.031502 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40aec707-f7e0-418b-901c-f5a6a87ba1c8 None None] Network 428f326b-b157-4e88-b8e0-0838be6e3c65 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:57.064300 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:57.071254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:57.079604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:57.083886 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e3487ab0-d510-4a1c-b1b4-d81d31fb0bd0 None None] For port c1547b71-0904-4e89-a8c6-be3cd30ee759, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c1547b71-0904-4e89-a8c6-be3cd30ee759,segment=NetworkSegment(2bea0bf6-e96a-44fe-9645-978724cb2867),segment_id=2bea0bf6-e96a-44fe-9645-978724cb2867)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:57.102283 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cad04b6e-d040-4142-8d0b-d1ff3a74994a None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:57.102617 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event updated for resources: {'Port': ['ID=70806e6a-039c-4324-a277-89f398ae7255,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.128986 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd0d5258-e84d-49df-bb84-616f8e8727c0 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.139363 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ebb91606-a20c-49a9-bee8-7ef3645c03bc tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.158150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd0d5258-e84d-49df-bb84-616f8e8727c0 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.163229 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e3487ab0-d510-4a1c-b1b4-d81d31fb0bd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.174468 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.193714 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.228954 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.235429 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.237489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ebb91606-a20c-49a9-bee8-7ef3645c03bc tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.246345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-cd4e0bb9-8944-4673-b326-9ffb71e8ca09 None None] Deleting port c1547b71-0904-4e89-a8c6-be3cd30ee759 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:57.246716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cd4e0bb9-8944-4673-b326-9ffb71e8ca09 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.262185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Port': ['ID=b96aa976-95f6-4aca-89eb-2d7f219db9c7,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.271773 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] No DVR routers for this DVR port b96aa976-95f6-4aca-89eb-2d7f219db9c7 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:57.326658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd0d5258-e84d-49df-bb84-616f8e8727c0 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.331702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd0d5258-e84d-49df-bb84-616f8e8727c0 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.335416 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fd0d5258-e84d-49df-bb84-616f8e8727c0 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/43673d45-8555-4729-b7be-c54ee6d1692d HTTP/1.1" status: 204 len: 168 time: 0.4291558 Dec 10 14:26:57.335603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3487ab0-d510-4a1c-b1b4-d81d31fb0bd0 None None] Pushing event updated for resources: {'Port': ['ID=c1547b71-0904-4e89-a8c6-be3cd30ee759,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.347191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-50c0b26c-5384-4818-ad45-6c72ee80ca6d None None] Could not find standard attr ID for object b96aa976-95f6-4aca-89eb-2d7f219db9c7. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:26:57.350441 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55372) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:57.357178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Subnet': ['ID=b4a4ac9a-ad53-4dee-8792-1cd9c66ab275,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.388570 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-cd4e0bb9-8944-4673-b326-9ffb71e8ca09 None None] For port c1547b71-0904-4e89-a8c6-be3cd30ee759, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c1547b71-0904-4e89-a8c6-be3cd30ee759,segment=NetworkSegment(2bea0bf6-e96a-44fe-9645-978724cb2867),segment_id=2bea0bf6-e96a-44fe-9645-978724cb2867)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:26:57.388963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cd4e0bb9-8944-4673-b326-9ffb71e8ca09 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.391150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:57.404987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ebb91606-a20c-49a9-bee8-7ef3645c03bc tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.409528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55374) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:57.409661 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ebb91606-a20c-49a9-bee8-7ef3645c03bc tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.8391855 Dec 10 14:26:57.409747 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:26:57.409982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebb91606-a20c-49a9-bee8-7ef3645c03bc tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1c7f8052-3c40-4935-a476-2ad805d85bc2,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.410095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:26:57.412515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-cd4e0bb9-8944-4673-b326-9ffb71e8ca09 None None] Calling delete_port for c1547b71-0904-4e89-a8c6-be3cd30ee759 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:26:57.415198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Port': ['ID=4a0a5247-c579-483d-9b33-5a067151c7d7,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.416454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0ad651fd-0971-47c9-8c0f-ad77b9cec81b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '1c7f8052-3c40-4935-a476-2ad805d85bc2', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:57.417395 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-0ad651fd-0971-47c9-8c0f-ad77b9cec81b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Dec 10 14:26:57.417657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:57.417836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-50c0b26c-5384-4818-ad45-6c72ee80ca6d None None] Provisioning complete for port 70806e6a-039c-4324-a277-89f398ae7255 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:57.417939 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-0ad651fd-0971-47c9-8c0f-ad77b9cec81b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:26:57.418186 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-50c0b26c-5384-4818-ad45-6c72ee80ca6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.419065 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0ad651fd-0971-47c9-8c0f-ad77b9cec81b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0073745 Dec 10 14:26:57.421720 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.423012 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:57.424899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55376) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:57.471220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['428f326b-b157-4e88-b8e0-0838be6e3c65']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:57.492772 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-50c0b26c-5384-4818-ad45-6c72ee80ca6d None None] Port 70806e6a-039c-4324-a277-89f398ae7255 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:57.515351 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-386fdd8f-41e3-4e38-95ab-4891ccb3e10d None None] DHCP port deletion for 428f326b-b157-4e88-b8e0-0838be6e3c65 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:26:57.515797 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e8456d12-0906-46d5-8c06-3e62dfd849de') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:57.516104 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e8456d12-0906-46d5-8c06-3e62dfd849de') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:57.532460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.534923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Checking segment: {'id': 'd4c98e4f-31a7-4749-9370-604db6aa94b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '974a50ab-ab5c-449b-b2d5-182064cd08ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:57.535424 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network hostable DHCP agents. Network: 974a50ab-ab5c-449b-b2d5-182064cd08ee, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:57.537930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd0d5258-e84d-49df-bb84-616f8e8727c0 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=43673d45-8555-4729-b7be-c54ee6d1692d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.572822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.575089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.611436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Releasing vlan 398 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:57.612099 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:57.614887 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:57.621737 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cd4e0bb9-8944-4673-b326-9ffb71e8ca09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.645003 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-84c93bcb-9cd5-428d-a730-c036e0c0df77 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2842450 Dec 10 14:26:57.646083 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55378) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:57.659204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a89ec271-6137-48b4-8b12-4089ff93ac4c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-secgroup--1693982527'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:57.670862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:57.672491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.677774 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd4e0bb9-8944-4673-b326-9ffb71e8ca09 None None] Pushing event deleted for resources: {'Port': ['ID=c1547b71-0904-4e89-a8c6-be3cd30ee759,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.683047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02620820-8533-4bb3-b3cc-60dfd18c3bd1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.712381 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd4e0bb9-8944-4673-b326-9ffb71e8ca09 None None] No DVR routers for this DVR port c1547b71-0904-4e89-a8c6-be3cd30ee759 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:26:57.723821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 974a50ab-ab5c-449b-b2d5-182064cd08ee is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:57.744865 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02620820-8533-4bb3-b3cc-60dfd18c3bd1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.777496 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 974a50ab-ab5c-449b-b2d5-182064cd08ee) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:57.782041 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:57.782711 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.786800 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-146b49d6-2e59-40df-af14-9302057a5c67 None None] Network 974a50ab-ab5c-449b-b2d5-182064cd08ee requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:57.797082 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.800299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a89ec271-6137-48b4-8b12-4089ff93ac4c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.809447 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.814958 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/networks/428f326b-b157-4e88-b8e0-0838be6e3c65 HTTP/1.1" status: 204 len: 168 time: 1.4362741 Dec 10 14:26:57.816224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55380) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:57.842141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6641cfbb-3d59-4605-9a60-d824a5539eb2 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Network': ['ID=428f326b-b157-4e88-b8e0-0838be6e3c65,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.859358 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-28c9b20f-23e4-4dd2-922c-7f2e50b6f589 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 2.2383876 Dec 10 14:26:57.859548 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e3d5b1d5-e605-4670-a9de-572ea85a8d44 None None] Provisioning complete for port 4a0a5247-c579-483d-9b33-5a067151c7d7 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:57.859548 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e3d5b1d5-e605-4670-a9de-572ea85a8d44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.859724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55382) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:57.880525 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a292b205-f85f-41be-95ae-221c205302cd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8928928 Dec 10 14:26:57.880525 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02620820-8533-4bb3-b3cc-60dfd18c3bd1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.881167 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02620820-8533-4bb3-b3cc-60dfd18c3bd1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.885281 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-02620820-8533-4bb3-b3cc-60dfd18c3bd1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/1c7f8052-3c40-4935-a476-2ad805d85bc2 HTTP/1.1" status: 204 len: 168 time: 0.4525034 Dec 10 14:26:57.885281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55384) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:57.891913 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6ba0d91a-1c0a-4864-814d-05bdbbe2688a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.14', 'mac_address': 'fa:16:3e:92:12:43'}, {'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:81:4a:7c'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:57.895159 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'subnet': {'network_id': 'da18baf2-2036-4c07-8911-6bae9632cc69', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:57.899492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55386) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:57.947340 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e3d5b1d5-e605-4670-a9de-572ea85a8d44 None None] Port 4a0a5247-c579-483d-9b33-5a067151c7d7 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:57.951668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-974a50ab-ab5c-449b-b2d5-182064cd08ee', 'network_id': '974a50ab-ab5c-449b-b2d5-182064cd08ee', 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'fixed_ips': [{'subnet_id': 'b4a4ac9a-ad53-4dee-8792-1cd9c66ab275'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:57.952095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02620820-8533-4bb3-b3cc-60dfd18c3bd1 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c7f8052-3c40-4935-a476-2ad805d85bc2,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:57.952907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:57.956085 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Port c1547b71-0904-4e89-a8c6-be3cd30ee759 update to ACTIVE by agent not found {{(pid=103812) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 10 14:26:57.956786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b96aa976-95f6-4aca-89eb-2d7f219db9c7 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:26:57.990324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: b96aa976-95f6-4aca-89eb-2d7f219db9c7 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:57.991031 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b96aa976-95f6-4aca-89eb-2d7f219db9c7 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Dec 10 14:26:58.024383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a89ec271-6137-48b4-8b12-4089ff93ac4c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.033863 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Port b96aa976-95f6-4aca-89eb-2d7f219db9c7 not found, will not notify nova. {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Dec 10 14:26:58.046066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.074686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a89ec271-6137-48b4-8b12-4089ff93ac4c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.076122 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.100439 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.100706 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:26:58.104983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.111556 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-21e016b7-286b-452a-994d-35b97d3bbb1a tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2104731 Dec 10 14:26:58.116541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55388) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:58.133376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c8060b8b-4f43-437a-8a7f-033dc862842e tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--1377267505'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:58.169032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a89ec271-6137-48b4-8b12-4089ff93ac4c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=068c78e0-73cc-4fc1-b13c-3c0f804b3d69,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:58.187516 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Allocated IP 2001:db8::2 (974a50ab-ab5c-449b-b2d5-182064cd08ee/b4a4ac9a-ad53-4dee-8792-1cd9c66ab275/4581a382-f5c0-44b0-9484-1e4a7572ee50) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:58.203678 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a89ec271-6137-48b4-8b12-4089ff93ac4c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.207508 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a89ec271-6137-48b4-8b12-4089ff93ac4c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5528588 Dec 10 14:26:58.212595 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55390) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:58.229598 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-453eb2a2-a658-4aea-b1f7-749bfa53ede2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': '068c78e0-73cc-4fc1-b13c-3c0f804b3d69', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:58.264427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c8060b8b-4f43-437a-8a7f-033dc862842e tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.346966 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.398037 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c8060b8b-4f43-437a-8a7f-033dc862842e tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.417847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.440816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.459657 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Network 974a50ab-ab5c-449b-b2d5-182064cd08ee is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:58.465020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:58.470159 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:58.481129 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Pushing event updated for resources: {'Port': ['ID=4581a382-f5c0-44b0-9484-1e4a7572ee50,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:58.494893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c8060b8b-4f43-437a-8a7f-033dc862842e tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.528835 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Attempting to bind port 4581a382-f5c0-44b0-9484-1e4a7572ee50 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:58.528835 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Attempting to bind port 4581a382-f5c0-44b0-9484-1e4a7572ee50 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'd4c98e4f-31a7-4749-9370-604db6aa94b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '974a50ab-ab5c-449b-b2d5-182064cd08ee'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:58.528835 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Attempting to bind port 4581a382-f5c0-44b0-9484-1e4a7572ee50 on network 974a50ab-ab5c-449b-b2d5-182064cd08ee {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:58.535946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:58.536462 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Checking segment: {'id': 'd4c98e4f-31a7-4749-9370-604db6aa94b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '974a50ab-ab5c-449b-b2d5-182064cd08ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:58.537709 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.538133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Subnet': ['ID=095b94f4-22e7-4e8c-b916-8569ce0ad1d7,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:58.538597 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Bound using segment: {'id': 'd4c98e4f-31a7-4749-9370-604db6aa94b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '974a50ab-ab5c-449b-b2d5-182064cd08ee'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:58.538858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Bound port: 4581a382-f5c0-44b0-9484-1e4a7572ee50, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd4c98e4f-31a7-4749-9370-604db6aa94b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '974a50ab-ab5c-449b-b2d5-182064cd08ee'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:58.540096 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.556880 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8060b8b-4f43-437a-8a7f-033dc862842e tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f40b29b5-be5b-443a-8fcf-57dd7fbd76d7,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:58.560452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Checking segment: {'id': '2d65ed04-f305-436f-85c3-d65e7a13667a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'da18baf2-2036-4c07-8911-6bae9632cc69'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:58.560827 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network hostable DHCP agents. Network: da18baf2-2036-4c07-8911-6bae9632cc69, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:26:58.609477 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c1547b71-0904-4e89-a8c6-be3cd30ee759 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:58.628660 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network da18baf2-2036-4c07-8911-6bae9632cc69 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:26:58.644447 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: c1547b71-0904-4e89-a8c6-be3cd30ee759 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:58.645043 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c1547b71-0904-4e89-a8c6-be3cd30ee759 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:58.645246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b96aa976-95f6-4aca-89eb-2d7f219db9c7 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:26:58.665000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.671225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: b96aa976-95f6-4aca-89eb-2d7f219db9c7 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:26:58.671573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b96aa976-95f6-4aca-89eb-2d7f219db9c7 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:26:58.676945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] For port 4581a382-f5c0-44b0-9484-1e4a7572ee50, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:58.689453 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] For port 4581a382-f5c0-44b0-9484-1e4a7572ee50, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=4581a382-f5c0-44b0-9484-1e4a7572ee50,segment=NetworkSegment(d4c98e4f-31a7-4749-9370-604db6aa94b9),segment_id=d4c98e4f-31a7-4749-9370-604db6aa94b9)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:58.689694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6ba0d91a-1c0a-4864-814d-05bdbbe2688a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.699290 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, da18baf2-2036-4c07-8911-6bae9632cc69) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:58.706455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:58.706455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.710130 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4bc931a4-473a-4336-8f47-eb1dee452621']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:58.713887 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e023d4b6-da85-4028-8c5a-fdbf328628b2 None None] Network da18baf2-2036-4c07-8911-6bae9632cc69 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:26:58.726526 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2bea0bf6-e96a-44fe-9645-978724cb2867') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:58.729194 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2bea0bf6-e96a-44fe-9645-978724cb2867') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:58.768870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.789009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-453eb2a2-a658-4aea-b1f7-749bfa53ede2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.808625 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.810532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.820225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-da18baf2-2036-4c07-8911-6bae9632cc69', 'network_id': 'da18baf2-2036-4c07-8911-6bae9632cc69', 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'fixed_ips': [{'subnet_id': '095b94f4-22e7-4e8c-b916-8569ce0ad1d7'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:26:58.821111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.828167 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-02fbf6e1-f7d9-4c1d-8f65-e2dae13a6e29 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.9344513 Dec 10 14:26:58.829723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55392) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:58.833265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1b5e133a-7eff-4b01-9580-8d5c83b9cfe5 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1968772373', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:58.836707 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Releasing vlan 363 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:58.836707 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:58.838965 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:58.884825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c8060b8b-4f43-437a-8a7f-033dc862842e tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:58.888912 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c8060b8b-4f43-437a-8a7f-033dc862842e tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.7681594 Dec 10 14:26:58.890785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55394) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:58.895433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e07a2860-0bab-4c44-baf9-154b04e4df6b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': 'f40b29b5-be5b-443a-8fcf-57dd7fbd76d7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:58.918563 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-e07a2860-0bab-4c44-baf9-154b04e4df6b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Dec 10 14:26:58.918563 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-e07a2860-0bab-4c44-baf9-154b04e4df6b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:26:58.918563 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e07a2860-0bab-4c44-baf9-154b04e4df6b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0252345 Dec 10 14:26:58.922733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55396) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:58.929369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-18e723bc-c7f8-419c-b76d-3a109735978c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': 'f40b29b5-be5b-443a-8fcf-57dd7fbd76d7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:58.930495 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-18e723bc-c7f8-419c-b76d-3a109735978c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Dec 10 14:26:58.931382 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-18e723bc-c7f8-419c-b76d-3a109735978c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:26:58.932578 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-18e723bc-c7f8-419c-b76d-3a109735978c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0085227 Dec 10 14:26:58.936401 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55398) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:58.937028 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c31d93f-443b-4b85-a39e-2a22efa5179b None None] Pushing event updated for resources: {'Port': ['ID=4581a382-f5c0-44b0-9484-1e4a7572ee50,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:58.957145 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-047a1bd0-bc94-4f43-b1b1-e28788fd207b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': 'f40b29b5-be5b-443a-8fcf-57dd7fbd76d7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:58.958238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Router f392bc21-f597-4d51-ad73-94752bd2ac24 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:26:58.958421 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-047a1bd0-bc94-4f43-b1b1-e28788fd207b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Dec 10 14:26:58.958421 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-047a1bd0-bc94-4f43-b1b1-e28788fd207b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:26:58.965897 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-047a1bd0-bc94-4f43-b1b1-e28788fd207b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0251689 Dec 10 14:26:58.968340 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55400) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:58.975521 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-5843ea6d-5cb2-406f-aa93-8292b5f3d5c7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': 'f40b29b5-be5b-443a-8fcf-57dd7fbd76d7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '256'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:58.977872 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-5843ea6d-5cb2-406f-aa93-8292b5f3d5c7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Dec 10 14:26:58.978386 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-5843ea6d-5cb2-406f-aa93-8292b5f3d5c7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:26:58.979396 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5843ea6d-5cb2-406f-aa93-8292b5f3d5c7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0095682 Dec 10 14:26:58.982537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55402) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.004127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-453eb2a2-a658-4aea-b1f7-749bfa53ede2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.053952 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccf485b4-b571-4d1b-a466-86d5e26c1070 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.059328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b5e133a-7eff-4b01-9580-8d5c83b9cfe5 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.059328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b5e133a-7eff-4b01-9580-8d5c83b9cfe5 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.103591 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.106309 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-453eb2a2-a658-4aea-b1f7-749bfa53ede2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.110030 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccf485b4-b571-4d1b-a466-86d5e26c1070 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.120009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.123530 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/networks/4bc931a4-473a-4336-8f47-eb1dee452621 HTTP/1.1" status: 204 len: 168 time: 1.3033495 Dec 10 14:26:59.137874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55404) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.161843 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ada31b-ab09-4ce6-a00b-ccea5fbd6d08 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Network': ['ID=4bc931a4-473a-4336-8f47-eb1dee452621,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:59.169974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-453eb2a2-a658-4aea-b1f7-749bfa53ede2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=048aab16-31ab-4d36-8b7a-26eadca70e69,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:59.203412 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b5e133a-7eff-4b01-9580-8d5c83b9cfe5 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.224903 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Allocated IP 2001:db8:1::2 (da18baf2-2036-4c07-8911-6bae9632cc69/095b94f4-22e7-4e8c-b916-8569ce0ad1d7/1b7281c6-bfe2-4fbf-9509-7ed35df38fec) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:26:59.254627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b5e133a-7eff-4b01-9580-8d5c83b9cfe5 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.269618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:26:59.283815 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a6dac5b-a0a2-42db-8d8c-d64f134b734a None None] Sync routers for ids ['f392bc21-f597-4d51-ad73-94752bd2ac24'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:26:59.288518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.294497 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.296268 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-471c3ce6-7d48-41d5-bfbe-f6c0f608e064 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "PUT /v2.0/routers/f392bc21-f597-4d51-ad73-94752bd2ac24 HTTP/1.1" status: 200 len: 883 time: 4.2549031 Dec 10 14:26:59.299886 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55406) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.314159 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6ba0d91a-1c0a-4864-814d-05bdbbe2688a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.318223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-453eb2a2-a658-4aea-b1f7-749bfa53ede2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.319581 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-453eb2a2-a658-4aea-b1f7-749bfa53ede2 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.1050518 Dec 10 14:26:59.327247 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55408) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.327486 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccf485b4-b571-4d1b-a466-86d5e26c1070 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.332720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccf485b4-b571-4d1b-a466-86d5e26c1070 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.333782 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ccf485b4-b571-4d1b-a466-86d5e26c1070 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/f40b29b5-be5b-443a-8fcf-57dd7fbd76d7 HTTP/1.1" status: 204 len: 168 time: 0.3499110 Dec 10 14:26:59.336558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b5e133a-7eff-4b01-9580-8d5c83b9cfe5 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.337148 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a6dac5b-a0a2-42db-8d8c-d64f134b734a None None] Routers {'f392bc21-f597-4d51-ad73-94752bd2ac24'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:59.337698 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1b5e133a-7eff-4b01-9580-8d5c83b9cfe5 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.5079956 Dec 10 14:26:59.338243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55410) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.338544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4a6dac5b-a0a2-42db-8d8c-d64f134b734a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['f392bc21-f597-4d51-ad73-94752bd2ac24'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:59.345462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55412) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.372684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6ba0d91a-1c0a-4864-814d-05bdbbe2688a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.387661 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4a6dac5b-a0a2-42db-8d8c-d64f134b734a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:59.406457 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a6dac5b-a0a2-42db-8d8c-d64f134b734a None None] Routers {'f392bc21-f597-4d51-ad73-94752bd2ac24'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:26:59.407093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4a6dac5b-a0a2-42db-8d8c-d64f134b734a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['f392bc21-f597-4d51-ad73-94752bd2ac24'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:59.419733 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6f1a1139-5943-46dc-a3a7-08341f1e08ab tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules/048aab16-31ab-4d36-8b7a-26eadca70e69 HTTP/1.1" status: 200 len: 763 time: 0.0930264 Dec 10 14:26:59.427891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55414) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.433830 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf485b4-b571-4d1b-a466-86d5e26c1070 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f40b29b5-be5b-443a-8fcf-57dd7fbd76d7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:59.477610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4a6dac5b-a0a2-42db-8d8c-d64f134b734a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:59.478208 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a6dac5b-a0a2-42db-8d8c-d64f134b734a None None] The sync data for ids ['f392bc21-f597-4d51-ad73-94752bd2ac24'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:26:59.496264 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.507978 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.567575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ba0d91a-1c0a-4864-814d-05bdbbe2688a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event updated for resources: {'Port': ['ID=4a0a5247-c579-483d-9b33-5a067151c7d7,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:59.578110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.604647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['26c2f5be-cb64-41a8-82a6-d606724194b4']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:59.616525 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6ba0d91a-1c0a-4864-814d-05bdbbe2688a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] In _notify_port_updated(), no bound segment for port 4a0a5247-c579-483d-9b33-5a067151c7d7 on network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 {{(pid=103811) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:26:59.622197 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b4c2eab6-cc73-417f-8459-f34ebf99654d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2744055 Dec 10 14:26:59.622197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b555f9f3-cdf8-45d9-8627-b2f6363a5a77') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:59.622197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b555f9f3-cdf8-45d9-8627-b2f6363a5a77') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:26:59.624410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55416) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.624976 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ba0d91a-1c0a-4864-814d-05bdbbe2688a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:59.625679 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6ba0d91a-1c0a-4864-814d-05bdbbe2688a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.629483 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6ba0d91a-1c0a-4864-814d-05bdbbe2688a tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "PUT /v2.0/ports/4a0a5247-c579-483d-9b33-5a067151c7d7 HTTP/1.1" status: 200 len: 1056 time: 1.7664740 Dec 10 14:26:59.641596 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-aba32aa0-caf6-43ca-9e27-603f7924be7a tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.2066808 Dec 10 14:26:59.641596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55418) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.642266 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a4f3262d-b9d4-4347-9c72-aaebab57f66e tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/routers/f392bc21-f597-4d51-ad73-94752bd2ac24 HTTP/1.1" status: 200 len: 924 time: 0.3381085 Dec 10 14:26:59.642830 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Network da18baf2-2036-4c07-8911-6bae9632cc69 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:26:59.648298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55420) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.649190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55422) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.653723 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:26:59.656334 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:26:59.659931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Pushing event updated for resources: {'Port': ['ID=1b7281c6-bfe2-4fbf-9509-7ed35df38fec,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:26:59.671889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b0ab9779-0647-4013-a16f-17da67eb4b15 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--1691481095'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:26:59.684827 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.736072 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.744045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Attempting to bind port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:26:59.744707 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Attempting to bind port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '2d65ed04-f305-436f-85c3-d65e7a13667a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'da18baf2-2036-4c07-8911-6bae9632cc69'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:26:59.745185 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Attempting to bind port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec on network da18baf2-2036-4c07-8911-6bae9632cc69 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:26:59.753036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 26, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:26:59.754360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Checking segment: {'id': '2d65ed04-f305-436f-85c3-d65e7a13667a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'da18baf2-2036-4c07-8911-6bae9632cc69'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:26:59.755062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.755735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Bound using segment: {'id': '2d65ed04-f305-436f-85c3-d65e7a13667a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'da18baf2-2036-4c07-8911-6bae9632cc69'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:26:59.761856 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Bound port: 1b7281c6-bfe2-4fbf-9509-7ed35df38fec, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2d65ed04-f305-436f-85c3-d65e7a13667a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'da18baf2-2036-4c07-8911-6bae9632cc69'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:26:59.763268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.767810 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Releasing vlan 364 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:26:59.768443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:26:59.774012 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:26:59.781961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bf10c7de-10ea-471f-ac95-979f6b51d6af tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.795331 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bf10c7de-10ea-471f-ac95-979f6b51d6af tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.812068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-397ac604-863a-4f18-9ca7-858a36bb60c6 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:26:59.813728 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-397ac604-863a-4f18-9ca7-858a36bb60c6 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=f392bc21-f597-4d51-ad73-94752bd2ac24&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1624627 Dec 10 14:26:59.820309 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55424) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:26:59.832607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b0ab9779-0647-4013-a16f-17da67eb4b15 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.886060 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.887537 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] For port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:26:59.891757 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0e5463de-b3ed-4612-88ee-82b6904763cd None None] Provisioning complete for port 4a0a5247-c579-483d-9b33-5a067151c7d7 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:26:59.892085 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e5463de-b3ed-4612-88ee-82b6904763cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.907066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-247b7eeb-456e-45fc-baac-dcedb61f73e1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Deleting port 4a0a5247-c579-483d-9b33-5a067151c7d7 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:26:59.907492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-247b7eeb-456e-45fc-baac-dcedb61f73e1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.931308 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] For port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1b7281c6-bfe2-4fbf-9509-7ed35df38fec,segment=NetworkSegment(2d65ed04-f305-436f-85c3-d65e7a13667a),segment_id=2d65ed04-f305-436f-85c3-d65e7a13667a)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:26:59.948864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0e5463de-b3ed-4612-88ee-82b6904763cd None None] Port 4a0a5247-c579-483d-9b33-5a067151c7d7 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:26:59.982570 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.989149 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bf10c7de-10ea-471f-ac95-979f6b51d6af tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.994097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bf10c7de-10ea-471f-ac95-979f6b51d6af tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:26:59.998373 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bf10c7de-10ea-471f-ac95-979f6b51d6af tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/048aab16-31ab-4d36-8b7a-26eadca70e69 HTTP/1.1" status: 204 len: 168 time: 0.3451357 Dec 10 14:27:00.001747 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55426) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:00.028547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.029278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.032263 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/networks/26c2f5be-cb64-41a8-82a6-d606724194b4 HTTP/1.1" status: 204 len: 168 time: 0.8933878 Dec 10 14:27:00.042127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55428) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:00.046414 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf10c7de-10ea-471f-ac95-979f6b51d6af tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=048aab16-31ab-4d36-8b7a-26eadca70e69,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:00.057499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56232466-c482-4ef6-ac0b-a124d7dcfb9a tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:00.060116 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-56232466-c482-4ef6-ac0b-a124d7dcfb9a tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 881 time: 0.2363937 Dec 10 14:27:00.069171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55430) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:00.084053 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-247b7eeb-456e-45fc-baac-dcedb61f73e1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.115303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-978f756c-9fdc-43fc-baea-f59e0d0a72f9 None None] Pushing event updated for resources: {'Port': ['ID=1b7281c6-bfe2-4fbf-9509-7ed35df38fec,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:00.133279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d411e4-c475-4d5e-b643-7b81b6b10202 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Network': ['ID=26c2f5be-cb64-41a8-82a6-d606724194b4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:00.145567 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c9f24b29-5c15-4645-a8a0-f3717f08c9dd tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=f392bc21-f597-4d51-ad73-94752bd2ac24 HTTP/1.1" status: 200 len: 205 time: 0.0654056 Dec 10 14:27:00.149747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55432) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:00.159582 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2f6692d8-bcdb-4ea3-bd57-06ff27256d91 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1513684 Dec 10 14:27:00.160974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-247b7eeb-456e-45fc-baac-dcedb61f73e1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Calling delete_port for 4a0a5247-c579-483d-9b33-5a067151c7d7 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:00.163081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55434) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:00.170708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-93aba2ce-6fbc-4fe3-9ad0-1fbaf889b31e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': '068c78e0-73cc-4fc1-b13c-3c0f804b3d69', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:00.318646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fef00682-5deb-44b7-9ba3-70401cd71293 None None] Network 974a50ab-ab5c-449b-b2d5-182064cd08ee requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:00.338441 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.379601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-93aba2ce-6fbc-4fe3-9ad0-1fbaf889b31e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.385202 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b0ab9779-0647-4013-a16f-17da67eb4b15 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.418791 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.438270 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-a92ad5bc-21d1-4c35-84c7-68fd0922c7c1 None None] Provisioning complete for port 4581a382-f5c0-44b0-9484-1e4a7572ee50 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:00.438645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a92ad5bc-21d1-4c35-84c7-68fd0922c7c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.481072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-247b7eeb-456e-45fc-baac-dcedb61f73e1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.485124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-93aba2ce-6fbc-4fe3-9ad0-1fbaf889b31e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.496503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b0ab9779-0647-4013-a16f-17da67eb4b15 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.525661 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-247b7eeb-456e-45fc-baac-dcedb61f73e1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event deleted for resources: {'Port': ['ID=4a0a5247-c579-483d-9b33-5a067151c7d7,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:00.586724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-93aba2ce-6fbc-4fe3-9ad0-1fbaf889b31e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.638659 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93aba2ce-6fbc-4fe3-9ad0-1fbaf889b31e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9836d825-fe2c-46fd-b84e-c4e8223755bb,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:00.662541 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a92ad5bc-21d1-4c35-84c7-68fd0922c7c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.728801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.740653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a92ad5bc-21d1-4c35-84c7-68fd0922c7c1 None None] For port 4581a382-f5c0-44b0-9484-1e4a7572ee50, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=4581a382-f5c0-44b0-9484-1e4a7572ee50,segment=NetworkSegment(d4c98e4f-31a7-4749-9370-604db6aa94b9),segment_id=d4c98e4f-31a7-4749-9370-604db6aa94b9)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:00.753281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7f359b16-f43f-42d5-add5-01d2cda3e391']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:00.764749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7056d828-c15e-4eff-a7e6-17ba9fc8e4bd') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:00.765275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7056d828-c15e-4eff-a7e6-17ba9fc8e4bd') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:00.777443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.794338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.795037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4581a382-f5c0-44b0-9484-1e4a7572ee50 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:00.801881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-93aba2ce-6fbc-4fe3-9ad0-1fbaf889b31e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.805656 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-93aba2ce-6fbc-4fe3-9ad0-1fbaf889b31e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6391189 Dec 10 14:27:00.806788 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55436) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:00.808575 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b0ab9779-0647-4013-a16f-17da67eb4b15 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.817361 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b0ab9779-0647-4013-a16f-17da67eb4b15 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 1.1887634 Dec 10 14:27:00.825878 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Releasing vlan 391 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:00.826570 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.836706 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55438) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:00.838424 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0ab9779-0647-4013-a16f-17da67eb4b15 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=896defff-c430-4cff-ae78-fb9e7200f440,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:00.840982 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:00.857229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-baaa8390-253b-412e-9d35-c5f78124c35c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '896defff-c430-4cff-ae78-fb9e7200f440', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:00.858144 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-baaa8390-253b-412e-9d35-c5f78124c35c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 10 14:27:00.859948 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-baaa8390-253b-412e-9d35-c5f78124c35c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:00.863785 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-baaa8390-253b-412e-9d35-c5f78124c35c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0210578 Dec 10 14:27:00.867127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a92ad5bc-21d1-4c35-84c7-68fd0922c7c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.870316 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55440) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:00.875987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b14568c8-a830-4d7b-ab40-cee2cff7cbde tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '896defff-c430-4cff-ae78-fb9e7200f440', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:00.914122 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-56cc9f1c-75c1-44ca-8f8d-21981cdd4bca tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules/9836d825-fe2c-46fd-b84e-c4e8223755bb HTTP/1.1" status: 200 len: 763 time: 0.1012378 Dec 10 14:27:00.917321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55442) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:00.967459 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92ad5bc-21d1-4c35-84c7-68fd0922c7c1 None None] Pushing event updated for resources: {'Port': ['ID=4581a382-f5c0-44b0-9484-1e4a7572ee50,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:00.991210 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0ce18cfb-d545-42ce-92e5-d70b1511db44 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0697391 Dec 10 14:27:00.991850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-247b7eeb-456e-45fc-baac-dcedb61f73e1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:00.996824 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-247b7eeb-456e-45fc-baac-dcedb61f73e1 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "DELETE /v2.0/ports/4a0a5247-c579-483d-9b33-5a067151c7d7 HTTP/1.1" status: 204 len: 168 time: 1.3567641 Dec 10 14:27:00.997498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55444) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.003102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 4581a382-f5c0-44b0-9484-1e4a7572ee50 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:01.003652 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.013527 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55446) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.054025 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f460b4d-0f3f-4a7e-9957-56b4478d2d2f tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] GET failed (client error): The resource could not be found. Dec 10 14:27:01.055623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-13a73dbe-a512-48a5-b2d6-55d14ed8b1d2 None None] Provisioning complete for port 4581a382-f5c0-44b0-9484-1e4a7572ee50 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:01.056415 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5f460b4d-0f3f-4a7e-9957-56b4478d2d2f tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "GET /v2.0/ports/4a0a5247-c579-483d-9b33-5a067151c7d7 HTTP/1.1" status: 404 len: 333 time: 0.0385780 Dec 10 14:27:01.057743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4cd9ffdd-c03a-4cfc-ab96-3766ba60f4be tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.059600 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-13a73dbe-a512-48a5-b2d6-55d14ed8b1d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.067406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4cd9ffdd-c03a-4cfc-ab96-3766ba60f4be tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.094846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55448) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.105576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.172724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4cd9ffdd-c03a-4cfc-ab96-3766ba60f4be tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.179068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4cd9ffdd-c03a-4cfc-ab96-3766ba60f4be tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.180832 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4cd9ffdd-c03a-4cfc-ab96-3766ba60f4be tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/9836d825-fe2c-46fd-b84e-c4e8223755bb HTTP/1.1" status: 204 len: 168 time: 0.1823878 Dec 10 14:27:01.192955 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55450) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.194140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cd9ffdd-c03a-4cfc-ab96-3766ba60f4be tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9836d825-fe2c-46fd-b84e-c4e8223755bb,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:01.198764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1b7281c6-bfe2-4fbf-9509-7ed35df38fec up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:01.237254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 2001:db8::1 (974a50ab-ab5c-449b-b2d5-182064cd08ee/b4a4ac9a-ad53-4dee-8792-1cd9c66ab275/c02f5295-cc2e-4620-8166-844fb3e72fdc) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:01.241485 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-8c30601b-5918-4456-b2ee-c4ed0a64e9d0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Deleting port 225eaa37-bb79-4860-aa3f-8433aeee1697 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:01.242340 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c30601b-5918-4456-b2ee-c4ed0a64e9d0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.275009 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:01.275741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.281863 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-aa973cf2-2138-4ed1-abbd-657ce4b78d53 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0835018 Dec 10 14:27:01.286397 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55452) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.292508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-cd92ae92-d732-4221-b532-0203c63b7f23 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': '068c78e0-73cc-4fc1-b13c-3c0f804b3d69', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:01.295067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.372656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.379214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.385218 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] 10.222.0.57 "DELETE /v2.0/networks/7f359b16-f43f-42d5-add5-01d2cda3e391 HTTP/1.1" status: 204 len: 168 time: 1.3213573 Dec 10 14:27:01.389659 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.402060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c30601b-5918-4456-b2ee-c4ed0a64e9d0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.416090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33c7e491-e5b5-490e-9030-b159dff1eec6 tempest-BulkNetworkOpsIpV6Test-487011748 tempest-BulkNetworkOpsIpV6Test-487011748-project] Pushing event deleted for resources: {'Network': ['ID=7f359b16-f43f-42d5-add5-01d2cda3e391,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:01.425957 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-8c30601b-5918-4456-b2ee-c4ed0a64e9d0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Calling delete_port for 225eaa37-bb79-4860-aa3f-8433aeee1697 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:01.464668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fdbc45d-8bca-4f53-9292-c28c1302b39c None None] Network da18baf2-2036-4c07-8911-6bae9632cc69 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:01.486811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1b7281c6-bfe2-4fbf-9509-7ed35df38fec,segment=NetworkSegment(2d65ed04-f305-436f-85c3-d65e7a13667a),segment_id=2d65ed04-f305-436f-85c3-d65e7a13667a)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:01.511610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.514813 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.securitygroups_db [None req-cd92ae92-d732-4221-b532-0203c63b7f23 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Project d2317e4253f846d8a16d312773f264e1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:27:01.522295 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cd92ae92-d732-4221-b532-0203c63b7f23 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.546863 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Deleting port 70806e6a-039c-4324-a277-89f398ae7255 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:01.547212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.568380 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.583752 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b547d70b-73d1-4934-beec-bd3e9ebfb0cb None None] Provisioning complete for port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:01.584128 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b547d70b-73d1-4934-beec-bd3e9ebfb0cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.606332 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-b14568c8-a830-4d7b-ab40-cee2cff7cbde tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:01.611842 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b14568c8-a830-4d7b-ab40-cee2cff7cbde tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.7358134 Dec 10 14:27:01.612020 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55456) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.615846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-46c254d6-7656-4215-a831-2111c70a7182 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '896defff-c430-4cff-ae78-fb9e7200f440', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:01.616422 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-46c254d6-7656-4215-a831-2111c70a7182 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Dec 10 14:27:01.621566 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-46c254d6-7656-4215-a831-2111c70a7182 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:01.621566 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-46c254d6-7656-4215-a831-2111c70a7182 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0065243 Dec 10 14:27:01.622364 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55458) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.632674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cd92ae92-d732-4221-b532-0203c63b7f23 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.635137 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2f017016-9ba6-4db6-a764-4817e81d9c9f tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '896defff-c430-4cff-ae78-fb9e7200f440', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:01.660650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.683498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Calling delete_port for 70806e6a-039c-4324-a277-89f398ae7255 owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:01.689290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=1b7281c6-bfe2-4fbf-9509-7ed35df38fec,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:01.703187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c30601b-5918-4456-b2ee-c4ed0a64e9d0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.705003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cd92ae92-d732-4221-b532-0203c63b7f23 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.735486 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.765021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd92ae92-d732-4221-b532-0203c63b7f23 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aafd1e72-5f1e-46dd-87bb-0e4bc3406573,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:01.778279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c30601b-5918-4456-b2ee-c4ed0a64e9d0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event deleted for resources: {'Port': ['ID=225eaa37-bb79-4860-aa3f-8433aeee1697,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:01.792520 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=c02f5295-cc2e-4620-8166-844fb3e72fdc,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:01.846211 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 974a50ab-ab5c-449b-b2d5-182064cd08ee is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:01.850235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:01.853411 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:01.854218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.882176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cd92ae92-d732-4221-b532-0203c63b7f23 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.885969 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cd92ae92-d732-4221-b532-0203c63b7f23 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5985241 Dec 10 14:27:01.886834 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55460) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.928389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c30601b-5918-4456-b2ee-c4ed0a64e9d0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:01.935339 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8c30601b-5918-4456-b2ee-c4ed0a64e9d0 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "DELETE /v2.0/ports/225eaa37-bb79-4860-aa3f-8433aeee1697 HTTP/1.1" status: 204 len: 168 time: 0.8367612 Dec 10 14:27:01.936445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55464) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.939270 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-35a7e827-56fb-467f-8de3-230b3cbcdd8a tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules/aafd1e72-5f1e-46dd-87bb-0e4bc3406573 HTTP/1.1" status: 200 len: 769 time: 0.0460660 Dec 10 14:27:01.939847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55466) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:01.968599 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-3ae6a53c-e88d-46d5-a64d-eef7a48264b3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] GET failed (client error): The resource could not be found. Dec 10 14:27:01.973365 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3ae6a53c-e88d-46d5-a64d-eef7a48264b3 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "GET /v2.0/ports/225eaa37-bb79-4860-aa3f-8433aeee1697 HTTP/1.1" status: 404 len: 333 time: 0.0312405 Dec 10 14:27:01.990708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55468) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.000637 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-2f017016-9ba6-4db6-a764-4817e81d9c9f tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:02.004842 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2f017016-9ba6-4db6-a764-4817e81d9c9f tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.3709557 Dec 10 14:27:02.006890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55470) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.013124 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-450b0197-e5bb-45fa-8291-dbc25a775eb3 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '896defff-c430-4cff-ae78-fb9e7200f440', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:02.013835 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-450b0197-e5bb-45fa-8291-dbc25a775eb3 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 10 14:27:02.014307 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-450b0197-e5bb-45fa-8291-dbc25a775eb3 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:02.024423 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-450b0197-e5bb-45fa-8291-dbc25a775eb3 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0058935 Dec 10 14:27:02.024423 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55472) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.024890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5c2f92d8-764c-4434-b28f-8825f39392a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '896defff-c430-4cff-ae78-fb9e7200f440', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:02.074107 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-06a9478c-e618-46b2-bbaa-34302a2ce109 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4119 time: 0.1299288 Dec 10 14:27:02.075178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55474) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.122111 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55476) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.125169 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b53fc82b-2e0c-428f-9cc7-2fad6f0da111 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.162901 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-5c2f92d8-764c-4434-b28f-8825f39392a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Project 49ab6b2508e14f10a31682c2abcd0dc3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:27:02.178831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.182074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.188139 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b53fc82b-2e0c-428f-9cc7-2fad6f0da111 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.209234 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0dc56460-599c-41db-9b17-387be4ea1a08 None None] Provisioning complete for port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:02.210029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0dc56460-599c-41db-9b17-387be4ea1a08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.220725 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event deleted for resources: {'Port': ['ID=70806e6a-039c-4324-a277-89f398ae7255,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:02.256288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Deleting port 29eaa4b9-4a9e-4745-9066-c749bfa6fecd {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:02.257239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.279186 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acdaa638-80c2-4ec4-9f49-162d7ae4724a None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:02.293633 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-5c2f92d8-764c-4434-b28f-8825f39392a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:02.294692 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5c2f92d8-764c-4434-b28f-8825f39392a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2737942 Dec 10 14:27:02.313709 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55480) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.318269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-46ab9dcd-2a1b-4a55-b88d-fcfeb7d23c4c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '896defff-c430-4cff-ae78-fb9e7200f440', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:02.319374 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-46ab9dcd-2a1b-4a55-b88d-fcfeb7d23c4c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Dec 10 14:27:02.321991 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-46ab9dcd-2a1b-4a55-b88d-fcfeb7d23c4c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:02.321991 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-46ab9dcd-2a1b-4a55-b88d-fcfeb7d23c4c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0062068 Dec 10 14:27:02.323824 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55482) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.333105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0dd5669d-f7f2-4f89-aaf0-65ffc8ce74bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '896defff-c430-4cff-ae78-fb9e7200f440', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:02.334102 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b53fc82b-2e0c-428f-9cc7-2fad6f0da111 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.346621 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b53fc82b-2e0c-428f-9cc7-2fad6f0da111 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.348570 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b53fc82b-2e0c-428f-9cc7-2fad6f0da111 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/aafd1e72-5f1e-46dd-87bb-0e4bc3406573 HTTP/1.1" status: 204 len: 168 time: 0.2723565 Dec 10 14:27:02.353593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55484) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.370449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b53fc82b-2e0c-428f-9cc7-2fad6f0da111 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=aafd1e72-5f1e-46dd-87bb-0e4bc3406573,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:02.422737 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.444323 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7619f177-2e83-47d4-b975-e2163fc1ce48 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0822151 Dec 10 14:27:02.444323 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55486) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.463185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Calling delete_port for 29eaa4b9-4a9e-4745-9066-c749bfa6fecd owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:02.464539 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.494051 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3eee14fb-e32a-4b7e-8aa9-acb6c54a152a None None] Provisioning complete for port c02f5295-cc2e-4620-8166-844fb3e72fdc triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:02.495585 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3eee14fb-e32a-4b7e-8aa9-acb6c54a152a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.539725 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ae135ef3-9481-4261-af0b-66bd0025d901 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=21f59c1b1be143f4a57bfe84466b4c08&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4130862 Dec 10 14:27:02.544431 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55488) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.564598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3eee14fb-e32a-4b7e-8aa9-acb6c54a152a None None] Port c02f5295-cc2e-4620-8166-844fb3e72fdc cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:02.574728 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.575452 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-0dd5669d-f7f2-4f89-aaf0-65ffc8ce74bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Project 49ab6b2508e14f10a31682c2abcd0dc3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:27:02.584136 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.591653 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.634302 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.643466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4581a382-f5c0-44b0-9484-1e4a7572ee50 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:02.680635 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-0dd5669d-f7f2-4f89-aaf0-65ffc8ce74bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:02.684204 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0dd5669d-f7f2-4f89-aaf0-65ffc8ce74bf tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.3568957 Dec 10 14:27:02.684848 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55490) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.693878 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a307d146-2f39-4310-a67d-26e0f634f72c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '896defff-c430-4cff-ae78-fb9e7200f440', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:02.699468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0501ea23-d120-40d8-9785-4dd93d2b2014 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.704359 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 4581a382-f5c0-44b0-9484-1e4a7572ee50 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:02.704907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.742308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0501ea23-d120-40d8-9785-4dd93d2b2014 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.757369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.757369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Fanout notify agent at l3_agent the message router_deleted on router f392bc21-f597-4d51-ad73-94752bd2ac24 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:27:02.764627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.769494 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6d306d11-bed8-4a3f-b3e3-6a602fed1ace tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/f392bc21-f597-4d51-ad73-94752bd2ac24 HTTP/1.1" status: 204 len: 168 time: 2.6112244 Dec 10 14:27:02.769971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55492) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.774758 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1ba1b109-a60b-4726-a06b-cbe8aa318b52 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1970552530', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:02.796917 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.804771 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1b7281c6-bfe2-4fbf-9509-7ed35df38fec up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:02.807382 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-a307d146-2f39-4310-a67d-26e0f634f72c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Project 49ab6b2508e14f10a31682c2abcd0dc3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:27:02.840279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.843088 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.844272 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/068c78e0-73cc-4fc1-b13c-3c0f804b3d69 HTTP/1.1" status: 204 len: 168 time: 0.3990901 Dec 10 14:27:02.847209 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55494) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.848139 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.858827 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:02.859415 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.882331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-46f4ff5d-da7c-4e2c-b180-d14968667a59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.885847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0501ea23-d120-40d8-9785-4dd93d2b2014 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.887511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0501ea23-d120-40d8-9785-4dd93d2b2014 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.888671 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0501ea23-d120-40d8-9785-4dd93d2b2014 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/061475b6-6995-407e-8a88-a1232905b5e2 HTTP/1.1" status: 204 len: 168 time: 0.3420131 Dec 10 14:27:02.891579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event deleted for resources: {'Port': ['ID=29eaa4b9-4a9e-4745-9066-c749bfa6fecd,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:02.893804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=068c78e0-73cc-4fc1-b13c-3c0f804b3d69,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:02.918526 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.925695 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.926756 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-28a993d7-072d-4364-93d6-537f7c0e1b5c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0708098 Dec 10 14:27:02.926850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.926850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.926850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.926850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.926850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.926850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.927261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.927354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.927354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.927354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.927568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.927652 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.927652 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16f88e59-4432-49aa-91d2-b35dae31fb0e tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.927805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55498) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:02.932865 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.933205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.933702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.934135 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.934503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.934837 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.935203 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.935479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.935878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.936222 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.936477 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.936948 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.937306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:02.949022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ba1b109-a60b-4726-a06b-cbe8aa318b52 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.949022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ba1b109-a60b-4726-a06b-cbe8aa318b52 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:02.962837 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-bebe557e-ae16-4c58-8142-d24bfeeea10c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group': {'name': 'tempest-secgroup--35471150'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:02.970518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0501ea23-d120-40d8-9785-4dd93d2b2014 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=061475b6-6995-407e-8a88-a1232905b5e2,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:03.034836 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.036771 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-a307d146-2f39-4310-a67d-26e0f634f72c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:03.039805 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-714880d9-6de3-4583-a31d-a07548690b74 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "DELETE /v2.0/ports/29eaa4b9-4a9e-4745-9066-c749bfa6fecd HTTP/1.1" status: 204 len: 168 time: 1.0479250 Dec 10 14:27:03.040938 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55500) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:03.041150 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a307d146-2f39-4310-a67d-26e0f634f72c tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.3533642 Dec 10 14:27:03.049399 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55502) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:03.111476 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=c02f5295-cc2e-4620-8166-844fb3e72fdc,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:03.124369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-322e7763-51e1-49b0-b289-694a76ddfe57 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Deleting subnet 6fb5370c-8342-469c-9924-bdb358134f2c {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:27:03.131055 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-322e7763-51e1-49b0-b289-694a76ddfe57 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.158552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ba1b109-a60b-4726-a06b-cbe8aa318b52 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.160299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bebe557e-ae16-4c58-8142-d24bfeeea10c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.174884 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a46aa-9ea5-4dd4-8940-144c1c023723 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.197108 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-322e7763-51e1-49b0-b289-694a76ddfe57 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.213881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ba1b109-a60b-4726-a06b-cbe8aa318b52 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.232084 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a46aa-9ea5-4dd4-8940-144c1c023723 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.246077 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 974a50ab-ab5c-449b-b2d5-182064cd08ee is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:03.250555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:03.323153 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-322e7763-51e1-49b0-b289-694a76ddfe57 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.323363 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bebe557e-ae16-4c58-8142-d24bfeeea10c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.373811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ba1b109-a60b-4726-a06b-cbe8aa318b52 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.373811 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1ba1b109-a60b-4726-a06b-cbe8aa318b52 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5998776 Dec 10 14:27:03.373811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55506) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:03.379498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': True}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:03.383227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a46aa-9ea5-4dd4-8940-144c1c023723 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.385914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a46aa-9ea5-4dd4-8940-144c1c023723 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.389593 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ac7a46aa-9ea5-4dd4-8940-144c1c023723 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/896defff-c430-4cff-ae78-fb9e7200f440 HTTP/1.1" status: 204 len: 168 time: 0.3451934 Dec 10 14:27:03.393356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55510) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:03.417602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7a46aa-9ea5-4dd4-8940-144c1c023723 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=896defff-c430-4cff-ae78-fb9e7200f440,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:03.475456 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-587ca4ad-dff3-45a0-af7a-e1aaa3079491 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0809603 Dec 10 14:27:03.481354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55514) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:03.481797 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bebe557e-ae16-4c58-8142-d24bfeeea10c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.486734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-86e67cfa-e5ab-40b9-918d-84193e0088a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--1425598866'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:03.500424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-322e7763-51e1-49b0-b289-694a76ddfe57 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.545791 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322e7763-51e1-49b0-b289-694a76ddfe57 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event deleted for resources: {'Subnet': ['ID=6fb5370c-8342-469c-9924-bdb358134f2c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:03.552243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-322e7763-51e1-49b0-b289-694a76ddfe57 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.555401 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-765b34fc-c6cc-4514-84c4-ded376651db3 None None] Network 9740484b-2f0c-4ec8-b8a4-2516743e88b3 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:03.556588 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-322e7763-51e1-49b0-b289-694a76ddfe57 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "DELETE /v2.0/subnets/6fb5370c-8342-469c-9924-bdb358134f2c HTTP/1.1" status: 204 len: 168 time: 0.5069492 Dec 10 14:27:03.559866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55518) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:03.631277 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8b501496-a448-44a2-a230-b3c0783076be None None] Provisioning complete for port c02f5295-cc2e-4620-8166-844fb3e72fdc triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:03.631585 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8b501496-a448-44a2-a230-b3c0783076be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.653389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.667923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bebe557e-ae16-4c58-8142-d24bfeeea10c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=257726a4-7f5c-4d44-b7f3-71b1faf9fbaf,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:03.668510 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-86e67cfa-e5ab-40b9-918d-84193e0088a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.706344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8b501496-a448-44a2-a230-b3c0783076be None None] Port c02f5295-cc2e-4620-8166-844fb3e72fdc cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:03.713985 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.752121 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bebe557e-ae16-4c58-8142-d24bfeeea10c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.756892 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bebe557e-ae16-4c58-8142-d24bfeeea10c tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.8042996 Dec 10 14:27:03.760194 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55522) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:03.769875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-83b86c33-d64c-4230-8cf8-83f47a6336f3 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Request body: {'security_group_rule': {'security_group_id': '257726a4-7f5c-4d44-b7f3-71b1faf9fbaf', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:03.786453 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 52009993-772b-48ae-81fe-d159369269c5 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:27:03.794493 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Deleting port 3942045b-a9d6-4a71-a419-5e9d3e04b72a {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:03.794841 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.801170 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7914ab14-2271-4b8e-8b13-7ec6ee2848e2 None None] DHCP port deletion for 9740484b-2f0c-4ec8-b8a4-2516743e88b3 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:03.858226 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7914ab14-2271-4b8e-8b13-7ec6ee2848e2 None None] Deleting port 3942045b-a9d6-4a71-a419-5e9d3e04b72a {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:03.859049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7914ab14-2271-4b8e-8b13-7ec6ee2848e2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.872193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-86e67cfa-e5ab-40b9-918d-84193e0088a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.891110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] For port 3942045b-a9d6-4a71-a419-5e9d3e04b72a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3942045b-a9d6-4a71-a419-5e9d3e04b72a,segment=NetworkSegment(16e64123-5fe0-41d3-b895-16b2f9a10070),segment_id=16e64123-5fe0-41d3-b895-16b2f9a10070)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:03.891738 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.910934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Calling delete_port for 3942045b-a9d6-4a71-a419-5e9d3e04b72a owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:03.913064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83b86c33-d64c-4230-8cf8-83f47a6336f3 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.933964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-86e67cfa-e5ab-40b9-918d-84193e0088a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.937014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:03.944170 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bc4a3f34-71f8-4a87-afd9-3532df72e397 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/52009993-772b-48ae-81fe-d159369269c5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5869415 Dec 10 14:27:03.945495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55528) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:03.950562 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b417a36-6f83-4fe0-8bcf-e7516b6f5221 None None] Sync routers for ids ['52009993-772b-48ae-81fe-d159369269c5'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:03.962755 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7914ab14-2271-4b8e-8b13-7ec6ee2848e2 None None] For port 3942045b-a9d6-4a71-a419-5e9d3e04b72a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3942045b-a9d6-4a71-a419-5e9d3e04b72a,segment=NetworkSegment(16e64123-5fe0-41d3-b895-16b2f9a10070),segment_id=16e64123-5fe0-41d3-b895-16b2f9a10070)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:03.965016 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7914ab14-2271-4b8e-8b13-7ec6ee2848e2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:03.967446 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b417a36-6f83-4fe0-8bcf-e7516b6f5221 None None] Routers {'52009993-772b-48ae-81fe-d159369269c5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:03.969985 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-9b417a36-6f83-4fe0-8bcf-e7516b6f5221 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['52009993-772b-48ae-81fe-d159369269c5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:03.985464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7914ab14-2271-4b8e-8b13-7ec6ee2848e2 None None] Calling delete_port for 3942045b-a9d6-4a71-a419-5e9d3e04b72a owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:04.000793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-984490a7-6fa7-4e8c-adcb-69c9d04b4a64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:04.002440 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-984490a7-6fa7-4e8c-adcb-69c9d04b4a64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports/c02f5295-cc2e-4620-8166-844fb3e72fdc HTTP/1.1" status: 200 len: 911 time: 0.0562675 Dec 10 14:27:04.006088 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55532) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:04.040899 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e67cfa-e5ab-40b9-918d-84193e0088a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d8db50af-4e1d-4b79-b8e5-6793f87ed37b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:04.071308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83b86c33-d64c-4230-8cf8-83f47a6336f3 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.080571 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-9b417a36-6f83-4fe0-8bcf-e7516b6f5221 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:04.090057 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b417a36-6f83-4fe0-8bcf-e7516b6f5221 None None] Routers {'52009993-772b-48ae-81fe-d159369269c5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:04.090789 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-9b417a36-6f83-4fe0-8bcf-e7516b6f5221 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:26:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['52009993-772b-48ae-81fe-d159369269c5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:04.102311 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-86e67cfa-e5ab-40b9-918d-84193e0088a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.103723 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-86e67cfa-e5ab-40b9-918d-84193e0088a2 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6211629 Dec 10 14:27:04.107195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55534) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:04.113677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c64c8c1c-069e-406d-b83a-946a1a6a3786 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': 'd8db50af-4e1d-4b79-b8e5-6793f87ed37b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'bad_group_id'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:04.166452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83b86c33-d64c-4230-8cf8-83f47a6336f3 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.192457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.192768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7914ab14-2271-4b8e-8b13-7ec6ee2848e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.235251 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83b86c33-d64c-4230-8cf8-83f47a6336f3 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5a398419-c625-4b89-8e94-39bc018f318d,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:04.244550 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-9b417a36-6f83-4fe0-8bcf-e7516b6f5221 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:04.245659 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b417a36-6f83-4fe0-8bcf-e7516b6f5221 None None] The sync data for ids ['52009993-772b-48ae-81fe-d159369269c5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:04.247383 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event deleted for resources: {'Port': ['ID=3942045b-a9d6-4a71-a419-5e9d3e04b72a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:04.257385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] No DVR routers for this DVR port 3942045b-a9d6-4a71-a419-5e9d3e04b72a on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:04.269594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7914ab14-2271-4b8e-8b13-7ec6ee2848e2 None None] Pushing event deleted for resources: {'Port': ['ID=3942045b-a9d6-4a71-a419-5e9d3e04b72a,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:04.285753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7914ab14-2271-4b8e-8b13-7ec6ee2848e2 None None] No DVR routers for this DVR port 3942045b-a9d6-4a71-a419-5e9d3e04b72a on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:04.350302 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83b86c33-d64c-4230-8cf8-83f47a6336f3 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.354802 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-83b86c33-d64c-4230-8cf8-83f47a6336f3 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5903742 Dec 10 14:27:04.359228 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55538) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:04.378658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.387555 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55540) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:04.401948 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-c64c8c1c-069e-406d-b83a-946a1a6a3786 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The resource could not be found. Dec 10 14:27:04.402987 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c64c8c1c-069e-406d-b83a-946a1a6a3786 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.2947359 Dec 10 14:27:04.414520 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55544) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:04.426838 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1af6be13-5c42-4bd1-bba3-daa16746a7e3 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': 'd8db50af-4e1d-4b79-b8e5-6793f87ed37b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': '95e48574-f32e-4a4a-ba4d-06e04b01e79c'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:04.433577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9740484b-2f0c-4ec8-b8a4-2516743e88b3']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:04.455468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '16e64123-5fe0-41d3-b895-16b2f9a10070') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:04.455771 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '16e64123-5fe0-41d3-b895-16b2f9a10070') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:04.475515 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.500309 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-369d6869-5f33-4cfd-9394-ed95a6188dcd tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.505823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.518656 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-test-network-1102143792'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:04.534567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Releasing vlan 384 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:04.534962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:04.538156 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:04.557003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-369d6869-5f33-4cfd-9394-ed95a6188dcd tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.581449 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.604503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.626742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3942045b-a9d6-4a71-a419-5e9d3e04b72a no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:04.648837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 3942045b-a9d6-4a71-a419-5e9d3e04b72a {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:27:04.649546 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3942045b-a9d6-4a71-a419-5e9d3e04b72a not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:27:04.686424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:04.690023 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.698937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.744274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-369d6869-5f33-4cfd-9394-ed95a6188dcd tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.746934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-369d6869-5f33-4cfd-9394-ed95a6188dcd tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.748107 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-369d6869-5f33-4cfd-9394-ed95a6188dcd tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/257726a4-7f5c-4d44-b7f3-71b1faf9fbaf HTTP/1.1" status: 204 len: 168 time: 0.3878958 Dec 10 14:27:04.753937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.755372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55546) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:04.778307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.781461 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] 10.222.0.57 "DELETE /v2.0/networks/9740484b-2f0c-4ec8-b8a4-2516743e88b3 HTTP/1.1" status: 204 len: 168 time: 1.2202175 Dec 10 14:27:04.805926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-369d6869-5f33-4cfd-9394-ed95a6188dcd tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=257726a4-7f5c-4d44-b7f3-71b1faf9fbaf,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:04.812709 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6b27fc-5de2-460d-9abe-a159db1b4c32 tempest-AllowedAddressPairTestJSON-1595395763 tempest-AllowedAddressPairTestJSON-1595395763-project] Pushing event deleted for resources: {'Network': ['ID=9740484b-2f0c-4ec8-b8a4-2516743e88b3,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:04.814369 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-1af6be13-5c42-4bd1-bba3-daa16746a7e3 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The resource could not be found. Dec 10 14:27:04.815437 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1af6be13-5c42-4bd1-bba3-daa16746a7e3 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.3999252 Dec 10 14:27:04.820274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55550) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:04.846024 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Allocated IP 172.26.2.41 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/45164ae1-048c-4267-b0f5-1c6084097236) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:04.885667 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f2863a5a-e647-42ba-b538-716fe25641ae tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1216547 Dec 10 14:27:04.887306 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55552) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:04.927477 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.930680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-03e7ccbc-50fc-4053-a317-0fbf8846d631 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.953964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-03e7ccbc-50fc-4053-a317-0fbf8846d631 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:04.971316 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.010160 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ec08dd79-0607-4531-bac1-94c6954d267d tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.1201200 Dec 10 14:27:05.011452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.015988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55554) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.042158 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-4ff94b91-91c3-48b7-b436-3fd6411ce3dc tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] delete failed (client error): The resource could not be found. Dec 10 14:27:05.046955 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4ff94b91-91c3-48b7-b436-3fd6411ce3dc tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "DELETE /v2.0/security-groups/257726a4-7f5c-4d44-b7f3-71b1faf9fbaf HTTP/1.1" status: 404 len: 347 time: 0.0261042 Dec 10 14:27:05.049047 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55556) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.069882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6d924007-6dde-43f0-a9a9-5146398925e3,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:05.091623 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-03e7ccbc-50fc-4053-a317-0fbf8846d631 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.094806 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-03e7ccbc-50fc-4053-a317-0fbf8846d631 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.095949 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-03e7ccbc-50fc-4053-a317-0fbf8846d631 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/d8db50af-4e1d-4b79-b8e5-6793f87ed37b HTTP/1.1" status: 204 len: 168 time: 0.2726057 Dec 10 14:27:05.104112 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55558) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.114430 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] vlan segment allocate from pool success with {'vlan_id': 393, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:05.115034 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d0e413df-b962-4a7e-a627-8f99eab66984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.124512 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e7ccbc-50fc-4053-a317-0fbf8846d631 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8db50af-4e1d-4b79-b8e5-6793f87ed37b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:05.124731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.128925 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a10e52c0-66be-4c38-a193-fbb4c38489f6 tempest-SecGroupIPv6Test-792531643 tempest-SecGroupIPv6Test-792531643-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0788360 Dec 10 14:27:05.137273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.137757 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Added segment 8884a3d8-3d3b-4c8a-a374-8f994bb64e01 of type vlan for network e9b085a0-e0b5-4630-9607-8d0706a5122c Dec 10 14:27:05.195802 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-343ab724-a607-45e9-acc7-fc6695735cbc tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0862300 Dec 10 14:27:05.196999 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.199243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55564) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.203784 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d6cd6b9d-278e-4670-a030-494fb14a7f7d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': 'b87c3dd3-d746-4ac0-bdef-c228ec009810', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:05.292249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55566) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.339649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.341667 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.347985 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:05.348164 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.389445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 2001:db8:1::1 (da18baf2-2036-4c07-8911-6bae9632cc69/095b94f4-22e7-4e8c-b916-8569ce0ad1d7/178f5aa1-1fd1-4067-b2ea-c420fc823e28) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:05.405518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:05.413623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event updated for resources: {'Port': ['ID=45164ae1-048c-4267-b0f5-1c6084097236,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:05.413623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:05.418806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:05.434833 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed33418c-b0d4-42da-a7a1-1d49400bfd92 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:05.441571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Network': ['ID=e9b085a0-e0b5-4630-9607-8d0706a5122c,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:05.460181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.460431 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ddfcc57f-553c-46aa-8638-ebebfa66e51c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 1.0666916 Dec 10 14:27:05.460531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.460531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.460531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.460531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.460531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.460531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.460531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.460531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.460531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.461207 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.461207 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.461773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:05.462533 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55570) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.463721 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:05.470485 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'name': 'tempest-PortsTestJSON-1967942058'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:05.477737 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-d6cd6b9d-278e-4670-a030-494fb14a7f7d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The resource could not be found. Dec 10 14:27:05.480222 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d6cd6b9d-278e-4670-a030-494fb14a7f7d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.2798891 Dec 10 14:27:05.499000 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3589ac5e-2144-4842-988c-d7e31451d563 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=a92f38bb4fde4f96868f58279fc34db3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2033343 Dec 10 14:27:05.499686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55572) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.500031 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55574) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.509912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-94838b38-72b8-4c39-ad1f-866cc52a0742 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--1307957959'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:05.586506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-32d6d671-179d-46d0-8370-69158e58b5ec None None] Provisioning complete for port 45164ae1-048c-4267-b0f5-1c6084097236 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:05.586985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-32d6d671-179d-46d0-8370-69158e58b5ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.627929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-32d6d671-179d-46d0-8370-69158e58b5ec None None] Port 45164ae1-048c-4267-b0f5-1c6084097236 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:05.633742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38cf643e-2399-4eac-9285-6b637cfb070e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.658286 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38cf643e-2399-4eac-9285-6b637cfb070e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.671243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.674611 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55578) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.694445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94838b38-72b8-4c39-ad1f-866cc52a0742 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.794672 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:05.796350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.798243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.816283 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:05.867690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38cf643e-2399-4eac-9285-6b637cfb070e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.870242 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38cf643e-2399-4eac-9285-6b637cfb070e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.871387 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-38cf643e-2399-4eac-9285-6b637cfb070e admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/1aa69db7-f656-4b3a-96a8-f668f6504a7c HTTP/1.1" status: 204 len: 168 time: 0.3692954 Dec 10 14:27:05.903290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38cf643e-2399-4eac-9285-6b637cfb070e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1aa69db7-f656-4b3a-96a8-f668f6504a7c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:05.927462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network da18baf2-2036-4c07-8911-6bae9632cc69 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:05.931991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94838b38-72b8-4c39-ad1f-866cc52a0742 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.939557 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:05.950029 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1bc1dbc3-4638-4efa-a751-11216cb6120f admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=d2317e4253f846d8a16d312773f264e1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2699087 Dec 10 14:27:05.950670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55584) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:05.951650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:05.952367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:05.964967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=178f5aa1-1fd1-4067-b2ea-c420fc823e28,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:06.040199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94838b38-72b8-4c39-ad1f-866cc52a0742 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.048006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.087847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94838b38-72b8-4c39-ad1f-866cc52a0742 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b8a79669-edb5-40d0-ba59-02ab906f40b6,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:06.109452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.145208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94838b38-72b8-4c39-ad1f-866cc52a0742 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.149643 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-94838b38-72b8-4c39-ad1f-866cc52a0742 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6456180 Dec 10 14:27:06.150302 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55586) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:06.155908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-79bbf470-38bc-4bed-8481-d8b1cde7d247 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--1175713692'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:06.170432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.172332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7666f053-7200-4aea-9ea1-3786446704ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.226048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.243397 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7666f053-7200-4aea-9ea1-3786446704ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.260638 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e9664e7b-2d4b-4093-8966-b2755b1cfce4 None None] Provisioning complete for port 178f5aa1-1fd1-4067-b2ea-c420fc823e28 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:06.261243 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9664e7b-2d4b-4093-8966-b2755b1cfce4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.263909 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-79bbf470-38bc-4bed-8481-d8b1cde7d247 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.312828 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=d8a9f1e1-4205-4e96-9e7f-f18cabac63f6,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:06.313468 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e9664e7b-2d4b-4093-8966-b2755b1cfce4 None None] Port 178f5aa1-1fd1-4067-b2ea-c420fc823e28 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:06.328480 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Checking segment: {'id': '8884a3d8-3d3b-4c8a-a374-8f994bb64e01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:06.328850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network hostable DHCP agents. Network: e9b085a0-e0b5-4630-9607-8d0706a5122c, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:06.370436 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.392421 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-79bbf470-38bc-4bed-8481-d8b1cde7d247 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.428790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:06.491863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-79bbf470-38bc-4bed-8481-d8b1cde7d247 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.521952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, e9b085a0-e0b5-4630-9607-8d0706a5122c) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:06.525515 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79bbf470-38bc-4bed-8481-d8b1cde7d247 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2a65cdf2-814b-4da8-8877-d5ca624fa425,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:06.527600 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:06.533290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:06.533953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.550317 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.553538 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33af533c-5764-4216-94eb-0f1efe72c721 None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:06.553684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7666f053-7200-4aea-9ea1-3786446704ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.556768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7666f053-7200-4aea-9ea1-3786446704ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.566869 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7666f053-7200-4aea-9ea1-3786446704ca admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/eda32678-25c7-4c8e-a750-9470fafbb3cb HTTP/1.1" status: 204 len: 168 time: 0.6058979 Dec 10 14:27:06.578006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-79bbf470-38bc-4bed-8481-d8b1cde7d247 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.578006 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-79bbf470-38bc-4bed-8481-d8b1cde7d247 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.4223223 Dec 10 14:27:06.579953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55596) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:06.582828 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.590598 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7666f053-7200-4aea-9ea1-3786446704ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eda32678-25c7-4c8e-a750-9470fafbb3cb,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:06.590777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9e11276e-000d-4192-87a4-2edee7b761b6 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': 'b8a79669-edb5-40d0-ba59-02ab906f40b6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '2001:db8::/48', 'remote_group_id': '2a65cdf2-814b-4da8-8877-d5ca624fa425'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:06.629141 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6aae9b28-5554-41ab-901c-097fc72375e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 1.1654422 Dec 10 14:27:06.632075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55600) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:06.643952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-232967372'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:06.853623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.869749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:06.873385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.900830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] vlan segment allocate from pool success with {'vlan_id': 361, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:06.909261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.909589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.909865 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Added segment db2b3bf4-591c-4dcb-bdaa-39d2b3ca8a30 of type vlan for network b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee Dec 10 14:27:06.910220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:06.949097 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-9e11276e-000d-4192-87a4-2edee7b761b6 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:06.949800 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9e11276e-000d-4192-87a4-2edee7b761b6 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.3686943 Dec 10 14:27:06.952326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Router e85edf19-4a36-4841-a1e2-a13da94d145d is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:27:06.953293 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55610) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:06.954123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.023565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e871933d-65b9-4ad2-a5d5-48a1bb102c52 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.025675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=178f5aa1-1fd1-4067-b2ea-c420fc823e28,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:07.049186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e871933d-65b9-4ad2-a5d5-48a1bb102c52 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.091829 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.100004 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:07.103313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.110907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network da18baf2-2036-4c07-8911-6bae9632cc69 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:07.113987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:07.208557 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Network': ['ID=b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:07.218823 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3af4b4a1-1171-44e5-8671-1318cd71158a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.5836303 Dec 10 14:27:07.220653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55622) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:07.221315 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:07.227889 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'ports': [{'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c'}, {'network_id': 'b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee'}]} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:07.228198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:07.228879 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': 'b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:07.370653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e871933d-65b9-4ad2-a5d5-48a1bb102c52 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.373606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e871933d-65b9-4ad2-a5d5-48a1bb102c52 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.377123 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e871933d-65b9-4ad2-a5d5-48a1bb102c52 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/2a65cdf2-814b-4da8-8877-d5ca624fa425 HTTP/1.1" status: 204 len: 168 time: 0.4182591 Dec 10 14:27:07.381080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55628) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:07.499818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-1aa87ac2-2c57-40d0-aecf-c932e7b4a43d None None] Provisioning complete for port 178f5aa1-1fd1-4067-b2ea-c420fc823e28 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:07.500521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1aa87ac2-2c57-40d0-aecf-c932e7b4a43d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.549309 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1aa87ac2-2c57-40d0-aecf-c932e7b4a43d None None] Port 178f5aa1-1fd1-4067-b2ea-c420fc823e28 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:07.560488 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.569291 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55632) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:07.680026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:07.685953 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.687174 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-915b0bc4-78f2-47c4-a44c-0a45d7c53c4b tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "PUT /v2.0/routers/e85edf19-4a36-4841-a1e2-a13da94d145d HTTP/1.1" status: 200 len: 918 time: 4.3129451 Dec 10 14:27:07.689190 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 52009993-772b-48ae-81fe-d159369269c5 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:27:07.689926 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55640) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:07.695008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01e3236c-f236-4a84-8e2c-72fd91eff511 None None] Sync routers for ids ['e85edf19-4a36-4841-a1e2-a13da94d145d'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:07.720837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01e3236c-f236-4a84-8e2c-72fd91eff511 None None] Routers {'e85edf19-4a36-4841-a1e2-a13da94d145d'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:07.724561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-01e3236c-f236-4a84-8e2c-72fd91eff511 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e85edf19-4a36-4841-a1e2-a13da94d145d'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:07.776116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e871933d-65b9-4ad2-a5d5-48a1bb102c52 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a65cdf2-814b-4da8-8877-d5ca624fa425,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:07.808563 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55642) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:07.847084 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-01e3236c-f236-4a84-8e2c-72fd91eff511 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:07.867672 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1bdcb360-35e5-4493-b91b-0bd9210e8c82 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4539 time: 0.1063752 Dec 10 14:27:07.870735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55646) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:07.877730 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d8951165-3698-4411-bc07-033f8affb153 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/routers/e85edf19-4a36-4841-a1e2-a13da94d145d HTTP/1.1" status: 200 len: 924 time: 0.1863670 Dec 10 14:27:07.880959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:07.883165 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55648) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:07.888408 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01e3236c-f236-4a84-8e2c-72fd91eff511 None None] Routers {'e85edf19-4a36-4841-a1e2-a13da94d145d'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:07.888684 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-89756453-b8b7-48d9-ba81-57e3f737323d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/52009993-772b-48ae-81fe-d159369269c5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8813803 Dec 10 14:27:07.889390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-01e3236c-f236-4a84-8e2c-72fd91eff511 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['e85edf19-4a36-4841-a1e2-a13da94d145d'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:07.893658 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6073e631-1c66-4f6a-9dc0-e8b5eedcef1a None None] Sync routers for ids ['52009993-772b-48ae-81fe-d159369269c5'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:07.896434 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55650) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:07.916239 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6073e631-1c66-4f6a-9dc0-e8b5eedcef1a None None] Routers {'52009993-772b-48ae-81fe-d159369269c5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:07.917190 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6073e631-1c66-4f6a-9dc0-e8b5eedcef1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['52009993-772b-48ae-81fe-d159369269c5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:07.957337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 2} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:07.962447 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:07.967634 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6073e631-1c66-4f6a-9dc0-e8b5eedcef1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:07.968617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-01e3236c-f236-4a84-8e2c-72fd91eff511 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:07.970861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01e3236c-f236-4a84-8e2c-72fd91eff511 None None] The sync data for ids ['e85edf19-4a36-4841-a1e2-a13da94d145d'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:07.981332 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6073e631-1c66-4f6a-9dc0-e8b5eedcef1a None None] Routers {'52009993-772b-48ae-81fe-d159369269c5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:07.981997 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6073e631-1c66-4f6a-9dc0-e8b5eedcef1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['52009993-772b-48ae-81fe-d159369269c5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:07.993024 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.014908 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca00a637-3b63-45a0-b562-280b88d31a1b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:08.019019 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ca00a637-3b63-45a0-b562-280b88d31a1b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports/178f5aa1-1fd1-4067-b2ea-c420fc823e28 HTTP/1.1" status: 200 len: 913 time: 0.1177433 Dec 10 14:27:08.019182 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ab09fb9a-c266-46bd-a3f9-9f42d8739b9d tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools-1904568512', 'prefixes': ['172.20.0.0/16']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:08.019597 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc8906e6-8ced-40b7-a315-d27929fbfb95 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:08.021090 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cc8906e6-8ced-40b7-a315-d27929fbfb95 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=e85edf19-4a36-4841-a1e2-a13da94d145d&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1367972 Dec 10 14:27:08.021706 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55652) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.029199 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55654) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.033973 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6073e631-1c66-4f6a-9dc0-e8b5eedcef1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:08.034774 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6073e631-1c66-4f6a-9dc0-e8b5eedcef1a None None] The sync data for ids ['52009993-772b-48ae-81fe-d159369269c5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:08.052702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94f98940-7cec-4573-9c60-ef59c2b0d5c5 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.079343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsTestJSON-test-network-242210186'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:08.123459 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94f98940-7cec-4573-9c60-ef59c2b0d5c5 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.171325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port 801e2320-cba8-4a47-982b-f404c90b93a6 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:08.265747 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94f98940-7cec-4573-9c60-ef59c2b0d5c5 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.268267 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94f98940-7cec-4573-9c60-ef59c2b0d5c5 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.271788 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-94f98940-7cec-4573-9c60-ef59c2b0d5c5 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/b8a79669-edb5-40d0-ba59-02ab906f40b6 HTTP/1.1" status: 204 len: 168 time: 0.3976240 Dec 10 14:27:08.272020 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55656) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.273533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Made reservation on behalf of a639154c129a4dfdb50e09c7c8833d1a for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:08.276907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.296850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7ff0e8e-0b04-4701-823d-900b5bbfe8ca tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:08.298280 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c7ff0e8e-0b04-4701-823d-900b5bbfe8ca tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 881 time: 0.2679219 Dec 10 14:27:08.301109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.303648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55658) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.319945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94f98940-7cec-4573-9c60-ef59c2b0d5c5 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8a79669-edb5-40d0-ba59-02ab906f40b6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:08.343647 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bd2a47ea-a4b0-4d44-83ef-a46ed50409ff tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=e85edf19-4a36-4841-a1e2-a13da94d145d HTTP/1.1" status: 200 len: 205 time: 0.0369473 Dec 10 14:27:08.350930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55660) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.364080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.391420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ab09fb9a-c266-46bd-a3f9-9f42d8739b9d tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] Publish callbacks [] for subnetpool, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.395986 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ab09fb9a-c266-46bd-a3f9-9f42d8739b9d tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] 10.222.0.57 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 737 time: 0.5843024 Dec 10 14:27:08.421457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55662) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.430944 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-23f31ce3-b946-4904-8258-b052abadd939 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1477723 Dec 10 14:27:08.434518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55664) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.443428 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-4247a67e-c4ba-4838-83f0-45f1090a2711 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--205537987'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:08.502249 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-006fdb78-4a9a-4e4f-bb30-76d6050725ce tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] 10.222.0.57 "GET /v2.0/subnetpools/4ee4d20c-a6d5-4fac-8f6b-5023c7d7db5d HTTP/1.1" status: 200 len: 732 time: 0.0771778 Dec 10 14:27:08.504493 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port ac0c982f-495a-415e-b536-d27322319d53 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:08.507151 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55666) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.513312 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-38148997-ea14-4ef4-af7b-e4319844fe47 tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools_update-867652110'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:08.587570 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.590915 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4247a67e-c4ba-4838-83f0-45f1090a2711 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.591372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.655647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.717313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38148997-ea14-4ef4-af7b-e4319844fe47 tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] Publish callbacks [] for subnetpool, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.720990 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-38148997-ea14-4ef4-af7b-e4319844fe47 tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] 10.222.0.57 "PUT /v2.0/subnetpools/4ee4d20c-a6d5-4fac-8f6b-5023c7d7db5d HTTP/1.1" status: 200 len: 683 time: 0.2087269 Dec 10 14:27:08.722630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55668) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.726086 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] vlan segment allocate from pool success with {'vlan_id': 350, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:08.742576 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.752564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event updated for resources: {'SecurityGroup': ['ID=40702bab-81a0-4e0d-8b1e-14b1fc2a3d59,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:08.762188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.762440 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Added segment b580f807-2275-4ac5-b411-e38f2f21ed4a of type vlan for network b144e4a5-9dd6-46d1-803d-970176603256 Dec 10 14:27:08.774714 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4247a67e-c4ba-4838-83f0-45f1090a2711 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.777776 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.798667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.820248 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.822709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.833195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4247a67e-c4ba-4838-83f0-45f1090a2711 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.873752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4247a67e-c4ba-4838-83f0-45f1090a2711 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0aa9e1a8-72b2-47c2-b54c-706f9e657303,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:08.949052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.986410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4b02d7b7-b573-412d-8ce8-b347e44cb9c8 tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] Publish callbacks [] for subnetpool, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.990021 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4b02d7b7-b573-412d-8ce8-b347e44cb9c8 tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] 10.222.0.57 "DELETE /v2.0/subnetpools/4ee4d20c-a6d5-4fac-8f6b-5023c7d7db5d HTTP/1.1" status: 204 len: 168 time: 0.2590070 Dec 10 14:27:08.990383 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4247a67e-c4ba-4838-83f0-45f1090a2711 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:08.991499 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4247a67e-c4ba-4838-83f0-45f1090a2711 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.5516689 Dec 10 14:27:08.992198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55670) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:08.997152 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55672) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:09.003566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.008993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9c9cea4f-b5df-4f18-9581-4eb6423f008b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '0aa9e1a8-72b2-47c2-b54c-706f9e657303', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:09.009134 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:09.009737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.022594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:09.039574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:09.041688 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-e08e8028-4bae-4e13-b9ed-d590bf951026 tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] show failed (client error): The resource could not be found. Dec 10 14:27:09.045483 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e08e8028-4bae-4e13-b9ed-d590bf951026 tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] 10.222.0.57 "GET /v2.0/subnetpools/4ee4d20c-a6d5-4fac-8f6b-5023c7d7db5d HTTP/1.1" status: 404 len: 346 time: 0.0463459 Dec 10 14:27:09.045483 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:09.045483 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.047879 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=801e2320-cba8-4a47-982b-f404c90b93a6,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:09.050980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55674) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:09.086670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Deleting port 45164ae1-048c-4267-b0f5-1c6084097236 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:09.087218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.101029 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-fbcfcc0d-93a9-461a-b62c-d769bb683426 tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] delete failed (client error): The resource could not be found. Dec 10 14:27:09.102689 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fbcfcc0d-93a9-461a-b62c-d769bb683426 tempest-SubnetPoolsTestJSON-973397121 tempest-SubnetPoolsTestJSON-973397121-project] 10.222.0.57 "DELETE /v2.0/subnetpools/4ee4d20c-a6d5-4fac-8f6b-5023c7d7db5d HTTP/1.1" status: 404 len: 346 time: 0.0492108 Dec 10 14:27:09.131000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=ac0c982f-495a-415e-b536-d27322319d53,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:09.138610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event updated for resources: {'Network': ['ID=b144e4a5-9dd6-46d1-803d-970176603256,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:09.140435 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Checking segment: {'id': 'db2b3bf4-591c-4dcb-bdaa-39d2b3ca8a30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:09.140810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network hostable DHCP agents. Network: b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:09.156606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network b144e4a5-9dd6-46d1-803d-970176603256 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:09.205972 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7f51cc0e-e1c1-49a0-bdda-9029421317bc tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 1.6327837 Dec 10 14:27:09.206799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55678) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:09.208639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.214744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Request body: {'subnet': {'network_id': 'b144e4a5-9dd6-46d1-803d-970176603256', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:09.223407 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-9c9cea4f-b5df-4f18-9581-4eb6423f008b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:09.225582 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Calling delete_port for 45164ae1-048c-4267-b0f5-1c6084097236 owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:09.227688 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9c9cea4f-b5df-4f18-9581-4eb6423f008b tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.2209511 Dec 10 14:27:09.230525 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:09.246801 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55680) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:09.255239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-fa7c946b-f1e9-48c2-abe3-4e90edccfd6f tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group_rule': {'security_group_id': '0aa9e1a8-72b2-47c2-b54c-706f9e657303', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:09.332183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 178f5aa1-1fd1-4067-b2ea-c420fc823e28 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:09.332562 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.353830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:09.357698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:09.364040 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:09.364715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d2b0097-f3a8-4953-85f3-b39e3e312a56 None None] Network b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:09.369396 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:09.370127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.478629 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d143060f-740f-406e-ae11-4c272a384dc4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 2.2561479 Dec 10 14:27:09.481781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55682) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:09.589536 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-8adaa802-2e6e-4683-aa3b-07d2f8d80c58 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port ac0c982f-495a-415e-b536-d27322319d53 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:09.590171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8adaa802-2e6e-4683-aa3b-07d2f8d80c58 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.613262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Made reservation on behalf of a639154c129a4dfdb50e09c7c8833d1a for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:09.617086 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.657920 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55686) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:09.709276 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-fa7c946b-f1e9-48c2-abe3-4e90edccfd6f tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:09.712467 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fa7c946b-f1e9-48c2-abe3-4e90edccfd6f tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.4613869 Dec 10 14:27:09.715902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55690) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:09.737983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8adaa802-2e6e-4683-aa3b-07d2f8d80c58 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.759396 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-8adaa802-2e6e-4683-aa3b-07d2f8d80c58 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for ac0c982f-495a-415e-b536-d27322319d53 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:09.769156 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.812976 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 178f5aa1-1fd1-4067-b2ea-c420fc823e28 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:09.832383 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83ae8767-c170-4dd7-8393-c33c109ecaf9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.898664 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9927fd3-cf65-458f-a264-c8697c4b5d4d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.934452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9927fd3-cf65-458f-a264-c8697c4b5d4d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.935450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83ae8767-c170-4dd7-8393-c33c109ecaf9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.986213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:09.990566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8adaa802-2e6e-4683-aa3b-07d2f8d80c58 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.024540 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8adaa802-2e6e-4683-aa3b-07d2f8d80c58 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=ac0c982f-495a-415e-b536-d27322319d53,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:10.039559 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8adaa802-2e6e-4683-aa3b-07d2f8d80c58 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.045727 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event deleted for resources: {'Port': ['ID=45164ae1-048c-4267-b0f5-1c6084097236,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:10.045907 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8adaa802-2e6e-4683-aa3b-07d2f8d80c58 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/ac0c982f-495a-415e-b536-d27322319d53 HTTP/1.1" status: 204 len: 168 time: 0.5608132 Dec 10 14:27:10.045907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55692) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.066289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb25dcc6-46ee-491d-aae6-8a02eeb2e057 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:10.103281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83ae8767-c170-4dd7-8393-c33c109ecaf9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.138418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.191473 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-83ae8767-c170-4dd7-8393-c33c109ecaf9 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=98bde933dcfc41e69e40c99c0312df1a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5302744 Dec 10 14:27:10.201214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55694) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.204846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9927fd3-cf65-458f-a264-c8697c4b5d4d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.207451 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a9927fd3-cf65-458f-a264-c8697c4b5d4d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.208584 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a9927fd3-cf65-458f-a264-c8697c4b5d4d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/0aa9e1a8-72b2-47c2-b54c-706f9e657303 HTTP/1.1" status: 204 len: 168 time: 0.4917300 Dec 10 14:27:10.211071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ae8767-c170-4dd7-8393-c33c109ecaf9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26a74b8c-af0d-4407-ae16-b09f02d44d94,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:10.219097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55696) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.241187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1cd1ec8-79a2-49e6-ab81-38fcc56e6b77 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:10.248011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1cd1ec8-79a2-49e6-ab81-38fcc56e6b77 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:10.249641 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f1cd1ec8-79a2-49e6-ab81-38fcc56e6b77 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1452 time: 0.2027864 Dec 10 14:27:10.267059 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55698) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.267498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9927fd3-cf65-458f-a264-c8697c4b5d4d tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0aa9e1a8-72b2-47c2-b54c-706f9e657303,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:10.275032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.289544 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.311719 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-681e1822-46a3-4cab-8232-0ce61bb05317 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0915213 Dec 10 14:27:10.316421 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55700) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.321800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8a61b445-ae3e-4788-9363-735bfd9b1b12 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'tempest-secgroup--980664061'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:10.329493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.360368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.415446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=178f5aa1-1fd1-4067-b2ea-c420fc823e28,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:10.426005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event updated for resources: {'Subnet': ['ID=4ef9c004-3d7a-4b01-a773-689bb0248ade,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:10.431012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Checking segment: {'id': 'b580f807-2275-4ac5-b411-e38f2f21ed4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b144e4a5-9dd6-46d1-803d-970176603256'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:10.431380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Network hostable DHCP agents. Network: b144e4a5-9dd6-46d1-803d-970176603256, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:10.441053 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a61b445-ae3e-4788-9363-735bfd9b1b12 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.516602 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-770d83f3-3069-44d7-b74d-89281ac4f7fd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.519156 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a61b445-ae3e-4788-9363-735bfd9b1b12 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.543479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Network b144e4a5-9dd6-46d1-803d-970176603256 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:10.562523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.563056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Fanout notify agent at l3_agent the message router_deleted on router e85edf19-4a36-4841-a1e2-a13da94d145d {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:27:10.577031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.578193 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-15a45adb-4718-434d-8e0f-00832448f0a4 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/e85edf19-4a36-4841-a1e2-a13da94d145d HTTP/1.1" status: 204 len: 168 time: 2.2257156 Dec 10 14:27:10.582540 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55702) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.588874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2935e768-0844-4ecf-88c9-2663e77105ae tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1846062699', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:10.591847 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-770d83f3-3069-44d7-b74d-89281ac4f7fd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.608908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a61b445-ae3e-4788-9363-735bfd9b1b12 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.619689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.639112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, b144e4a5-9dd6-46d1-803d-970176603256) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:10.646383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-65f821ab-8f64-4d65-b349-4f9520d0b8a5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 801e2320-cba8-4a47-982b-f404c90b93a6 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:10.646868 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65f821ab-8f64-4d65-b349-4f9520d0b8a5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.649702 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddb2e5ec-7139-42ee-8210-4280ab267d40 None None] Network b144e4a5-9dd6-46d1-803d-970176603256 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:10.669301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a61b445-ae3e-4788-9363-735bfd9b1b12 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event updated for resources: {'SecurityGroup': ['ID=98e78024-2f15-4b36-b76c-677de31bf213,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:10.685213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:10.686743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.689678 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2935e768-0844-4ecf-88c9-2663e77105ae tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.692284 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2935e768-0844-4ecf-88c9-2663e77105ae tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.756593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2935e768-0844-4ecf-88c9-2663e77105ae tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.759737 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a61b445-ae3e-4788-9363-735bfd9b1b12 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.761906 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8a61b445-ae3e-4788-9363-735bfd9b1b12 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.4442391 Dec 10 14:27:10.764493 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55704) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.768928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d17913ab-0702-4a23-a4aa-ca541136f1e7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:10.769346 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-d17913ab-0702-4a23-a4aa-ca541136f1e7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 10 14:27:10.770481 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-d17913ab-0702-4a23-a4aa-ca541136f1e7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] update failed (client error): There was a conflict when trying to complete your request. Dec 10 14:27:10.779337 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d17913ab-0702-4a23-a4aa-ca541136f1e7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "PUT /v2.0/security-groups/98e78024-2f15-4b36-b76c-677de31bf213 HTTP/1.1" status: 409 len: 330 time: 0.0059946 Dec 10 14:27:10.779473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-b144e4a5-9dd6-46d1-803d-970176603256', 'network_id': 'b144e4a5-9dd6-46d1-803d-970176603256', 'project_id': 'a639154c129a4dfdb50e09c7c8833d1a', 'fixed_ips': [{'subnet_id': '4ef9c004-3d7a-4b01-a773-689bb0248ade'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:10.779473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.781450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55706) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.802372 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-08caa40f-1be2-4afe-b7d7-5453808f5f1b tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5938103 Dec 10 14:27:10.802676 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65f821ab-8f64-4d65-b349-4f9520d0b8a5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.806369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55708) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.811554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Request body: {'port': {'network_id': 'b144e4a5-9dd6-46d1-803d-970176603256', 'name': 'tempest-ExtraDHCPOptionsTestJSON-36769168'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:10.820484 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-65f821ab-8f64-4d65-b349-4f9520d0b8a5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 801e2320-cba8-4a47-982b-f404c90b93a6 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:10.834665 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2935e768-0844-4ecf-88c9-2663e77105ae tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.902122 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-770d83f3-3069-44d7-b74d-89281ac4f7fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.904731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-770d83f3-3069-44d7-b74d-89281ac4f7fd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.908236 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-770d83f3-3069-44d7-b74d-89281ac4f7fd admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/26a74b8c-af0d-4407-ae16-b09f02d44d94 HTTP/1.1" status: 204 len: 168 time: 0.6962912 Dec 10 14:27:10.922160 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5a938507-9181-411b-b125-55ee815f6a85 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.947625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5a938507-9181-411b-b125-55ee815f6a85 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.954075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-770d83f3-3069-44d7-b74d-89281ac4f7fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26a74b8c-af0d-4407-ae16-b09f02d44d94,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:10.965057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2935e768-0844-4ecf-88c9-2663e77105ae tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:10.966664 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2935e768-0844-4ecf-88c9-2663e77105ae tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.3828392 Dec 10 14:27:10.970552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55712) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:10.976747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'enable_snat': False}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:11.045228 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Allocated IP 172.20.0.2 (b144e4a5-9dd6-46d1-803d-970176603256/4ef9c004-3d7a-4b01-a773-689bb0248ade/46e8a41f-90d3-4126-8b7a-af658c911891) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:11.077315 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 52009993-772b-48ae-81fe-d159369269c5 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:27:11.114455 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Made reservation on behalf of a639154c129a4dfdb50e09c7c8833d1a for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:11.118053 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.120045 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5a938507-9181-411b-b125-55ee815f6a85 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.122715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5a938507-9181-411b-b125-55ee815f6a85 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.126496 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5a938507-9181-411b-b125-55ee815f6a85 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/98e78024-2f15-4b36-b76c-677de31bf213 HTTP/1.1" status: 204 len: 168 time: 0.3404195 Dec 10 14:27:11.132071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55716) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:11.154726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a938507-9181-411b-b125-55ee815f6a85 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=98e78024-2f15-4b36-b76c-677de31bf213,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:11.175908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] device_id is not set on port cd8ce4c1-3c81-4254-8271-41a0d95223ce yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:11.207666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.246905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65f821ab-8f64-4d65-b349-4f9520d0b8a5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.247595 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c87592-41c5-4799-9ef6-6360e887429e req-a998d422-044c-44bf-baf3-4a061729a46e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:11.249207 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-19c87592-41c5-4799-9ef6-6360e887429e req-a998d422-044c-44bf-baf3-4a061729a46e tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1241906 Dec 10 14:27:11.259327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.308596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f821ab-8f64-4d65-b349-4f9520d0b8a5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=801e2320-cba8-4a47-982b-f404c90b93a6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:11.310916 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Network b144e4a5-9dd6-46d1-803d-970176603256 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:11.314965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:11.317103 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Allocated IP 172.20.0.12 (b144e4a5-9dd6-46d1-803d-970176603256/4ef9c004-3d7a-4b01-a773-689bb0248ade/cd8ce4c1-3c81-4254-8271-41a0d95223ce) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:11.318310 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:11.351408 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Pushing event updated for resources: {'Port': ['ID=46e8a41f-90d3-4126-8b7a-af658c911891,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:11.381900 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65f821ab-8f64-4d65-b349-4f9520d0b8a5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.386187 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-65f821ab-8f64-4d65-b349-4f9520d0b8a5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/801e2320-cba8-4a47-982b-f404c90b93a6 HTTP/1.1" status: 204 len: 168 time: 1.1162164 Dec 10 14:27:11.417975 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55722) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:11.418197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Attempting to bind port 46e8a41f-90d3-4126-8b7a-af658c911891 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:11.418422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Attempting to bind port 46e8a41f-90d3-4126-8b7a-af658c911891 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'b580f807-2275-4ac5-b411-e38f2f21ed4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b144e4a5-9dd6-46d1-803d-970176603256'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:11.418830 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Attempting to bind port 46e8a41f-90d3-4126-8b7a-af658c911891 on network b144e4a5-9dd6-46d1-803d-970176603256 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:11.424730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.425499 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:11.425885 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Checking segment: {'id': 'b580f807-2275-4ac5-b411-e38f2f21ed4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b144e4a5-9dd6-46d1-803d-970176603256'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:11.426327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.426728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Bound using segment: {'id': 'b580f807-2275-4ac5-b411-e38f2f21ed4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b144e4a5-9dd6-46d1-803d-970176603256'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:11.427308 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Bound port: 46e8a41f-90d3-4126-8b7a-af658c911891, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b580f807-2275-4ac5-b411-e38f2f21ed4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b144e4a5-9dd6-46d1-803d-970176603256'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:11.427746 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.440424 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:11.448503 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-42398484-79c0-435d-9459-85e4c44ff5ed tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.3139021 Dec 10 14:27:11.459827 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-be3676fe-1d37-459f-a304-308072075c1c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/52009993-772b-48ae-81fe-d159369269c5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4364247 Dec 10 14:27:11.464344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24c3c102-d9f3-4868-ab66-4c47091a1e5e None None] Sync routers for ids ['52009993-772b-48ae-81fe-d159369269c5'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:11.479601 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55728) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:11.479954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55730) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:11.503845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.519588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24c3c102-d9f3-4868-ab66-4c47091a1e5e None None] Routers {'52009993-772b-48ae-81fe-d159369269c5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:11.520298 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-24c3c102-d9f3-4868-ab66-4c47091a1e5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['52009993-772b-48ae-81fe-d159369269c5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:11.551859 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-19c87592-41c5-4799-9ef6-6360e887429e req-bb3dedfd-828c-42ff-bc1c-7a28625e0a60 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1915877 Dec 10 14:27:11.568500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-24c3c102-d9f3-4868-ab66-4c47091a1e5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:11.568857 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-987984b9-b3d8-47d5-b500-8c053d7c2fc7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] delete failed (client error): The resource could not be found. Dec 10 14:27:11.576812 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-987984b9-b3d8-47d5-b500-8c053d7c2fc7 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "DELETE /v2.0/security-groups/2cd8e344-ce12-4c8b-b2c1-8fc5e3643d79 HTTP/1.1" status: 404 len: 347 time: 0.0888910 Dec 10 14:27:11.582989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55734) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:11.603927 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24c3c102-d9f3-4868-ab66-4c47091a1e5e None None] Routers {'52009993-772b-48ae-81fe-d159369269c5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:11.604851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-24c3c102-d9f3-4868-ab66-4c47091a1e5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['52009993-772b-48ae-81fe-d159369269c5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:11.610884 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-8bee51c2-9955-40b7-84aa-b515020302be tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] show failed (client error): The resource could not be found. Dec 10 14:27:11.611954 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8bee51c2-9955-40b7-84aa-b515020302be tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-groups/a56549d4-2078-4337-ab2e-d6ef588d739f HTTP/1.1" status: 404 len: 347 time: 0.0279715 Dec 10 14:27:11.620552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55738) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:11.638310 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-bf52a279-b42d-40aa-a7f1-9ef40df4c6a0 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] show failed (client error): The resource could not be found. Dec 10 14:27:11.639180 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-256668d8-9726-4211-9d4b-3a178baf5b95 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:11.643447 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-256668d8-9726-4211-9d4b-3a178baf5b95 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.2190671 Dec 10 14:27:11.645604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55740) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:11.661517 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bf52a279-b42d-40aa-a7f1-9ef40df4c6a0 tempest-NegativeSecGroupIPv6Test-245260792 tempest-NegativeSecGroupIPv6Test-245260792-project] 10.222.0.57 "GET /v2.0/security-group-rules/60705869-475a-4fcd-a8c8-b0e38423671f HTTP/1.1" status: 404 len: 356 time: 0.0394971 Dec 10 14:27:11.661733 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] For port 46e8a41f-90d3-4126-8b7a-af658c911891, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:11.668113 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-24c3c102-d9f3-4868-ab66-4c47091a1e5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:11.668780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24c3c102-d9f3-4868-ab66-4c47091a1e5e None None] The sync data for ids ['52009993-772b-48ae-81fe-d159369269c5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:11.670336 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.684077 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] For port 46e8a41f-90d3-4126-8b7a-af658c911891, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=46e8a41f-90d3-4126-8b7a-af658c911891,segment=NetworkSegment(b580f807-2275-4ac5-b411-e38f2f21ed4a),segment_id=b580f807-2275-4ac5-b411-e38f2f21ed4a)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:11.688212 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-2f0f63a9-cf4d-4298-8b24-94c1abd3d6f6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:27:11.691926 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2f0f63a9-cf4d-4298-8b24-94c1abd3d6f6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/ac0c982f-495a-415e-b536-d27322319d53 HTTP/1.1" status: 404 len: 333 time: 0.0418773 Dec 10 14:27:11.730901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55744) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:11.744822 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:11.756011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event updated for resources: {'Port': ['ID=cd8ce4c1-3c81-4254-8271-41a0d95223ce,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:11.819793 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-94a277b8-3312-479b-898f-6e57705f5e16 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:27:11.823982 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-94a277b8-3312-479b-898f-6e57705f5e16 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/801e2320-cba8-4a47-982b-f404c90b93a6 HTTP/1.1" status: 404 len: 333 time: 0.0859115 Dec 10 14:27:11.827390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55748) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:11.833616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Network b144e4a5-9dd6-46d1-803d-970176603256 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:11.845353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:11.860748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:11.876001 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ea2e77-6046-4113-90ee-f172547cd08c None None] Pushing event updated for resources: {'Port': ['ID=46e8a41f-90d3-4126-8b7a-af658c911891,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:11.973244 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a0d00a-9000-4683-836b-143166f4f19f req-f72ac5f6-f689-4006-ac82-2e1bced61a54 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:11.975771 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-94a0d00a-9000-4683-836b-143166f4f19f req-f72ac5f6-f689-4006-ac82-2e1bced61a54 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2411048 Dec 10 14:27:11.981794 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.024560 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:12.025081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.185074 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-94a0d00a-9000-4683-836b-143166f4f19f req-dac9ac96-ee05-45cc-a74b-c6c22da2a6cd tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1984503 Dec 10 14:27:12.190849 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f62e457a-67cc-4401-b7f3-56403ffd3bd8 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3832495 Dec 10 14:27:12.194722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55756) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:12.201661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Request body: {'port': {'network_id': 'b144e4a5-9dd6-46d1-803d-970176603256', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1347809306', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:12.204564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.api.validators [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] bootfile-name is not in valid_values {{(pid=103810) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:27:12.204564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.api.validators [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] tftp-server is not in valid_values {{(pid=103810) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:27:12.204564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.api.validators [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] server-ip-address is not in valid_values {{(pid=103810) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:27:12.213903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.247366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:12.277547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'db2b3bf4-591c-4dcb-bdaa-39d2b3ca8a30') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:12.277669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'db2b3bf4-591c-4dcb-bdaa-39d2b3ca8a30') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:12.293327 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.314546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.340028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Releasing vlan 361 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:12.340356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.395512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55764) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:12.407839 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:12.514731 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.526314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.530989 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/networks/b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee HTTP/1.1" status: 204 len: 168 time: 0.6992514 Dec 10 14:27:12.534126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.538517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55770) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:12.558116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84a3250d-a81d-4708-9be2-d3fae2dcff9e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Network': ['ID=b8c65396-ab94-49ed-b5ed-8b40c0f2f3ee,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:12.578978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-272073194'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:12.587548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.648980 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Made reservation on behalf of a639154c129a4dfdb50e09c7c8833d1a for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:12.652545 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.700171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b9a4104-5e8f-41dd-b219-74223324cec4 req-49322875-ffa4-4e4b-a665-dfb1d78c02c5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:12.706681 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3b9a4104-5e8f-41dd-b219-74223324cec4 req-49322875-ffa4-4e4b-a665-dfb1d78c02c5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.0668435 Dec 10 14:27:12.715394 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 46e8a41f-90d3-4126-8b7a-af658c911891 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:12.739325 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] device_id is not set on port 031aa7ee-3392-42f5-a0fe-c20af777a01a yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:12.803962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 46e8a41f-90d3-4126-8b7a-af658c911891 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:12.804952 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.825326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:12.829270 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.839518 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3b9a4104-5e8f-41dd-b219-74223324cec4 req-b5514e5f-a0e8-4a61-b0d4-8ff6472ff3d5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1208115 Dec 10 14:27:12.846717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.916243 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-95817859-ca81-4869-9353-2a042af72131 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=49ab6b2508e14f10a31682c2abcd0dc3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5098646 Dec 10 14:27:12.920014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55778) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:12.920972 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:12.997823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 46e8a41f-90d3-4126-8b7a-af658c911891, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=46e8a41f-90d3-4126-8b7a-af658c911891,segment=NetworkSegment(b580f807-2275-4ac5-b411-e38f2f21ed4a),segment_id=b580f807-2275-4ac5-b411-e38f2f21ed4a)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:13.021916 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] vlan segment allocate from pool success with {'vlan_id': 373, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:13.023295 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d07709d1-ced8-4d18-81dc-2ffbccbce032 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.024976 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Allocated IP 172.26.2.46 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/f12ba217-44c1-47b6-8251-54c65cbc58e0) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:13.053839 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d07709d1-ced8-4d18-81dc-2ffbccbce032 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.056769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.057306 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Added segment 5e10ced6-ee25-4521-bacf-f383b1cbf9b8 of type vlan for network 4f8f60d3-4189-45a5-91c9-a144dc4cc316 Dec 10 14:27:13.091683 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.160798 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=46e8a41f-90d3-4126-8b7a-af658c911891,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:13.185762 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Allocated IP 172.20.0.5 (b144e4a5-9dd6-46d1-803d-970176603256/4ef9c004-3d7a-4b01-a773-689bb0248ade/031aa7ee-3392-42f5-a0fe-c20af777a01a) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:13.211529 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d07709d1-ced8-4d18-81dc-2ffbccbce032 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.214627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d07709d1-ced8-4d18-81dc-2ffbccbce032 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.218176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3ecf46f-dcce-44f9-af27-7ac9af4b026a None None] Network b144e4a5-9dd6-46d1-803d-970176603256 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:13.218333 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d07709d1-ced8-4d18-81dc-2ffbccbce032 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/e0478651-0295-4615-a8fa-b4ac4a717cd0 HTTP/1.1" status: 204 len: 168 time: 0.2921746 Dec 10 14:27:13.221859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.227132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d07709d1-ced8-4d18-81dc-2ffbccbce032 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0478651-0295-4615-a8fa-b4ac4a717cd0,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:13.327326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-33fce5ac-6ad1-4e57-aa64-70480b02d3a9 None None] Provisioning complete for port 46e8a41f-90d3-4126-8b7a-af658c911891 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:13.328161 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-33fce5ac-6ad1-4e57-aa64-70480b02d3a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.350809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.410208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.412228 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:13.412671 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.581089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Network': ['ID=4f8f60d3-4189-45a5-91c9-a144dc4cc316,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:13.586324 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ccaae6cd-7e96-49d3-9940-482f23e5d9d6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 1.0302835 Dec 10 14:27:13.589313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55792) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:13.597519 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': '4f8f60d3-4189-45a5-91c9-a144dc4cc316', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.2', 'end': '172.20.0.14'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:13.597758 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 4f8f60d3-4189-45a5-91c9-a144dc4cc316 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:13.689806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.711704 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.716194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port c02f5295-cc2e-4620-8166-844fb3e72fdc {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:13.716586 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.775673 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-1aa6a2cf-9c97-41ac-8a88-ff49684bdcf3 None None] Provisioning complete for port cd8ce4c1-3c81-4254-8271-41a0d95223ce triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:13.775673 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1aa6a2cf-9c97-41ac-8a88-ff49684bdcf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.816736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55798) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:13.826001 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1aa6a2cf-9c97-41ac-8a88-ff49684bdcf3 None None] Port cd8ce4c1-3c81-4254-8271-41a0d95223ce cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:13.829610 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1577567629', 'description': 'tempest-secgroup-smoke-1577567629 description', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:13.843115 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-1aa6a2cf-9c97-41ac-8a88-ff49684bdcf3 None None] Provisioning complete for port 46e8a41f-90d3-4126-8b7a-af658c911891 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:13.843571 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1aa6a2cf-9c97-41ac-8a88-ff49684bdcf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.847120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:13.857371 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:13.870887 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:13.871645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:13.880953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.917797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8946d5da-0f53-46af-9e8d-1f98117310ce None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:13.959586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.972424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:13.990083 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Pushing event updated for resources: {'Port': ['ID=f12ba217-44c1-47b6-8251-54c65cbc58e0,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:14.016731 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.ipam_backend_mixin [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Performing IP validity checks on allocation pools {{(pid=103811) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 10 14:27:14.020091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.ipam_backend_mixin [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103811) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 10 14:27:14.078386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.099277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.102499 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for c02f5295-cc2e-4620-8166-844fb3e72fdc owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:14.108880 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6083eca7-b987-42bb-bc84-8373098d59c5 req-dc952c6b-66a5-43c4-a699-dbf833a4b5e5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:14.111158 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6083eca7-b987-42bb-bc84-8373098d59c5 req-dc952c6b-66a5-43c4-a699-dbf833a4b5e5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1103690 Dec 10 14:27:14.148460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-aeab9a71-1ce7-4c88-bf06-2b81862d6b02 None None] Provisioning complete for port cd8ce4c1-3c81-4254-8271-41a0d95223ce triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:14.153218 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-aeab9a71-1ce7-4c88-bf06-2b81862d6b02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.197147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Network b144e4a5-9dd6-46d1-803d-970176603256 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:14.208085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:14.218029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-aeab9a71-1ce7-4c88-bf06-2b81862d6b02 None None] Port cd8ce4c1-3c81-4254-8271-41a0d95223ce cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:14.239734 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-aeab9a71-1ce7-4c88-bf06-2b81862d6b02 None None] Provisioning complete for port f12ba217-44c1-47b6-8251-54c65cbc58e0 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:14.240238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-aeab9a71-1ce7-4c88-bf06-2b81862d6b02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.249441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.250072 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:14.252637 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event updated for resources: {'Port': ['ID=031aa7ee-3392-42f5-a0fe-c20af777a01a,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:14.256766 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6083eca7-b987-42bb-bc84-8373098d59c5 req-0eee8a05-a447-4560-b22d-40eff3de6543 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1247983 Dec 10 14:27:14.307837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-aeab9a71-1ce7-4c88-bf06-2b81862d6b02 None None] Port f12ba217-44c1-47b6-8251-54c65cbc58e0 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:14.343658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.370576 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:14.377106 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.396568 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.407178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'SecurityGroup': ['ID=268d619f-a8f5-4162-9742-e85ecde84026,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:14.443661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.501064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.503360 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=53baf5e5-852f-4a8b-af1e-806390cac297,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:14.522987 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Checking segment: {'id': '5e10ced6-ee25-4521-bacf-f383b1cbf9b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '4f8f60d3-4189-45a5-91c9-a144dc4cc316'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:14.523879 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network hostable DHCP agents. Network: 4f8f60d3-4189-45a5-91c9-a144dc4cc316, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:14.531723 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cfe3edcd-acfc-4cd9-8ed2-f0bf9c67511c tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1152 time: 2.3352995 Dec 10 14:27:14.534542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55814) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:14.604868 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23870b34-2875-4321-acf5-d0feb63a669a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:14.613238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23870b34-2875-4321-acf5-d0feb63a669a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:14.624325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23870b34-2875-4321-acf5-d0feb63a669a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:14.631121 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-23870b34-2875-4321-acf5-d0feb63a669a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2617 time: 0.0951843 Dec 10 14:27:14.633566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-97046ab1-2d2b-4ecb-9a79-303bc4dea670 None None] Provisioning complete for port 031aa7ee-3392-42f5-a0fe-c20af777a01a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:14.634622 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-97046ab1-2d2b-4ecb-9a79-303bc4dea670 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.639382 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55818) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:14.643048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 4f8f60d3-4189-45a5-91c9-a144dc4cc316 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:14.655992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.679445 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-97046ab1-2d2b-4ecb-9a79-303bc4dea670 None None] Port 031aa7ee-3392-42f5-a0fe-c20af777a01a cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:14.681451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 46e8a41f-90d3-4126-8b7a-af658c911891 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:14.744200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 46e8a41f-90d3-4126-8b7a-af658c911891 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:14.744661 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.763625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3c07f7e7-ccab-408a-a625-67551419384e,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:14.790686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 4f8f60d3-4189-45a5-91c9-a144dc4cc316) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:14.796999 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:14.797654 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.807511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.811888 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d220285f-8845-49c3-acb1-8aabd4d540c9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.9872713 Dec 10 14:27:14.812320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-240f3edc-8726-432d-8d74-cfefd452f61c None None] Network 4f8f60d3-4189-45a5-91c9-a144dc4cc316 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:14.813922 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55822) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:14.819006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2b86a7f0-cc47-48b0-8bc6-7f31a5bdb2bc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'security_group_rule': {'security_group_id': '3c07f7e7-ccab-408a-a625-67551419384e', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:14.846561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1b253375-0a6b-415c-b261-29c2ec217322 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Deleting port 031aa7ee-3392-42f5-a0fe-c20af777a01a {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:14.846917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1b253375-0a6b-415c-b261-29c2ec217322 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.925374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.948101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1b253375-0a6b-415c-b261-29c2ec217322 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.954214 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-4f8f60d3-4189-45a5-91c9-a144dc4cc316', 'network_id': '4f8f60d3-4189-45a5-91c9-a144dc4cc316', 'project_id': '7a25938276dc428b9a5723e37d120269', 'fixed_ips': [{'subnet_id': '53baf5e5-852f-4a8b-af1e-806390cac297'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:14.955086 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:14.961801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=c02f5295-cc2e-4620-8166-844fb3e72fdc,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:14.979616 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cfea4df6-c6af-45fb-96f6-375a818c800d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3860204 Dec 10 14:27:14.979616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1b253375-0a6b-415c-b261-29c2ec217322 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Calling delete_port for 031aa7ee-3392-42f5-a0fe-c20af777a01a owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:14.982915 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55824) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:14.993382 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': '4f8f60d3-4189-45a5-91c9-a144dc4cc316', 'name': 'tempest-PortsTestJSON-1095260356'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:15.159561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b86a7f0-cc47-48b0-8bc6-7f31a5bdb2bc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.185697 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Allocated IP 172.20.0.2 (4f8f60d3-4189-45a5-91c9-a144dc4cc316/53baf5e5-852f-4a8b-af1e-806390cac297/c56e12e0-a446-4676-bc7b-df7129b24405) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:15.210000 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.218038 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1b253375-0a6b-415c-b261-29c2ec217322 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.221337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.235152 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.251919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b86a7f0-cc47-48b0-8bc6-7f31a5bdb2bc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.253941 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b253375-0a6b-415c-b261-29c2ec217322 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event deleted for resources: {'Port': ['ID=031aa7ee-3392-42f5-a0fe-c20af777a01a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:15.346753 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b86a7f0-cc47-48b0-8bc6-7f31a5bdb2bc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.397364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b86a7f0-cc47-48b0-8bc6-7f31a5bdb2bc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c0ef3ec-f8f6-48a1-b578-869665391ebe,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:15.409804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1b253375-0a6b-415c-b261-29c2ec217322 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.417485 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1b253375-0a6b-415c-b261-29c2ec217322 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "DELETE /v2.0/ports/031aa7ee-3392-42f5-a0fe-c20af777a01a HTTP/1.1" status: 204 len: 168 time: 0.7715712 Dec 10 14:27:15.422123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55834) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:15.434968 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Request body: {'port': {'name': 'tempest-new-port-name-815124037', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:15.435366 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.api.validators [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] bootfile-name is not in valid_values {{(pid=103810) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:27:15.435759 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.api.validators [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] tftp-server is not in valid_values {{(pid=103810) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:27:15.436031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.api.validators [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] server-ip-address is not in valid_values {{(pid=103810) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:27:15.446106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.489708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ce47d2-fd47-4f68-9aab-a8a3249f8f49 req-92ae6cf2-6759-4b31-859a-e3e95b528a99 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:15.491670 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e8ce47d2-fd47-4f68-9aab-a8a3249f8f49 req-92ae6cf2-6759-4b31-859a-e3e95b528a99 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1046369 Dec 10 14:27:15.506127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b86a7f0-cc47-48b0-8bc6-7f31a5bdb2bc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.507284 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2b86a7f0-cc47-48b0-8bc6-7f31a5bdb2bc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6918585 Dec 10 14:27:15.515553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55838) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:15.529567 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ddc7d1f2-d187-4e46-a0af-22e90e2fd50a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'security_group_rule': {'security_group_id': '3c07f7e7-ccab-408a-a625-67551419384e', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:15.560576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.578547 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e8ce47d2-fd47-4f68-9aab-a8a3249f8f49 req-b98490c8-f2fd-4de4-bcd3-7d38dbee271c tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0773528 Dec 10 14:27:15.591530 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-ddc7d1f2-d187-4e46-a0af-22e90e2fd50a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 10 14:27:15.591530 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 10 14:27:15.591530 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'project_id_1': '37199cbe89a04c3096fd8e1d31a3df63', 'expiration_1': datetime.datetime(2021, 12, 10, 14, 26, 55, 540970)}] Dec 10 14:27:15.591530 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:27:15.591907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-ddc7d1f2-d187-4e46-a0af-22e90e2fd50a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:27:15.608560 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Network 4f8f60d3-4189-45a5-91c9-a144dc4cc316 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:15.613323 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:15.617483 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:15.630901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Pushing event updated for resources: {'Port': ['ID=c56e12e0-a446-4676-bc7b-df7129b24405,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:15.638515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.639464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.639827 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.640193 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.640529 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.641569 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.641913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.642247 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.642579 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.642923 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.643480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.643814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.644169 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:15.694930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Attempting to bind port c56e12e0-a446-4676-bc7b-df7129b24405 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:15.695379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Attempting to bind port c56e12e0-a446-4676-bc7b-df7129b24405 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '5e10ced6-ee25-4521-bacf-f383b1cbf9b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '4f8f60d3-4189-45a5-91c9-a144dc4cc316'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:15.695685 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Attempting to bind port c56e12e0-a446-4676-bc7b-df7129b24405 on network 4f8f60d3-4189-45a5-91c9-a144dc4cc316 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:15.700963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:15.701340 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Checking segment: {'id': '5e10ced6-ee25-4521-bacf-f383b1cbf9b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '4f8f60d3-4189-45a5-91c9-a144dc4cc316'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:15.701775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.702127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:15.702265 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Bound using segment: {'id': '5e10ced6-ee25-4521-bacf-f383b1cbf9b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '4f8f60d3-4189-45a5-91c9-a144dc4cc316'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:15.702672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Bound port: c56e12e0-a446-4676-bc7b-df7129b24405, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5e10ced6-ee25-4521-bacf-f383b1cbf9b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '4f8f60d3-4189-45a5-91c9-a144dc4cc316'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:15.703057 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.705655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.723336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.743385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 52009993-772b-48ae-81fe-d159369269c5 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:27:15.756691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port 1e255111-41b2-4c67-b297-871b833eec79 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:15.760363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55844) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:15.777505 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] For port c56e12e0-a446-4676-bc7b-df7129b24405, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:15.780733 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] For port c56e12e0-a446-4676-bc7b-df7129b24405, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c56e12e0-a446-4676-bc7b-df7129b24405,segment=NetworkSegment(5e10ced6-ee25-4521-bacf-f383b1cbf9b8),segment_id=5e10ced6-ee25-4521-bacf-f383b1cbf9b8)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:15.828142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Router a5584c5a-aba0-475d-affd-2778e1409c17 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:27:15.846205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:15.924804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8907d1c-1e0c-4971-855e-349078c2577d None None] Pushing event updated for resources: {'Port': ['ID=c56e12e0-a446-4676-bc7b-df7129b24405,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:15.936749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'network': {'name': 'tempest-network-smoke--1937072718', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'port_security_enabled': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:15.954438 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:15.959001 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97455700-a30b-4a9f-8f35-b2d2e63b5ff9 None None] Sync routers for ids ['52009993-772b-48ae-81fe-d159369269c5'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:15.970229 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97455700-a30b-4a9f-8f35-b2d2e63b5ff9 None None] Routers {'52009993-772b-48ae-81fe-d159369269c5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:15.970861 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-97455700-a30b-4a9f-8f35-b2d2e63b5ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['52009993-772b-48ae-81fe-d159369269c5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:15.990802 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fc3894a4-b823-443c-bf7d-829429f5c9a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/52009993-772b-48ae-81fe-d159369269c5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5059052 Dec 10 14:27:15.991514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55848) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:16.014755 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-97455700-a30b-4a9f-8f35-b2d2e63b5ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:16.024499 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97455700-a30b-4a9f-8f35-b2d2e63b5ff9 None None] Routers {'52009993-772b-48ae-81fe-d159369269c5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:16.024844 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cb1f161a-a339-4dbb-bf72-e5acaa7bac93 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=52009993-772b-48ae-81fe-d159369269c5 HTTP/1.1" status: 200 len: 205 time: 0.0320415 Dec 10 14:27:16.025687 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-97455700-a30b-4a9f-8f35-b2d2e63b5ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['52009993-772b-48ae-81fe-d159369269c5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:16.027549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55850) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:16.037138 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:16.041093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.064920 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-97455700-a30b-4a9f-8f35-b2d2e63b5ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:16.065620 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97455700-a30b-4a9f-8f35-b2d2e63b5ff9 None None] The sync data for ids ['52009993-772b-48ae-81fe-d159369269c5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:16.090559 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.158537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2be21dc-4b26-492b-916c-126cdc156354 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.195647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.3 (4f8f60d3-4189-45a5-91c9-a144dc4cc316/53baf5e5-852f-4a8b-af1e-806390cac297/1e255111-41b2-4c67-b297-871b833eec79) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:16.265176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:16.278425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.282150 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f087dd4-da3e-403a-a43a-c3f72872b472 None None] Sync routers for ids ['a5584c5a-aba0-475d-affd-2778e1409c17'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:16.282371 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-70833953-921c-4211-aad6-e2916f626481 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "PUT /v2.0/routers/a5584c5a-aba0-475d-affd-2778e1409c17 HTTP/1.1" status: 200 len: 919 time: 5.3065913 Dec 10 14:27:16.283935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55852) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:16.301103 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f087dd4-da3e-403a-a43a-c3f72872b472 None None] Routers {'a5584c5a-aba0-475d-affd-2778e1409c17'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:16.301896 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7f087dd4-da3e-403a-a43a-c3f72872b472 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a5584c5a-aba0-475d-affd-2778e1409c17'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:16.353744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7f087dd4-da3e-403a-a43a-c3f72872b472 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:16.363695 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f087dd4-da3e-403a-a43a-c3f72872b472 None None] Routers {'a5584c5a-aba0-475d-affd-2778e1409c17'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:16.364308 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7f087dd4-da3e-403a-a43a-c3f72872b472 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a5584c5a-aba0-475d-affd-2778e1409c17'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:16.366495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ddc7d1f2-d187-4e46-a0af-22e90e2fd50a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.373487 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.401927 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7f087dd4-da3e-403a-a43a-c3f72872b472 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:16.402689 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f087dd4-da3e-403a-a43a-c3f72872b472 None None] The sync data for ids ['a5584c5a-aba0-475d-affd-2778e1409c17'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:16.435842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2be21dc-4b26-492b-916c-126cdc156354 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.440724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2be21dc-4b26-492b-916c-126cdc156354 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.470929 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.475027 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.477561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ddc7d1f2-d187-4e46-a0af-22e90e2fd50a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.582065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ddc7d1f2-d187-4e46-a0af-22e90e2fd50a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.590462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event updated for resources: {'Port': ['ID=cd8ce4c1-3c81-4254-8271-41a0d95223ce,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:16.623198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc7d1f2-d187-4e46-a0af-22e90e2fd50a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6cd38dca-9db5-41ba-954b-e1ca4325f5b5,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:16.627023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] In _notify_port_updated(), no bound segment for port cd8ce4c1-3c81-4254-8271-41a0d95223ce on network b144e4a5-9dd6-46d1-803d-970176603256 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:27:16.633377 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:16.634107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.635558 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ce4c55d8-1680-4684-851f-c7bf47522dec tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "PUT /v2.0/ports/cd8ce4c1-3c81-4254-8271-41a0d95223ce HTTP/1.1" status: 200 len: 1136 time: 1.2106645 Dec 10 14:27:16.638159 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55856) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:16.693159 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.733409 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ddc7d1f2-d187-4e46-a0af-22e90e2fd50a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.734859 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ddc7d1f2-d187-4e46-a0af-22e90e2fd50a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 1.2176354 Dec 10 14:27:16.742575 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8018418b-9763-4dfe-8af9-98a1b81ad5fe tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:16.744162 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8018418b-9763-4dfe-8af9-98a1b81ad5fe tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "GET /v2.0/ports/cd8ce4c1-3c81-4254-8271-41a0d95223ce HTTP/1.1" status: 200 len: 1136 time: 0.1049688 Dec 10 14:27:16.749691 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c56e12e0-a446-4676-bc7b-df7129b24405 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:16.751186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55858) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:16.751310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55860) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:16.758432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-3fa95171-520c-4d49-958d-81b01e0f0d11 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'security_group_rule': {'security_group_id': '3c07f7e7-ccab-408a-a625-67551419384e', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:16.791589 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 4f8f60d3-4189-45a5-91c9-a144dc4cc316 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:16.821402 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:16.824886 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:16.829327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c56e12e0-a446-4676-bc7b-df7129b24405 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:16.838443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.884538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.928551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=1e255111-41b2-4c67-b297-871b833eec79,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:16.937343 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:16.940627 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a6b587f2-3a65-42a9-8d3f-e3720a86ad84 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/routers/a5584c5a-aba0-475d-affd-2778e1409c17 HTTP/1.1" status: 200 len: 925 time: 0.6492796 Dec 10 14:27:16.946573 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55862) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:16.960577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec6f560-9b0a-4607-9999-551c5b3a8cc7 req-b20eb5d5-f1e6-445e-97fa-29329c4d1b65 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:16.964735 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5ec6f560-9b0a-4607-9999-551c5b3a8cc7 req-b20eb5d5-f1e6-445e-97fa-29329c4d1b65 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.0805833 Dec 10 14:27:16.964945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f7bf212e-8f2e-4de0-ae3a-830afd27d48d None None] Provisioning complete for port cd8ce4c1-3c81-4254-8271-41a0d95223ce triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:16.964945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7bf212e-8f2e-4de0-ae3a-830afd27d48d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.004893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3fa95171-520c-4d49-958d-81b01e0f0d11 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.013872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port c56e12e0-a446-4676-bc7b-df7129b24405, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c56e12e0-a446-4676-bc7b-df7129b24405,segment=NetworkSegment(5e10ced6-ee25-4521-bacf-f383b1cbf9b8),segment_id=5e10ced6-ee25-4521-bacf-f383b1cbf9b8)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:17.015782 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.030829 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f7bf212e-8f2e-4de0-ae3a-830afd27d48d None None] Port cd8ce4c1-3c81-4254-8271-41a0d95223ce cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:17.046512 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5ec6f560-9b0a-4607-9999-551c5b3a8cc7 req-1a2e4524-1dd6-4516-a098-ffbc7ba94133 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0766556 Dec 10 14:27:17.055475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2be21dc-4b26-492b-916c-126cdc156354 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.055872 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f2be21dc-4b26-492b-916c-126cdc156354 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Fanout notify agent at l3_agent the message router_deleted on router 52009993-772b-48ae-81fe-d159369269c5 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:27:17.077626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2be21dc-4b26-492b-916c-126cdc156354 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.077626 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f2be21dc-4b26-492b-916c-126cdc156354 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/52009993-772b-48ae-81fe-d159369269c5 HTTP/1.1" status: 204 len: 168 time: 1.0450177 Dec 10 14:27:17.077626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] vlan segment allocate from pool success with {'vlan_id': 391, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:17.079831 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55864) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:17.085542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cca085dd-e391-4080-a4cf-eb8756fec695 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:17.089597 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cca085dd-e391-4080-a4cf-eb8756fec695 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=a5584c5a-aba0-475d-affd-2778e1409c17&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1393590 Dec 10 14:27:17.090952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55866) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:17.094043 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:17.094189 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d5de5fb4-d905-4ad0-81a3-14a4d4762b92,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:17.094369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.099563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.141938 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3fa95171-520c-4d49-958d-81b01e0f0d11 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.142565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.144033 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Added segment adfc0116-69c7-41b9-a20f-0f8e0f0c5109 of type vlan for network 041ac3a9-0ca7-4449-9782-639f1235b461 Dec 10 14:27:17.158094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-48bbc859-e182-4287-9b74-1070452ec59a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Deleting port cd8ce4c1-3c81-4254-8271-41a0d95223ce {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:17.158497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-48bbc859-e182-4287-9b74-1070452ec59a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.167958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=c56e12e0-a446-4676-bc7b-df7129b24405,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:17.230879 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.236136 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9b3bc187-c554-4746-ac06-10e8eb9f5dd5 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.2478924 Dec 10 14:27:17.237323 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55868) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:17.239619 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-a47f5cec-6219-4a2b-92e7-a7dfc2b2dd38 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting subnet 095b94f4-22e7-4e8c-b916-8569ce0ad1d7 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:27:17.246060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a47f5cec-6219-4a2b-92e7-a7dfc2b2dd38 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.255902 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37b2adcb-a429-4ae0-b534-bb8e1a3e2f4c None None] Network 4f8f60d3-4189-45a5-91c9-a144dc4cc316 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:17.278141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3fa95171-520c-4d49-958d-81b01e0f0d11 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.297068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-48bbc859-e182-4287-9b74-1070452ec59a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.319516 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a47f5cec-6219-4a2b-92e7-a7dfc2b2dd38 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.355555 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf6cfa36-a9a5-4bf3-9469-dc8a141ab472 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:17.356045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-48bbc859-e182-4287-9b74-1070452ec59a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Calling delete_port for cd8ce4c1-3c81-4254-8271-41a0d95223ce owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:17.360268 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bf6cfa36-a9a5-4bf3-9469-dc8a141ab472 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/networks/d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 881 time: 0.2603219 Dec 10 14:27:17.360464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fa95171-520c-4d49-958d-81b01e0f0d11 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ceb6f81-14fc-4e78-b251-5c2d955cfa1a,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:17.361627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55870) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:17.378299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7ae491d5-61ef-464a-838a-3144ab7cb394 None None] Provisioning complete for port c56e12e0-a446-4676-bc7b-df7129b24405 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:17.378947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7ae491d5-61ef-464a-838a-3144ab7cb394 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.397185 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-94dff9aa-dc7d-4f3e-ad41-47176868bcda tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=a5584c5a-aba0-475d-affd-2778e1409c17 HTTP/1.1" status: 200 len: 205 time: 0.0338426 Dec 10 14:27:17.400121 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55872) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:17.460521 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.466714 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:17.467516 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.575681 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a47f5cec-6219-4a2b-92e7-a7dfc2b2dd38 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.651111 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 1.8867350 Dec 10 14:27:17.656651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55874) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:17.658183 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96440a6-a28b-4141-ae5f-3ac0fff14b2e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Network': ['ID=041ac3a9-0ca7-4449-9782-639f1235b461,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:17.668279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'admin_state_up': True, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:17.678443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 041ac3a9-0ca7-4449-9782-639f1235b461 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:17.718298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3fa95171-520c-4d49-958d-81b01e0f0d11 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.719742 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3fa95171-520c-4d49-958d-81b01e0f0d11 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9675190 Dec 10 14:27:17.723670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55876) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:17.730078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7e599902-ef4b-4a09-ab3e-662d6487ead5 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'security_group_rule': {'security_group_id': '3c07f7e7-ccab-408a-a625-67551419384e', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:17.749360 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.797096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a47f5cec-6219-4a2b-92e7-a7dfc2b2dd38 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.808242 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-8b681de7-389f-4eec-bfb1-bd6b30391214 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 1e255111-41b2-4c67-b297-871b833eec79 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:17.808736 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8b681de7-389f-4eec-bfb1-bd6b30391214 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.850092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a47f5cec-6219-4a2b-92e7-a7dfc2b2dd38 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.857359 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a47f5cec-6219-4a2b-92e7-a7dfc2b2dd38 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/095b94f4-22e7-4e8c-b916-8569ce0ad1d7 HTTP/1.1" status: 204 len: 168 time: 0.7764533 Dec 10 14:27:17.862767 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55878) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:17.863676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47f5cec-6219-4a2b-92e7-a7dfc2b2dd38 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Subnet': ['ID=095b94f4-22e7-4e8c-b916-8569ce0ad1d7,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:17.883653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.890154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.917928 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65696c34-a3cf-4925-a198-5bad5665c340 None None] Network da18baf2-2036-4c07-8911-6bae9632cc69 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:17.982021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8b681de7-389f-4eec-bfb1-bd6b30391214 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:17.996870 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7e599902-ef4b-4a09-ab3e-662d6487ead5 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.003861 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-8b681de7-389f-4eec-bfb1-bd6b30391214 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 1e255111-41b2-4c67-b297-871b833eec79 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:18.006238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-9b44b911-7d18-485f-921d-de45ff2829a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting subnet b4a4ac9a-ad53-4dee-8792-1cd9c66ab275 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:27:18.015603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b44b911-7d18-485f-921d-de45ff2829a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.040611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-522d2ce9-dcd8-4ed4-8486-dc110ea72353 None None] Provisioning complete for port 1e255111-41b2-4c67-b297-871b833eec79 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:18.041252 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-522d2ce9-dcd8-4ed4-8486-dc110ea72353 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.083891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b44b911-7d18-485f-921d-de45ff2829a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.097634 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-48bbc859-e182-4287-9b74-1070452ec59a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.100833 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-522d2ce9-dcd8-4ed4-8486-dc110ea72353 None None] Port 1e255111-41b2-4c67-b297-871b833eec79 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:18.116736 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-522d2ce9-dcd8-4ed4-8486-dc110ea72353 None None] Provisioning complete for port c56e12e0-a446-4676-bc7b-df7129b24405 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:18.117137 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-522d2ce9-dcd8-4ed4-8486-dc110ea72353 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.117627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.161010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48bbc859-e182-4287-9b74-1070452ec59a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event deleted for resources: {'Port': ['ID=cd8ce4c1-3c81-4254-8271-41a0d95223ce,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:18.173693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.212182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7e599902-ef4b-4a09-ab3e-662d6487ead5 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.231142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8374dc4f-314a-4005-9602-2e31bcf2c689 None None] DHCP port deletion for da18baf2-2036-4c07-8911-6bae9632cc69 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:18.295689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7e599902-ef4b-4a09-ab3e-662d6487ead5 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.296573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b44b911-7d18-485f-921d-de45ff2829a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.307880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8374dc4f-314a-4005-9602-2e31bcf2c689 None None] Deleting port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:18.309101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8374dc4f-314a-4005-9602-2e31bcf2c689 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.347582 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e599902-ef4b-4a09-ab3e-662d6487ead5 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=917d979f-92ba-42ef-b28a-0bd24360c9f4,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:18.354624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-48bbc859-e182-4287-9b74-1070452ec59a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.360512 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-48bbc859-e182-4287-9b74-1070452ec59a tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "DELETE /v2.0/ports/cd8ce4c1-3c81-4254-8271-41a0d95223ce HTTP/1.1" status: 204 len: 168 time: 1.6049662 Dec 10 14:27:18.361806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55882) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:18.393482 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8374dc4f-314a-4005-9602-2e31bcf2c689 None None] For port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1b7281c6-bfe2-4fbf-9509-7ed35df38fec,segment=NetworkSegment(2d65ed04-f305-436f-85c3-d65e7a13667a),segment_id=2d65ed04-f305-436f-85c3-d65e7a13667a)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:18.394011 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8374dc4f-314a-4005-9602-2e31bcf2c689 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.418666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8374dc4f-314a-4005-9602-2e31bcf2c689 None None] Calling delete_port for 1b7281c6-bfe2-4fbf-9509-7ed35df38fec owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:18.440577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-92e0f7d0-a260-4ab5-a6a9-f681e946a164 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Deleting subnet 4ef9c004-3d7a-4b01-a773-689bb0248ade {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:27:18.442621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-06b5e362-bb2a-43e8-a184-2c42114b204c None None] Provisioning complete for port 1e255111-41b2-4c67-b297-871b833eec79 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:18.442805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7e599902-ef4b-4a09-ab3e-662d6487ead5 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.442976 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-06b5e362-bb2a-43e8-a184-2c42114b204c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.444097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2ea289-db7b-4576-a56f-2cb15a840ae9 req-20b96b46-c0c8-40ed-99cb-01233460e1fc tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:18.446229 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cc2ea289-db7b-4576-a56f-2cb15a840ae9 req-20b96b46-c0c8-40ed-99cb-01233460e1fc tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2319260 Dec 10 14:27:18.451589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55884) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:18.456140 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7e599902-ef4b-4a09-ab3e-662d6487ead5 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.7313585 Dec 10 14:27:18.457144 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92e0f7d0-a260-4ab5-a6a9-f681e946a164 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.457265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c9b569d2-a674-4525-9812-535e17a70824 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'security_group_rule': {'security_group_id': '3c07f7e7-ccab-408a-a625-67551419384e', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:18.460299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8b681de7-389f-4eec-bfb1-bd6b30391214 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.517912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b44b911-7d18-485f-921d-de45ff2829a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.518891 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-06b5e362-bb2a-43e8-a184-2c42114b204c None None] Port 1e255111-41b2-4c67-b297-871b833eec79 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:18.525978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b681de7-389f-4eec-bfb1-bd6b30391214 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=1e255111-41b2-4c67-b297-871b833eec79,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:18.550821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b44b911-7d18-485f-921d-de45ff2829a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.554363 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9b44b911-7d18-485f-921d-de45ff2829a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/b4a4ac9a-ad53-4dee-8792-1cd9c66ab275 HTTP/1.1" status: 204 len: 168 time: 0.6825998 Dec 10 14:27:18.563659 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55886) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:18.572745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e50d1ba-7330-4906-bab9-bbb4a8bc8f6e None None] Network 974a50ab-ab5c-449b-b2d5-182064cd08ee requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:18.585110 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.securitygroups_db [None req-c9b569d2-a674-4525-9812-535e17a70824 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Project 37199cbe89a04c3096fd8e1d31a3df63 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:27:18.601838 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9b569d2-a674-4525-9812-535e17a70824 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.627939 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8b681de7-389f-4eec-bfb1-bd6b30391214 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.637602 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8b681de7-389f-4eec-bfb1-bd6b30391214 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/1e255111-41b2-4c67-b297-871b833eec79 HTTP/1.1" status: 204 len: 168 time: 1.3991113 Dec 10 14:27:18.639797 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55888) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:18.643613 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92e0f7d0-a260-4ab5-a6a9-f681e946a164 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.646052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b44b911-7d18-485f-921d-de45ff2829a8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Subnet': ['ID=b4a4ac9a-ad53-4dee-8792-1cd9c66ab275,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:18.651299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8374dc4f-314a-4005-9602-2e31bcf2c689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.705130 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8374dc4f-314a-4005-9602-2e31bcf2c689 None None] Pushing event deleted for resources: {'Port': ['ID=1b7281c6-bfe2-4fbf-9509-7ed35df38fec,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:18.708237 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-f430ad41-47e6-4ec0-aefc-e0e44688b8ed tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:27:18.708817 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f430ad41-47e6-4ec0-aefc-e0e44688b8ed tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:27:18.716410 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f430ad41-47e6-4ec0-aefc-e0e44688b8ed tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/1e255111-41b2-4c67-b297-871b833eec79 HTTP/1.1" status: 404 len: 333 time: 0.0755467 Dec 10 14:27:18.717054 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55890) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:18.730712 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cc2ea289-db7b-4576-a56f-2cb15a840ae9 req-8281823c-c899-4f74-bd2a-63e2e045c3c1 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2206662 Dec 10 14:27:18.748162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8374dc4f-314a-4005-9602-2e31bcf2c689 None None] No DVR routers for this DVR port 1b7281c6-bfe2-4fbf-9509-7ed35df38fec on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:18.749999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c56e12e0-a446-4676-bc7b-df7129b24405 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:18.780288 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-5967ebc3-0fcf-4f2d-821b-2eddb5fe3571 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:27:18.785012 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5967ebc3-0fcf-4f2d-821b-2eddb5fe3571 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/1e255111-41b2-4c67-b297-871b833eec79 HTTP/1.1" status: 404 len: 333 time: 0.0626316 Dec 10 14:27:18.785798 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55892) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:18.804111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Deleting port f12ba217-44c1-47b6-8251-54c65cbc58e0 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:18.804964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.822390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.843144 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c56e12e0-a446-4676-bc7b-df7129b24405 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:18.844091 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.886129 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-45a9d2e0-48f6-4e4d-94dd-7ced1aa5663c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet 53baf5e5-852f-4a8b-af1e-806390cac297 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:27:18.892056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-45a9d2e0-48f6-4e4d-94dd-7ced1aa5663c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.921125 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92e0f7d0-a260-4ab5-a6a9-f681e946a164 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.941022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.952540 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9b569d2-a674-4525-9812-535e17a70824 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:18.973982 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adbb5d69-05a4-4e59-9f65-6780a4daa185 None None] DHCP port deletion for 974a50ab-ab5c-449b-b2d5-182064cd08ee request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:18.974513 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-45a9d2e0-48f6-4e4d-94dd-7ced1aa5663c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.027657 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1b7281c6-bfe2-4fbf-9509-7ed35df38fec no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:19.050750 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 1b7281c6-bfe2-4fbf-9509-7ed35df38fec {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:27:19.051483 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1b7281c6-bfe2-4fbf-9509-7ed35df38fec not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:27:19.062152 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-adbb5d69-05a4-4e59-9f65-6780a4daa185 None None] Deleting port 4581a382-f5c0-44b0-9484-1e4a7572ee50 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:19.062539 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-adbb5d69-05a4-4e59-9f65-6780a4daa185 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.072834 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9b569d2-a674-4525-9812-535e17a70824 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.083689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-45a9d2e0-48f6-4e4d-94dd-7ced1aa5663c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.115065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92e0f7d0-a260-4ab5-a6a9-f681e946a164 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.138408 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-adbb5d69-05a4-4e59-9f65-6780a4daa185 None None] For port 4581a382-f5c0-44b0-9484-1e4a7572ee50, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=4581a382-f5c0-44b0-9484-1e4a7572ee50,segment=NetworkSegment(d4c98e4f-31a7-4749-9370-604db6aa94b9),segment_id=d4c98e4f-31a7-4749-9370-604db6aa94b9)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:19.139079 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-adbb5d69-05a4-4e59-9f65-6780a4daa185 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.144816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92e0f7d0-a260-4ab5-a6a9-f681e946a164 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event deleted for resources: {'Subnet': ['ID=4ef9c004-3d7a-4b01-a773-689bb0248ade,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:19.149592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.153813 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92e0f7d0-a260-4ab5-a6a9-f681e946a164 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.157174 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-92e0f7d0-a260-4ab5-a6a9-f681e946a164 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "DELETE /v2.0/subnets/4ef9c004-3d7a-4b01-a773-689bb0248ade HTTP/1.1" status: 204 len: 168 time: 0.7943020 Dec 10 14:27:19.159920 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55894) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:19.160599 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.164316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c3dd50d-089e-4009-b370-dfa4a54b2791 None None] Network b144e4a5-9dd6-46d1-803d-970176603256 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:19.166330 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b569d2-a674-4525-9812-535e17a70824 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2eab6f0b-c5b1-445e-a3df-da6e9a181ec5,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:19.176029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-adbb5d69-05a4-4e59-9f65-6780a4daa185 None None] Calling delete_port for 4581a382-f5c0-44b0-9484-1e4a7572ee50 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:19.189295 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Calling delete_port for f12ba217-44c1-47b6-8251-54c65cbc58e0 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:19.206822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['da18baf2-2036-4c07-8911-6bae9632cc69']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:19.221014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2d65ed04-f305-436f-85c3-d65e7a13667a') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:19.221681 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2d65ed04-f305-436f-85c3-d65e7a13667a') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:19.255652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.273863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.284127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9b569d2-a674-4525-9812-535e17a70824 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.285503 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c9b569d2-a674-4525-9812-535e17a70824 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.8327203 Dec 10 14:27:19.289126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55896) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:19.294072 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-996fc927-f02d-4ea2-82c9-c1a3b1161281 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'security_group_rule': {'security_group_id': '3c07f7e7-ccab-408a-a625-67551419384e', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:19.303043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.325086 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Releasing vlan 374 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:19.325781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:19.329204 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:19.333732 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-45a9d2e0-48f6-4e4d-94dd-7ced1aa5663c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.372599 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a9d2e0-48f6-4e4d-94dd-7ced1aa5663c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=53baf5e5-852f-4a8b-af1e-806390cac297,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:19.373285 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-45a9d2e0-48f6-4e4d-94dd-7ced1aa5663c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.376563 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-45a9d2e0-48f6-4e4d-94dd-7ced1aa5663c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/53baf5e5-852f-4a8b-af1e-806390cac297 HTTP/1.1" status: 204 len: 168 time: 0.5874646 Dec 10 14:27:19.379918 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55898) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:19.383881 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cf8d919-9722-4dd9-bc49-72de14ac7e5b None None] Network 4f8f60d3-4189-45a5-91c9-a144dc4cc316 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:19.404100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-333a3f22-f245-450e-8202-0e5daa233a6e None None] DHCP port deletion for b144e4a5-9dd6-46d1-803d-970176603256 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:19.409260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Deleting port 46e8a41f-90d3-4126-8b7a-af658c911891 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:19.409655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.440102 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-996fc927-f02d-4ea2-82c9-c1a3b1161281 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Project 37199cbe89a04c3096fd8e1d31a3df63 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:27:19.448146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-adbb5d69-05a4-4e59-9f65-6780a4daa185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.486390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-996fc927-f02d-4ea2-82c9-c1a3b1161281 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.499855 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adbb5d69-05a4-4e59-9f65-6780a4daa185 None None] Pushing event deleted for resources: {'Port': ['ID=4581a382-f5c0-44b0-9484-1e4a7572ee50,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:19.511282 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adbb5d69-05a4-4e59-9f65-6780a4daa185 None None] No DVR routers for this DVR port 4581a382-f5c0-44b0-9484-1e4a7572ee50 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:19.546952 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.561928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.564672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] For port 46e8a41f-90d3-4126-8b7a-af658c911891, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=46e8a41f-90d3-4126-8b7a-af658c911891,segment=NetworkSegment(b580f807-2275-4ac5-b411-e38f2f21ed4a),segment_id=b580f807-2275-4ac5-b411-e38f2f21ed4a)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:19.565233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.567714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-333a3f22-f245-450e-8202-0e5daa233a6e None None] Deleting port 46e8a41f-90d3-4126-8b7a-af658c911891 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:19.568073 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-333a3f22-f245-450e-8202-0e5daa233a6e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.574205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.578076 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/networks/da18baf2-2036-4c07-8911-6bae9632cc69 HTTP/1.1" status: 204 len: 168 time: 0.9941175 Dec 10 14:27:19.582562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55900) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:19.587023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Calling delete_port for 46e8a41f-90d3-4126-8b7a-af658c911891 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:19.642193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a6f3b5-93ea-43b4-be8c-c2c67229dbca tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Network': ['ID=da18baf2-2036-4c07-8911-6bae9632cc69,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:19.647803 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.672240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf85330d-8b1d-4a18-a225-642c8e975f5e None None] DHCP port deletion for 4f8f60d3-4189-45a5-91c9-a144dc4cc316 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:19.686054 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-996fc927-f02d-4ea2-82c9-c1a3b1161281 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.686315 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-333a3f22-f245-450e-8202-0e5daa233a6e None None] For port 46e8a41f-90d3-4126-8b7a-af658c911891, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=46e8a41f-90d3-4126-8b7a-af658c911891,segment=NetworkSegment(b580f807-2275-4ac5-b411-e38f2f21ed4a),segment_id=b580f807-2275-4ac5-b411-e38f2f21ed4a)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:19.686982 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-333a3f22-f245-450e-8202-0e5daa233a6e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.712534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.721911 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-333a3f22-f245-450e-8202-0e5daa233a6e None None] Calling delete_port for 46e8a41f-90d3-4126-8b7a-af658c911891 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:19.735045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port c56e12e0-a446-4676-bc7b-df7129b24405 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:19.735393 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.746835 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-996fc927-f02d-4ea2-82c9-c1a3b1161281 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.792949 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-cf85330d-8b1d-4a18-a225-642c8e975f5e None None] Deleting port c56e12e0-a446-4676-bc7b-df7129b24405 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:19.793327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cf85330d-8b1d-4a18-a225-642c8e975f5e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.800639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-996fc927-f02d-4ea2-82c9-c1a3b1161281 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0f07f88d-06a7-428e-a04c-60248d9d5b30,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:19.814538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.819928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.820132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] For port c56e12e0-a446-4676-bc7b-df7129b24405, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c56e12e0-a446-4676-bc7b-df7129b24405,segment=NetworkSegment(5e10ced6-ee25-4521-bacf-f383b1cbf9b8),segment_id=5e10ced6-ee25-4521-bacf-f383b1cbf9b8)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:19.820472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.822933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.842979 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for c56e12e0-a446-4676-bc7b-df7129b24405 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:19.866715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event deleted for resources: {'Port': ['ID=46e8a41f-90d3-4126-8b7a-af658c911891,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:19.872038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] No DVR routers for this DVR port 46e8a41f-90d3-4126-8b7a-af658c911891 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:19.887414 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-cf85330d-8b1d-4a18-a225-642c8e975f5e None None] For port c56e12e0-a446-4676-bc7b-df7129b24405, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c56e12e0-a446-4676-bc7b-df7129b24405,segment=NetworkSegment(5e10ced6-ee25-4521-bacf-f383b1cbf9b8),segment_id=5e10ced6-ee25-4521-bacf-f383b1cbf9b8)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:19.887414 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cf85330d-8b1d-4a18-a225-642c8e975f5e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.897149 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-cf85330d-8b1d-4a18-a225-642c8e975f5e None None] Calling delete_port for c56e12e0-a446-4676-bc7b-df7129b24405 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:19.910458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-333a3f22-f245-450e-8202-0e5daa233a6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.940449 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-333a3f22-f245-450e-8202-0e5daa233a6e None None] Pushing event deleted for resources: {'Port': ['ID=46e8a41f-90d3-4126-8b7a-af658c911891,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:19.942250 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-996fc927-f02d-4ea2-82c9-c1a3b1161281 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:19.943493 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-996fc927-f02d-4ea2-82c9-c1a3b1161281 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.6529415 Dec 10 14:27:19.949056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55904) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:19.954553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'network': {'name': 'tempest-network-smoke--520496968', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'port_security_enabled': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:19.980307 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-333a3f22-f245-450e-8202-0e5daa233a6e None None] No DVR routers for this DVR port 46e8a41f-90d3-4126-8b7a-af658c911891 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:20.038578 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.069648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b144e4a5-9dd6-46d1-803d-970176603256']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:20.085123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b580f807-2275-4ac5-b411-e38f2f21ed4a') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:20.086071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b580f807-2275-4ac5-b411-e38f2f21ed4a') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:20.095304 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.109180 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.114361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cf85330d-8b1d-4a18-a225-642c8e975f5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.121063 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Releasing vlan 350 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:20.121899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:20.125261 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:20.141038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf85330d-8b1d-4a18-a225-642c8e975f5e None None] Pushing event deleted for resources: {'Port': ['ID=c56e12e0-a446-4676-bc7b-df7129b24405,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:20.142149 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Made reservation on behalf of 37199cbe89a04c3096fd8e1d31a3df63 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:20.144860 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf85330d-8b1d-4a18-a225-642c8e975f5e None None] No DVR routers for this DVR port c56e12e0-a446-4676-bc7b-df7129b24405 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:20.146013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.196833 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event deleted for resources: {'Port': ['ID=f12ba217-44c1-47b6-8251-54c65cbc58e0,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:20.207982 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1b802fe-38eb-4601-99b8-77142ccb28cf None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:20.215630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.230548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] vlan segment allocate from pool success with {'vlan_id': 353, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:20.253716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No DVR routers for this DVR port c56e12e0-a446-4676-bc7b-df7129b24405 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:20.256460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=c56e12e0-a446-4676-bc7b-df7129b24405,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:20.281469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.281822 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Added segment aaba56c6-c9a2-4aa8-9651-0a759874ef75 of type vlan for network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b Dec 10 14:27:20.345959 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e5a7758-d892-4594-b742-91ef8abfb124 req-2d4aea42-b28e-4734-9cde-3a8b87eb857c tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:20.347427 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0e5a7758-d892-4594-b742-91ef8abfb124 req-2d4aea42-b28e-4734-9cde-3a8b87eb857c tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.5373683 Dec 10 14:27:20.356980 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.376936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.380662 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.385278 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] 10.222.0.57 "DELETE /v2.0/networks/b144e4a5-9dd6-46d1-803d-970176603256 HTTP/1.1" status: 204 len: 168 time: 1.2238231 Dec 10 14:27:20.396788 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.26.2.108 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/0246a92c-5e97-4dcc-b32d-9fefc0769806) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:20.402864 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-297235b3-bb65-4592-9bf8-54142e46c065 tempest-ExtraDHCPOptionsTestJSON-28142567 tempest-ExtraDHCPOptionsTestJSON-28142567-project] Pushing event deleted for resources: {'Network': ['ID=b144e4a5-9dd6-46d1-803d-970176603256,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:20.407981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.441861 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4f8f60d3-4189-45a5-91c9-a144dc4cc316']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:20.443942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.453331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5e10ced6-ee25-4521-bacf-f383b1cbf9b8') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:20.453715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5e10ced6-ee25-4521-bacf-f383b1cbf9b8') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:20.464068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.465666 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.479618 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.486937 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Releasing vlan 373 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:20.487416 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:20.490669 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:20.583339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['974a50ab-ab5c-449b-b2d5-182064cd08ee']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:20.611448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.618103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:20.619981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.628616 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0e5a7758-d892-4594-b742-91ef8abfb124 req-27c7b51d-dd16-4906-bcb4-b0800399c4d3 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2715020 Dec 10 14:27:20.636502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4c98e4f-31a7-4749-9370-604db6aa94b9') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:20.636777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4c98e4f-31a7-4749-9370-604db6aa94b9') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:20.638272 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 46e8a41f-90d3-4126-8b7a-af658c911891 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:20.639500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.643206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.655642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.668282 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 46e8a41f-90d3-4126-8b7a-af658c911891 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:27:20.668638 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 46e8a41f-90d3-4126-8b7a-af658c911891 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:27:20.669060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4581a382-f5c0-44b0-9484-1e4a7572ee50 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:20.683182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.692982 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 4581a382-f5c0-44b0-9484-1e4a7572ee50 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:27:20.693341 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4581a382-f5c0-44b0-9484-1e4a7572ee50 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:27:20.693799 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c56e12e0-a446-4676-bc7b-df7129b24405 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:20.694606 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.699056 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/networks/4f8f60d3-4189-45a5-91c9-a144dc4cc316 HTTP/1.1" status: 204 len: 168 time: 1.3173225 Dec 10 14:27:20.708366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55908) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:20.710461 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'Network': ['ID=6ba405b9-cdef-4b06-9661-6ad5871b3c6b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:20.715269 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: c56e12e0-a446-4676-bc7b-df7129b24405 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:27:20.715837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c56e12e0-a446-4676-bc7b-df7129b24405 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:27:20.718041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1277881812'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:20.726934 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:20.730817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.731003 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f52a4cef-1910-470b-b598-27613e1eb9e0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Network': ['ID=4f8f60d3-4189-45a5-91c9-a144dc4cc316,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:20.743128 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Releasing vlan 360 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:20.743538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:20.746533 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:20.767404 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.769477 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-aca345ad-8cb0-462c-90a7-c9396837bba9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.8185925 Dec 10 14:27:20.771988 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55910) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:20.777904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'admin_state_up': True, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:20.826171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.826694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Fanout notify agent at l3_agent the message router_deleted on router a5584c5a-aba0-475d-affd-2778e1409c17 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:27:20.835762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.836863 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4edcf6dd-c918-4e72-8325-023f83b23131 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/a5584c5a-aba0-475d-affd-2778e1409c17 HTTP/1.1" status: 204 len: 168 time: 3.4357138 Dec 10 14:27:20.841373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55912) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:20.845942 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-796097351', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:20.932890 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.935822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.937343 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:20.941048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.957651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:20.961395 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/networks/974a50ab-ab5c-449b-b2d5-182064cd08ee HTTP/1.1" status: 204 len: 168 time: 1.3736877 Dec 10 14:27:20.966040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55916) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:20.971417 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-521930366'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:21.000255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931e3e61-e2a1-4389-bd74-52c95ed124cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Network': ['ID=974a50ab-ab5c-449b-b2d5-182064cd08ee,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:21.014318 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55918) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:21.018535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:21.027328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:21.029855 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.031010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.031758 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:21.037453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=0246a92c-5e97-4dcc-b32d-9fefc0769806,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:21.038319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] vlan segment allocate from pool success with {'vlan_id': 372, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:21.047562 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 10 14:27:21.047562 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 10 14:27:21.047562 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'project_id_1': 'e0ad36cdee2c48fba74cb6486de7c888', 'expiration_1': datetime.datetime(2021, 12, 10, 14, 27, 0, 982018)}] Dec 10 14:27:21.047562 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:27:21.048604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:27:21.058053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fafb6b16-f91e-4bf8-8eaf-69aeeee73f04 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:21.074849 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.075311 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Added segment 5aeb1c94-0dd7-47a3-807a-4408a80df695 of type vlan for network b3773060-7a49-4574-8e29-8b143493a66a Dec 10 14:27:21.105893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.106187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-a7da4ead-eb42-49fb-9e30-671d6b6aa7f0 None None] Provisioning complete for port 0246a92c-5e97-4dcc-b32d-9fefc0769806 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:21.106187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a7da4ead-eb42-49fb-9e30-671d6b6aa7f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.121695 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.122942 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.125468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.150893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-a7da4ead-eb42-49fb-9e30-671d6b6aa7f0 None None] Port 0246a92c-5e97-4dcc-b32d-9fefc0769806 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:21.198986 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.275550 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7390d0b0-0d6c-4c37-a591-2594b43a0a0b admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=a639154c129a4dfdb50e09c7c8833d1a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2600574 Dec 10 14:27:21.278205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55922) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:21.306193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.311710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:21.312294 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.403913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.442165 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Network': ['ID=b3773060-7a49-4574-8e29-8b143493a66a,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:21.444354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1f08d54-5f0a-4f64-b17f-427870319654 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.454445 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network b3773060-7a49-4574-8e29-8b143493a66a details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:21.475883 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.491479 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-869c6d77-6d55-4500-a9d8-d9dc0df83901 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.7814612 Dec 10 14:27:21.496957 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55924) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:21.502907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'b3773060-7a49-4574-8e29-8b143493a66a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:21.509137 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1f08d54-5f0a-4f64-b17f-427870319654 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.531487 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.740548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:21.741160 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1f08d54-5f0a-4f64-b17f-427870319654 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.744379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1f08d54-5f0a-4f64-b17f-427870319654 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.744527 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.745603 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c1f08d54-5f0a-4f64-b17f-427870319654 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/40702bab-81a0-4e0d-8b1e-14b1fc2a3d59 HTTP/1.1" status: 204 len: 168 time: 0.4663696 Dec 10 14:27:21.782219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1f08d54-5f0a-4f64-b17f-427870319654 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40702bab-81a0-4e0d-8b1e-14b1fc2a3d59,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:21.797007 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.813170 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] vlan segment allocate from pool success with {'vlan_id': 384, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:21.816925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa58a92-6579-4594-a62c-ecfdf84b8a80 req-4a728d5c-4647-4368-bd95-5dd68e22386d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:21.818525 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2aa58a92-6579-4594-a62c-ecfdf84b8a80 req-4a728d5c-4647-4368-bd95-5dd68e22386d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.0833230 Dec 10 14:27:21.859395 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.862873 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added segment d0822671-f7f9-4b59-9ff6-606e02d7296c of type vlan for network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 Dec 10 14:27:21.863904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:21.868117 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:21.950676 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2aa58a92-6579-4594-a62c-ecfdf84b8a80 req-e918900c-9de4-4525-bf31-069510064437 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0982258 Dec 10 14:27:22.045497 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9d7899bb-a9e2-467f-bfc6-02634a8598ca is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:27:22.169634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:22.182618 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Sync routers for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:22.194029 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:22.195041 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:22.276836 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.281358 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e4c55666-62bc-44d6-b633-c03176e570d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 4.6154420 Dec 10 14:27:22.281723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55938) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:22.317214 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:22.324080 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.353904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.426561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.479155 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.515233 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:27:21Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:22.528440 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.548871 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Checking router: 9d7899bb-a9e2-467f-bfc6-02634a8598ca for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:27:22.556441 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Updating router 9d7899bb-a9e2-467f-bfc6-02634a8598ca port 0246a92c-5e97-4dcc-b32d-9fefc0769806 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:27:22.556624 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-638025ac-e35d-4e46-8b17-24c9b6b3a62a tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?project_id=c0bfba20c10d46e1abb38c3a54bd852b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2692487 Dec 10 14:27:22.557293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.557928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55944) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:22.563324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:22.563911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.587739 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.746229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dfd949c-0fa9-4cca-9cb2-41236e5a2011 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:22.747780 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0dfd949c-0fa9-4cca-9cb2-41236e5a2011 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1888251 Dec 10 14:27:22.750710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55952) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:22.751030 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 1.7837744 Dec 10 14:27:22.751184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55954) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:22.757008 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'subnet': {'network_id': '6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:22.760274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ced6b9-42f4-46fb-9940-51e56e466f52 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Network': ['ID=6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:22.771604 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:22.806487 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cc80e43f-3d95-4849-bbb7-12568323c635 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0518048 Dec 10 14:27:22.807345 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55956) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:22.811663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-652484874', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:22.814517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Allocated IP 172.26.2.191 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/af294fd1-c085-4a25-98af-b92ec5593a0f) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:22.926188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.929541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:22.956858 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55960) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:23.019940 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=8d603f1a-7d82-439b-a752-66f440a6f7ba,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:23.033972 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Checking segment: {'id': '5aeb1c94-0dd7-47a3-807a-4408a80df695', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 372, 'network_id': 'b3773060-7a49-4574-8e29-8b143493a66a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:23.034340 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network hostable DHCP agents. Network: b3773060-7a49-4574-8e29-8b143493a66a, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:23.070269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:23.077260 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.086636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1233365955'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:23.097623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.131976 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network b3773060-7a49-4574-8e29-8b143493a66a is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:23.149208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:23.153567 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:23.157110 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:23.172227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84175a20-7f62-4997-9954-6cb913b29a8a req-66aa6b45-ee6f-4921-9b76-0358b97ba07d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:23.173801 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-84175a20-7f62-4997-9954-6cb913b29a8a req-66aa6b45-ee6f-4921-9b76-0358b97ba07d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1412468 Dec 10 14:27:23.174745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efd93799-94cc-4790-a5f1-5d78b7694332 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:23.185491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'Port': ['ID=af294fd1-c085-4a25-98af-b92ec5593a0f,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:23.199508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:23.202650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.212799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, b3773060-7a49-4574-8e29-8b143493a66a) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:23.219031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:23.220170 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.229522 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47efda4b-a51c-4395-8675-a0fa7643fec1 None None] Network b3773060-7a49-4574-8e29-8b143493a66a requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:23.297578 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.330604 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-53ac7e64-d90c-489c-90c1-c0cf02087d1d None None] Provisioning complete for port af294fd1-c085-4a25-98af-b92ec5593a0f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:23.331253 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-53ac7e64-d90c-489c-90c1-c0cf02087d1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.352518 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-84175a20-7f62-4997-9954-6cb913b29a8a req-2b47c571-20eb-4f1b-9820-eb46c212d551 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1727338 Dec 10 14:27:23.397161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:23.401236 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.404311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-53ac7e64-d90c-489c-90c1-c0cf02087d1d None None] Port af294fd1-c085-4a25-98af-b92ec5593a0f cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:23.409056 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-b3773060-7a49-4574-8e29-8b143493a66a', 'network_id': 'b3773060-7a49-4574-8e29-8b143493a66a', 'project_id': '7a25938276dc428b9a5723e37d120269', 'fixed_ips': [{'subnet_id': '8d603f1a-7d82-439b-a752-66f440a6f7ba'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:23.410163 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.422977 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.423226 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.480799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Allocated IP 172.26.2.218 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/06c5d227-6fb3-478e-a0fb-a2c85432254d) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:23.481135 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Attempting to bind port 0246a92c-5e97-4dcc-b32d-9fefc0769806 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:23.481910 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Attempting to bind port 0246a92c-5e97-4dcc-b32d-9fefc0769806 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:23.482517 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Attempting to bind port 0246a92c-5e97-4dcc-b32d-9fefc0769806 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:23.488083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06f78b0b-30e5-445c-9a91-a7acfa8822d8 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:23.491736 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Pushing event updated for resources: {'Port': ['ID=0246a92c-5e97-4dcc-b32d-9fefc0769806,revision_number=2']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:23.495256 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:23.496013 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:23.496601 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.497180 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:23.497879 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Bound port: 0246a92c-5e97-4dcc-b32d-9fefc0769806, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:23.501917 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.572272 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] For port 0246a92c-5e97-4dcc-b32d-9fefc0769806, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:23.576317 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] For port 0246a92c-5e97-4dcc-b32d-9fefc0769806, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0246a92c-5e97-4dcc-b32d-9fefc0769806,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:23.578898 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.579275 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.579714 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.580051 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.580381 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.580748 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.581313 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.581727 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.582118 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.582760 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.582760 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.583140 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.583463 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:27:23.595702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.618506 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c3b9defd-ae50-4e6b-8285-f2df5fbf0b9c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1173418 Dec 10 14:27:23.635947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55966) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:23.652731 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': 'b3773060-7a49-4574-8e29-8b143493a66a', 'security_groups': [], 'name': 'tempest-PortsTestJSON-214514215'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:23.669279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.680639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.687063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.691717 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.740865 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:23.741842 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:23.755274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Subnet': ['ID=d6900cec-6324-4f02-95fb-5736fd986d4b,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:23.770123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.773773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Allocated IP 172.20.0.2 (b3773060-7a49-4574-8e29-8b143493a66a/8d603f1a-7d82-439b-a752-66f440a6f7ba/f626d3ef-873f-4c54-97a9-1ae67f72c198) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:23.865037 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Checking segment: {'id': 'd0822671-f7f9-4b59-9ff6-606e02d7296c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:23.865586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network hostable DHCP agents. Network: 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:23.876398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] vlan segment allocate from pool success with {'vlan_id': 397, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:23.883284 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5950d8c-178b-462a-b5c6-85173e32b3fe None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:23.894555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.896378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'SecurityGroup': ['ID=202b38d9-8042-4348-bfff-f6423742cdbb,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:23.900962 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1808671-59cc-457e-9640-6a1d266e936a None None] Pushing event updated for resources: {'Port': ['ID=0246a92c-5e97-4dcc-b32d-9fefc0769806,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:23.912513 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:23.916914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Subnet': ['ID=0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:23.920098 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:23.920483 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Added segment 3750ad91-886c-452d-855d-30e37524fa87 of type vlan for network 39fe2720-3149-4d03-a6a8-4d005fde2d99 Dec 10 14:27:23.922418 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Checking segment: {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:23.922851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network hostable DHCP agents. Network: 041ac3a9-0ca7-4449-9782-639f1235b461, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:23.985497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.018352 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-aa516b33-04c0-4100-86f0-6d60d1367804 None None] Provisioning complete for port 0246a92c-5e97-4dcc-b32d-9fefc0769806 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:24.019388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-aa516b33-04c0-4100-86f0-6d60d1367804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.097979 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.107000 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-aa516b33-04c0-4100-86f0-6d60d1367804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.129851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-aa516b33-04c0-4100-86f0-6d60d1367804 None None] For port 0246a92c-5e97-4dcc-b32d-9fefc0769806, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0246a92c-5e97-4dcc-b32d-9fefc0769806,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:24.133278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.139748 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:27:21Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:24.152722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.180471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Network b3773060-7a49-4574-8e29-8b143493a66a is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:24.184466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:24.187618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:24.227156 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-aa516b33-04c0-4100-86f0-6d60d1367804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.232696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Pushing event updated for resources: {'Port': ['ID=f626d3ef-873f-4c54-97a9-1ae67f72c198,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:24.234442 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:24.285432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:24.294695 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b45e0b5-7e20-4f94-9c2f-24cc8ad3bcff None None] The sync data for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv is: [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:27:21Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:24.314197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa516b33-04c0-4100-86f0-6d60d1367804 None None] Pushing event updated for resources: {'Port': ['ID=0246a92c-5e97-4dcc-b32d-9fefc0769806,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:24.325539 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event updated for resources: {'Port': ['ID=06c5d227-6fb3-478e-a0fb-a2c85432254d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:24.331424 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:24.350503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.359313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:24.360323 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0e3d34b-64f8-4129-a970-5c83bc13f64e None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:24.362483 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Attempting to bind port f626d3ef-873f-4c54-97a9-1ae67f72c198 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:24.363013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Attempting to bind port f626d3ef-873f-4c54-97a9-1ae67f72c198 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '5aeb1c94-0dd7-47a3-807a-4408a80df695', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 372, 'network_id': 'b3773060-7a49-4574-8e29-8b143493a66a'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:24.363481 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Attempting to bind port f626d3ef-873f-4c54-97a9-1ae67f72c198 on network b3773060-7a49-4574-8e29-8b143493a66a {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:24.376695 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:24.377241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Checking segment: {'id': '5aeb1c94-0dd7-47a3-807a-4408a80df695', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 372, 'network_id': 'b3773060-7a49-4574-8e29-8b143493a66a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:24.378423 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.378971 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Bound using segment: {'id': '5aeb1c94-0dd7-47a3-807a-4408a80df695', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 372, 'network_id': 'b3773060-7a49-4574-8e29-8b143493a66a'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:24.379567 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Bound port: f626d3ef-873f-4c54-97a9-1ae67f72c198, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5aeb1c94-0dd7-47a3-807a-4408a80df695', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 372, 'network_id': 'b3773060-7a49-4574-8e29-8b143493a66a'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:24.380057 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.418090 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network 041ac3a9-0ca7-4449-9782-639f1235b461 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:24.442098 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-dd4b9efd-ba53-47ed-8c70-7ebe56c7b24c None None] Provisioning complete for port 0246a92c-5e97-4dcc-b32d-9fefc0769806 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:24.442469 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-dd4b9efd-ba53-47ed-8c70-7ebe56c7b24c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.446322 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:24.453654 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.503289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Router bd5934f5-df99-4165-8014-b21160f71cfb is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:27:24.510193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.510413 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] For port f626d3ef-873f-4c54-97a9-1ae67f72c198, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:24.514997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] For port f626d3ef-873f-4c54-97a9-1ae67f72c198, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f626d3ef-873f-4c54-97a9-1ae67f72c198,segment=NetworkSegment(5aeb1c94-0dd7-47a3-807a-4408a80df695),segment_id=5aeb1c94-0dd7-47a3-807a-4408a80df695)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:24.516919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:24.517717 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.586945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:24.591612 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:24.599561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3de759c-a88f-4db0-8c3f-f1c6ddcf53ec None None] Network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:24.613630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 041ac3a9-0ca7-4449-9782-639f1235b461) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:24.613630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:24.613630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.615013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.648338 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:24.649167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.665124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Network': ['ID=39fe2720-3149-4d03-a6a8-4d005fde2d99,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:24.713330 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fea1755-6c52-4981-a093-b2bfa18390e0 None None] Network 041ac3a9-0ca7-4449-9782-639f1235b461 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:24.725929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 39fe2720-3149-4d03-a6a8-4d005fde2d99 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:24.732219 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a978f0d0-5351-4148-90ae-b52562ec9c5b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.9789562 Dec 10 14:27:24.740381 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35a20cfe-ea37-4f87-85a7-17970e07ca2b req-85f23263-393d-4fbb-9823-7d9459241746 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:24.742082 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-35a20cfe-ea37-4f87-85a7-17970e07ca2b req-85f23263-393d-4fbb-9823-7d9459241746 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2840426 Dec 10 14:27:24.757197 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-be217abc-d6fd-4157-9f04-314e60d030ff tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.7874746 Dec 10 14:27:24.760061 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55970) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:24.760061 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:24.780779 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-dfb672ca-77f1-4149-85af-362bc7cff405 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1145165178', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:24.782928 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Sync routers for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:24.884300 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.3 (b3773060-7a49-4574-8e29-8b143493a66a/8d603f1a-7d82-439b-a752-66f440a6f7ba/a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:24.907756 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6e884a6f-4d69-4ea3-b2bb-e51532842f07 None None] Provisioning complete for port 06c5d227-6fb3-478e-a0fb-a2c85432254d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:24.908598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6e884a6f-4d69-4ea3-b2bb-e51532842f07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:24.934405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:24.940000 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:24.953309 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.051753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfb672ca-77f1-4149-85af-362bc7cff405 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.053983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfb672ca-77f1-4149-85af-362bc7cff405 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.111721 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04a1cffa-1692-49ee-b336-c02232bd9042 None None] Pushing event updated for resources: {'Port': ['ID=f626d3ef-873f-4c54-97a9-1ae67f72c198,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:25.172288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.203547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfb672ca-77f1-4149-85af-362bc7cff405 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.209517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.215106 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6ef812bf-bbce-4cc6-82b1-bcb12b3d10c4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 4.4387197 Dec 10 14:27:25.219580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55972) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:25.229091 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63', 'network_id': '6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63', 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'fixed_ips': [{'subnet_id': 'd6900cec-6324-4f02-95fb-5736fd986d4b'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:25.230357 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.236110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6e884a6f-4d69-4ea3-b2bb-e51532842f07 None None] Port 06c5d227-6fb3-478e-a0fb-a2c85432254d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:25.307756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55976) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:25.307912 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-98bae1d6-699d-4f60-93fb-f9c8255009ec tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 2.4988060 Dec 10 14:27:25.309493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfb672ca-77f1-4149-85af-362bc7cff405 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.391828 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.395519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-041ac3a9-0ca7-4449-9782-639f1235b461', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:25.396596 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.541275 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:25.571466 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-35a20cfe-ea37-4f87-85a7-17970e07ca2b req-1d3e520e-ac15-4d89-aed3-74ed44b3ff0a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7939436 Dec 10 14:27:25.609226 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network b3773060-7a49-4574-8e29-8b143493a66a is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:25.620709 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:25.623560 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:25.657096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfb672ca-77f1-4149-85af-362bc7cff405 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.662740 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dfb672ca-77f1-4149-85af-362bc7cff405 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.9108531 Dec 10 14:27:25.679800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55980) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:25.686653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Allocated IP 172.20.0.2 (041ac3a9-0ca7-4449-9782-639f1235b461/0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a/9b75e5f0-a26b-4378-a24a-22245f796466) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:25.725734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'port': {'network_id': '6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63', 'name': 'tempest-RoutersIpV6Test-245679777'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:25.756594 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-21db520d-c90c-4971-b49c-94c5433307a8 tempest-TestNetworkAdvancedServerOps-1660048031 tempest-TestNetworkAdvancedServerOps-1660048031-project-admin] 10.222.0.57 "GET /v2.0/subnets?project_id=37199cbe89a04c3096fd8e1d31a3df63&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.5385132 Dec 10 14:27:25.765773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55982) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:25.802707 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:25.804690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.855782 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:25.860891 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:25.960747 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:26.021483 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-72955362-4d1b-422e-92d0-8d8a9e77ab0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 885 time: 2.3822961 Dec 10 14:27:26.034700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55986) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:26.090218 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Network 041ac3a9-0ca7-4449-9782-639f1235b461 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:26.098012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:26.101905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:26.283070 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:26.287773 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:26.323722 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e285ef0-8841-4dae-8dc1-25a2cc0a8f62 req-6e5878a0-37c7-4ff7-b2d7-08b137f18524 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:26.334039 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8e285ef0-8841-4dae-8dc1-25a2cc0a8f62 req-6e5878a0-37c7-4ff7-b2d7-08b137f18524 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1400170 Dec 10 14:27:26.341132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] device_id is not set on port c9b105cc-327c-423e-a58c-c7d64bb8f971 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:26.493539 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-173881e0-af3d-4861-bea7-e46d89718e32 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:26.493897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-173881e0-af3d-4861-bea7-e46d89718e32 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:26.510390 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8e285ef0-8841-4dae-8dc1-25a2cc0a8f62 req-0ee3e3cd-15b7-4508-83ba-1ac5e99bedb8 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1720815 Dec 10 14:27:26.528848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9aac83d2-3724-430f-b1a7-10f40324d768 None None] Network b3773060-7a49-4574-8e29-8b143493a66a requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:26.610406 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Pushing event updated for resources: {'Port': ['ID=9b75e5f0-a26b-4378-a24a-22245f796466,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:26.630382 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-173881e0-af3d-4861-bea7-e46d89718e32 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:26.648522 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-173881e0-af3d-4861-bea7-e46d89718e32 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:26.775716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Allocated IP 2001:db8::2 (6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63/d6900cec-6324-4f02-95fb-5736fd986d4b/d65b48a3-5269-4044-88c5-19f5ad2556da) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:26.798854 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Attempting to bind port 9b75e5f0-a26b-4378-a24a-22245f796466 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:26.799229 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Attempting to bind port 9b75e5f0-a26b-4378-a24a-22245f796466 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:26.799596 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Attempting to bind port 9b75e5f0-a26b-4378-a24a-22245f796466 on network 041ac3a9-0ca7-4449-9782-639f1235b461 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:26.834352 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f626d3ef-873f-4c54-97a9-1ae67f72c198 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:26.854977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2750d127-d1b0-445a-9530-7513dbf55be1 None None] Provisioning complete for port f626d3ef-873f-4c54-97a9-1ae67f72c198 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:26.855348 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2750d127-d1b0-445a-9530-7513dbf55be1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:26.880389 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:26.880990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Checking segment: {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:26.881169 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:26.881603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Bound using segment: {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:26.882860 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Bound port: 9b75e5f0-a26b-4378-a24a-22245f796466, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:26.883023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:26.955016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-173881e0-af3d-4861-bea7-e46d89718e32 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:26.970914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-fe5c61b0-88a8-45cf-b383-390fa5cb76db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:26.973080 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-fe5c61b0-88a8-45cf-b383-390fa5cb76db service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1098 time: 0.2695293 Dec 10 14:27:27.005801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.043722 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-173881e0-af3d-4861-bea7-e46d89718e32 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:27.073088 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaebe9e2-c69d-47e2-a86e-5ce22cfd6bd6 tempest-TestNetworkAdvancedServerOps-1660048031 tempest-TestNetworkAdvancedServerOps-1660048031-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:27.075160 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-eaebe9e2-c69d-47e2-a86e-5ce22cfd6bd6 tempest-TestNetworkAdvancedServerOps-1660048031 tempest-TestNetworkAdvancedServerOps-1660048031-project-admin] 10.222.0.57 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 1.3044848 Dec 10 14:27:27.085881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55988) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:27.120870 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] For port 9b75e5f0-a26b-4378-a24a-22245f796466, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:27.123940 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6bebc94b-383a-44dc-8226-415ebf7436c1 tempest-TestNetworkAdvancedServerOps-1660048031 tempest-TestNetworkAdvancedServerOps-1660048031-project-admin] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0369222 Dec 10 14:27:27.124608 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55990) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:27.126038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] For port 9b75e5f0-a26b-4378-a24a-22245f796466, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=9b75e5f0-a26b-4378-a24a-22245f796466,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:27.135114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-953920316', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:27.230006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-173881e0-af3d-4861-bea7-e46d89718e32 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.233641 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-173881e0-af3d-4861-bea7-e46d89718e32 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a HTTP/1.1" status: 204 len: 168 time: 1.1973617 Dec 10 14:27:27.236436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55992) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:27.269981 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-e5cf9ca3-d409-46c3-8317-9bada764e1c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:27:27.271558 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e5cf9ca3-d409-46c3-8317-9bada764e1c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a HTTP/1.1" status: 404 len: 333 time: 0.0341494 Dec 10 14:27:27.274397 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 55994) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:27.301781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.342029 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-c98d7817-2d69-46e4-8d95-b408a983dfa1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet 8d603f1a-7d82-439b-a752-66f440a6f7ba {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:27:27.345851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Made reservation on behalf of 37199cbe89a04c3096fd8e1d31a3df63 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:27.349153 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.353991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c98d7817-2d69-46e4-8d95-b408a983dfa1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.364326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-860ecea6-70da-4d9c-8af9-57e1af688622 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:27.365595 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-860ecea6-70da-4d9c-8af9-57e1af688622 service neutron] 10.222.0.39 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 912 time: 0.3803473 Dec 10 14:27:27.421807 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61031511-8e91-4555-9ff0-263a0cb8f3cb None None] Pushing event updated for resources: {'Port': ['ID=9b75e5f0-a26b-4378-a24a-22245f796466,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:27.502214 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c98d7817-2d69-46e4-8d95-b408a983dfa1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.504833 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.517778 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-79d1ef07-b77e-4c70-851e-9e08382e32e1 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 1000 time: 0.1294370 Dec 10 14:27:27.528836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port f626d3ef-873f-4c54-97a9-1ae67f72c198 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:27.538982 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.540930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:23Z', 'revision_number': 3, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:27.746489 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.766746 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Checking router: bd5934f5-df99-4165-8014-b21160f71cfb for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:27:27.766746 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Updating router bd5934f5-df99-4165-8014-b21160f71cfb port af294fd1-c085-4a25-98af-b92ec5593a0f binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:27:27.776764 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.796230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 2001:db8::cd (6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63/d6900cec-6324-4f02-95fb-5736fd986d4b/c9b105cc-327c-423e-a58c-c7d64bb8f971) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:27.833861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2750d127-d1b0-445a-9530-7513dbf55be1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.884290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:27.886148 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:27.891939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:27.900591 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Pushing event updated for resources: {'Port': ['ID=d65b48a3-5269-4044-88c5-19f5ad2556da,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:27.910987 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:28.048676 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-8b1fe1fb-edc1-478b-9ce9-c1ac004b760a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:28.052271 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-8b1fe1fb-edc1-478b-9ce9-c1ac004b760a service neutron] 10.222.0.39 "GET /v2.0/subnets?id=630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 200 len: 850 time: 0.4002666 Dec 10 14:27:28.057556 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 55998) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:28.078825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'subnet': {'network_id': '39fe2720-3149-4d03-a6a8-4d005fde2d99', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:28.080640 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-2750d127-d1b0-445a-9530-7513dbf55be1 None None] For port f626d3ef-873f-4c54-97a9-1ae67f72c198, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f626d3ef-873f-4c54-97a9-1ae67f72c198,segment=NetworkSegment(5aeb1c94-0dd7-47a3-807a-4408a80df695),segment_id=5aeb1c94-0dd7-47a3-807a-4408a80df695)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:28.168832 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c98d7817-2d69-46e4-8d95-b408a983dfa1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.177507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2750d127-d1b0-445a-9530-7513dbf55be1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.235659 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.241690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cd1618-e155-4a7a-bfc2-82987acccc00 req-67155026-88e3-4996-b64b-583242bc6788 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:28.243715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Attempting to bind port d65b48a3-5269-4044-88c5-19f5ad2556da on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:28.244788 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Attempting to bind port d65b48a3-5269-4044-88c5-19f5ad2556da by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'd0822671-f7f9-4b59-9ff6-606e02d7296c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:28.244788 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Attempting to bind port d65b48a3-5269-4044-88c5-19f5ad2556da on network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:28.249851 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e4cd1618-e155-4a7a-bfc2-82987acccc00 req-67155026-88e3-4996-b64b-583242bc6788 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.4714930 Dec 10 14:27:28.261130 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:28.261531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Checking segment: {'id': 'd0822671-f7f9-4b59-9ff6-606e02d7296c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:28.261936 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.262331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Bound using segment: {'id': 'd0822671-f7f9-4b59-9ff6-606e02d7296c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:28.262816 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Bound port: d65b48a3-5269-4044-88c5-19f5ad2556da, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd0822671-f7f9-4b59-9ff6-606e02d7296c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:28.263429 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.336918 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-c5454787-b8a7-4c5f-aae9-1e6f0b03dceb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:28.339477 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-c5454787-b8a7-4c5f-aae9-1e6f0b03dceb service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=1cc2d855-81bd-4d95-a565-455c7130be80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2791111 Dec 10 14:27:28.352897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.378157 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6923a819-8bde-4cca-87dc-ef9894b53db2 None None] Could not find standard attr ID for object a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:27:28.408601 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Router 45744f4c-a5ae-4929-8e07-2115b36d27cf is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:27:28.470397 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] For port d65b48a3-5269-4044-88c5-19f5ad2556da, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:28.474505 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] For port d65b48a3-5269-4044-88c5-19f5ad2556da, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d65b48a3-5269-4044-88c5-19f5ad2556da,segment=NetworkSegment(d0822671-f7f9-4b59-9ff6-606e02d7296c),segment_id=d0822671-f7f9-4b59-9ff6-606e02d7296c)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:28.493083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2750d127-d1b0-445a-9530-7513dbf55be1 None None] Pushing event updated for resources: {'Port': ['ID=f626d3ef-873f-4c54-97a9-1ae67f72c198,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:28.503334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c98d7817-2d69-46e4-8d95-b408a983dfa1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.503334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.559785 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e4cd1618-e155-4a7a-bfc2-82987acccc00 req-fdb4d75f-5510-4d8e-b876-29b41d0a6055 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3089998 Dec 10 14:27:28.561835 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6923a819-8bde-4cca-87dc-ef9894b53db2 None None] Provisioning complete for port f626d3ef-873f-4c54-97a9-1ae67f72c198 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:28.562924 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6923a819-8bde-4cca-87dc-ef9894b53db2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.565043 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:28.568550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.617456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=c9b105cc-327c-423e-a58c-c7d64bb8f971,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:28.625151 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.649442 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.654383 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c98d7817-2d69-46e4-8d95-b408a983dfa1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=8d603f1a-7d82-439b-a752-66f440a6f7ba,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:28.654789 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:27:28.656368 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:27:28.703872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47190151-3bdb-42ba-a1a7-2c5eeccf2937 None None] Network b3773060-7a49-4574-8e29-8b143493a66a requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:28.717106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'Subnet': ['ID=0f3ba970-7746-4f0a-8fc3-e64be22456c1,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:28.724810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c98d7817-2d69-46e4-8d95-b408a983dfa1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.738812 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c98d7817-2d69-46e4-8d95-b408a983dfa1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/8d603f1a-7d82-439b-a752-66f440a6f7ba HTTP/1.1" status: 204 len: 168 time: 1.4632888 Dec 10 14:27:28.747202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56000) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:28.762462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:28.787075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:28.794881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:28.801352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:28.802056 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.840143 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.1 (041ac3a9-0ca7-4449-9782-639f1235b461/0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a/7099f252-8b6b-4127-8ac0-b819a3d01e75) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:28.864044 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:27:28.879965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb23903-413b-4229-852e-2c7fa0b32234 None None] Pushing event updated for resources: {'Port': ['ID=d65b48a3-5269-4044-88c5-19f5ad2556da,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:28.905567 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.909154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Checking segment: {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:28.912207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Network hostable DHCP agents. Network: 6ba405b9-cdef-4b06-9661-6ad5871b3c6b, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:28.925163 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:28.986495 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d35445dc-0654-4191-b312-ee775be94e64 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 927 time: 3.2976871 Dec 10 14:27:28.986768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:28.988726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56002) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:29.000743 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.002179 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-486e44ad-6e4e-4629-80f5-361aba533ba6 None None] Sync routers for ids ['45744f4c-a5ae-4929-8e07-2115b36d27cf'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:29.013316 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-1dea103d-3e71-427d-9e78-5fe5fde5ed53 service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6444192 Dec 10 14:27:29.018398 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-486e44ad-6e4e-4629-80f5-361aba533ba6 None None] Routers {'45744f4c-a5ae-4929-8e07-2115b36d27cf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:29.024826 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-486e44ad-6e4e-4629-80f5-361aba533ba6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['45744f4c-a5ae-4929-8e07-2115b36d27cf'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:29.099411 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Attempting to bind port af294fd1-c085-4a25-98af-b92ec5593a0f on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:29.100121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Attempting to bind port af294fd1-c085-4a25-98af-b92ec5593a0f by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:29.100662 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Attempting to bind port af294fd1-c085-4a25-98af-b92ec5593a0f on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:29.101199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:29.109880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:29.110265 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:29.110672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.111069 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:29.111555 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Bound port: af294fd1-c085-4a25-98af-b92ec5593a0f, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:29.111939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.135260 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-486e44ad-6e4e-4629-80f5-361aba533ba6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:29.159415 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-486e44ad-6e4e-4629-80f5-361aba533ba6 None None] Routers {'45744f4c-a5ae-4929-8e07-2115b36d27cf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:29.160117 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-486e44ad-6e4e-4629-80f5-361aba533ba6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['45744f4c-a5ae-4929-8e07-2115b36d27cf'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:29.202466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] For port af294fd1-c085-4a25-98af-b92ec5593a0f, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:29.206138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] For port af294fd1-c085-4a25-98af-b92ec5593a0f, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=af294fd1-c085-4a25-98af-b92ec5593a0f,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:29.214056 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9e3a2b6-3e2b-4402-8d90-9a69b0b48030 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:29.215752 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3810d6-e967-4e41-9063-1163bb739822 None None] Pushing event updated for resources: {'Port': ['ID=af294fd1-c085-4a25-98af-b92ec5593a0f,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:29.223999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-910ecc2e-b1a3-481f-83c7-c40da44360a6 None None] Network 041ac3a9-0ca7-4449-9782-639f1235b461 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:29.231866 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-486e44ad-6e4e-4629-80f5-361aba533ba6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:29.232813 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-486e44ad-6e4e-4629-80f5-361aba533ba6 None None] The sync data for ids ['45744f4c-a5ae-4929-8e07-2115b36d27cf'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:29.244522 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fdc0966-e318-4411-a0ba-4ef4320a3ed4 None None] DHCP port deletion for b3773060-7a49-4574-8e29-8b143493a66a request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:29.260229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 6ba405b9-cdef-4b06-9661-6ad5871b3c6b) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:29.265661 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:29.266601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.324433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port f626d3ef-873f-4c54-97a9-1ae67f72c198 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:29.324433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.405532 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1c1427c2-af96-4141-b555-9f852e1a8f74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 2.2776625 Dec 10 14:27:29.417017 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56004) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:29.482587 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa314140-0b2d-405f-a10c-3c858e81cb53 None None] Network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:29.504587 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.531474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] For port f626d3ef-873f-4c54-97a9-1ae67f72c198, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f626d3ef-873f-4c54-97a9-1ae67f72c198,segment=NetworkSegment(5aeb1c94-0dd7-47a3-807a-4408a80df695),segment_id=5aeb1c94-0dd7-47a3-807a-4408a80df695)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:29.531842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.548747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.571292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for f626d3ef-873f-4c54-97a9-1ae67f72c198 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:29.581306 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.584538 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-205c490e-2150-4c00-8327-cf11b3bb8e64 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 8.7395637 Dec 10 14:27:29.587280 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56006) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:29.604535 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:29.617268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0246a92c-5e97-4dcc-b32d-9fefc0769806 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:29.674847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdcae1c8-4241-4129-9f93-1e4c2b532aa1 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:29.688008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e76b11e3-2aca-44a7-bde8-b103086078b2 None None] Provisioning complete for port 9b75e5f0-a26b-4378-a24a-22245f796466 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:29.688394 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e76b11e3-2aca-44a7-bde8-b103086078b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.694376 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4e17c116-fc08-41a4-a907-510e93c932f2 req-2ad64c61-2e7b-4db9-8d52-c051d7a2a939 service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6726067 Dec 10 14:27:29.765712 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3810d6-e967-4e41-9063-1163bb739822 None None] Pushing event updated for resources: {'Port': ['ID=af294fd1-c085-4a25-98af-b92ec5593a0f,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:29.774473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:29.775106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:29.802917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.864740 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.886603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:29.891891 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.920008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6fdc0966-e318-4411-a0ba-4ef4320a3ed4 None None] Deleting port f626d3ef-873f-4c54-97a9-1ae67f72c198 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:29.920718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6fdc0966-e318-4411-a0ba-4ef4320a3ed4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:29.995231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.018232 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0246a92c-5e97-4dcc-b32d-9fefc0769806 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:30.018607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.086333 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Subnet': ['ID=bb26c672-9a8a-4e30-9437-db1b88e06953,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:30.227509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.243129 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network 041ac3a9-0ca7-4449-9782-639f1235b461 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:30.293302 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:30.307990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:30.385962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=7099f252-8b6b-4127-8ac0-b819a3d01e75,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:30.404265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Checking segment: {'id': '3750ad91-886c-452d-855d-30e37524fa87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': '39fe2720-3149-4d03-a6a8-4d005fde2d99'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:30.404265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network hostable DHCP agents. Network: 39fe2720-3149-4d03-a6a8-4d005fde2d99, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:30.428342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.440333 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-6fdc0966-e318-4411-a0ba-4ef4320a3ed4 None None] For port f626d3ef-873f-4c54-97a9-1ae67f72c198, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f626d3ef-873f-4c54-97a9-1ae67f72c198,segment=NetworkSegment(5aeb1c94-0dd7-47a3-807a-4408a80df695),segment_id=5aeb1c94-0dd7-47a3-807a-4408a80df695)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:30.440807 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6fdc0966-e318-4411-a0ba-4ef4320a3ed4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.462989 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6fdc0966-e318-4411-a0ba-4ef4320a3ed4 None None] Calling delete_port for f626d3ef-873f-4c54-97a9-1ae67f72c198 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:30.473580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.477402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.515115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cd7e703-d653-4842-a805-1c1c7dd88d92 req-ba799c6b-fb47-43e9-b930-1cdbb603d1b6 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:30.516893 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4cd7e703-d653-4842-a805-1c1c7dd88d92 req-ba799c6b-fb47-43e9-b930-1cdbb603d1b6 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.6911368 Dec 10 14:27:30.560767 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6fdc0966-e318-4411-a0ba-4ef4320a3ed4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.570715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network 39fe2720-3149-4d03-a6a8-4d005fde2d99 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:30.611380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=f626d3ef-873f-4c54-97a9-1ae67f72c198,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:30.613346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No DVR routers for this DVR port f626d3ef-873f-4c54-97a9-1ae67f72c198 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:30.641124 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e76b11e3-2aca-44a7-bde8-b103086078b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.687399 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3a98a3e-17c4-41c6-8f8f-526864c9eca7 None None] Network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:30.690964 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:30.699261 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fdc0966-e318-4411-a0ba-4ef4320a3ed4 None None] Pushing event deleted for resources: {'Port': ['ID=f626d3ef-873f-4c54-97a9-1ae67f72c198,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:30.725073 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fdc0966-e318-4411-a0ba-4ef4320a3ed4 None None] No DVR routers for this DVR port f626d3ef-873f-4c54-97a9-1ae67f72c198 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:30.730218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Deleting port 06c5d227-6fb3-478e-a0fb-a2c85432254d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:30.730551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.745564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 39fe2720-3149-4d03-a6a8-4d005fde2d99) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:30.775681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:30.776410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.807070 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcad41c6-7d61-4926-bf8a-07f4d9b30db1 None None] Network 39fe2720-3149-4d03-a6a8-4d005fde2d99 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:30.852386 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4cd7e703-d653-4842-a805-1c1c7dd88d92 req-204f2528-49e0-4761-94a1-ffc45e5291c2 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2557683 Dec 10 14:27:30.859314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.872229 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.885299 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-211c1421-129b-4234-a590-b896cd7acedf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.8264160 Dec 10 14:27:30.891268 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56012) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:30.898791 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1730364124'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:30.902687 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.909150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Calling delete_port for 06c5d227-6fb3-478e-a0fb-a2c85432254d owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:30.920179 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e76b11e3-2aca-44a7-bde8-b103086078b2 None None] For port 9b75e5f0-a26b-4378-a24a-22245f796466, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=9b75e5f0-a26b-4378-a24a-22245f796466,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:30.932257 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:30.934938 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b3773060-7a49-4574-8e29-8b143493a66a']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:30.945453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5aeb1c94-0dd7-47a3-807a-4408a80df695') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:30.945906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5aeb1c94-0dd7-47a3-807a-4408a80df695') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:30.963029 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.033111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.051252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:31.051470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.055290 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.056808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Releasing vlan 372 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:31.057215 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:31.066975 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:31.076526 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e76b11e3-2aca-44a7-bde8-b103086078b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.087960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] vlan segment allocate from pool success with {'vlan_id': 379, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:31.092292 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.097038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.097436 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Added segment 08ecbe43-f39a-4738-bbee-012cc6c6772a of type vlan for network f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 Dec 10 14:27:31.142683 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.146286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Allocated IP 172.20.0.2 (6ba405b9-cdef-4b06-9661-6ad5871b3c6b/0f3ba970-7746-4f0a-8fc3-e64be22456c1/ca8d956f-a9bd-41fb-8601-a45a40775705) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:31.165126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 9b75e5f0-a26b-4378-a24a-22245f796466 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:31.254614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.260889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:31.261548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.267271 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=c9b105cc-327c-423e-a58c-c7d64bb8f971,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:31.289684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.301354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.305159 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/networks/b3773060-7a49-4574-8e29-8b143493a66a HTTP/1.1" status: 204 len: 168 time: 2.5526721 Dec 10 14:27:31.312134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56014) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:31.320482 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'name': 'tempest-PortsTestJSON-1435250774'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:31.361472 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d255888-ae9e-4c81-beef-2ce88465db90 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Network': ['ID=b3773060-7a49-4574-8e29-8b143493a66a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:31.375465 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76b11e3-2aca-44a7-bde8-b103086078b2 None None] Pushing event updated for resources: {'Port': ['ID=9b75e5f0-a26b-4378-a24a-22245f796466,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:31.382558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Network': ['ID=f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:31.414369 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:31.441689 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Provisioning complete for port 9b75e5f0-a26b-4378-a24a-22245f796466 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:31.442224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.446888 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7bb19071-8c64-4279-9e0c-5be4103832df tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.5542135 Dec 10 14:27:31.447177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56016) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:31.461804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-39fe2720-3149-4d03-a6a8-4d005fde2d99', 'network_id': '39fe2720-3149-4d03-a6a8-4d005fde2d99', 'project_id': '608b3110bcfe4055bf2af3eb17ae415d', 'fixed_ips': [{'subnet_id': 'bb26c672-9a8a-4e30-9437-db1b88e06953'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:31.462850 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.464598 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'subnet': {'network_id': 'f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:31.509508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.513899 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.612386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.620797 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 10 14:27:31.620797 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 10 14:27:31.620797 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'project_id_1': '608b3110bcfe4055bf2af3eb17ae415d', 'expiration_1': datetime.datetime(2021, 12, 10, 14, 27, 11, 571394)}] Dec 10 14:27:31.620797 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:27:31.621408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:27:31.635817 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.669174 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Pushing event deleted for resources: {'Port': ['ID=06c5d227-6fb3-478e-a0fb-a2c85432254d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:31.693973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.703418 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0f702df-c83e-4ba2-bf6e-0b840b7ffcbf None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:31.801639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.803770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.826357 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:31.830508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:31.858093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=7099f252-8b6b-4127-8ac0-b819a3d01e75,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:31.866627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 9b75e5f0-a26b-4378-a24a-22245f796466 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:31.866627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.005238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port 75912115-6b66-4256-a3e1-adf7c5e6c0ed yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:32.052830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.112033 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.121342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.127631 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Allocated IP 2001:db8:0:ffff::2 (39fe2720-3149-4d03-a6a8-4d005fde2d99/bb26c672-9a8a-4e30-9437-db1b88e06953/76a9df83-322a-4e8f-b436-03d2c9bda760) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:32.134037 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.147422 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network 041ac3a9-0ca7-4449-9782-639f1235b461 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:32.152015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:32.154426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:23Z', 'revision_number': 3, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:32.194237 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Provisioning complete for port 7099f252-8b6b-4127-8ac0-b819a3d01e75 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:32.195561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.216268 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a604e1-45db-45d8-b635-9682426e7951 req-913c6c1c-2dae-4e6a-bac4-86d34ddfdf50 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:32.221976 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f9a604e1-45db-45d8-b635-9682426e7951 req-913c6c1c-2dae-4e6a-bac4-86d34ddfdf50 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2451451 Dec 10 14:27:32.243191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0496fccd-75f9-4522-a8c9-bcc8ab5b1bb2 None None] The sync data for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv is: [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:23Z', 'revision_number': 3, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:32.248804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Port 7099f252-8b6b-4127-8ac0-b819a3d01e75 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:32.254006 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.274231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:32.278277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.378926 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Pushing event updated for resources: {'Port': ['ID=ca8d956f-a9bd-41fb-8601-a45a40775705,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:32.391572 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d65b48a3-5269-4044-88c5-19f5ad2556da up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:32.420472 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.471773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:32.476402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:32.480210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:32.538964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.562488 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Attempting to bind port ca8d956f-a9bd-41fb-8601-a45a40775705 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:32.562862 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Attempting to bind port ca8d956f-a9bd-41fb-8601-a45a40775705 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:32.563227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Attempting to bind port ca8d956f-a9bd-41fb-8601-a45a40775705 on network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:32.570616 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:32.570996 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Checking segment: {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:32.571399 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.571909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Bound using segment: {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:32.572391 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Bound port: ca8d956f-a9bd-41fb-8601-a45a40775705, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:32.572775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.587755 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Provisioning complete for port af294fd1-c085-4a25-98af-b92ec5593a0f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:32.588134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.640629 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Router 45744f4c-a5ae-4929-8e07-2115b36d27cf has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:27:32.775819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d65b48a3-5269-4044-88c5-19f5ad2556da triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:32.775819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.830652 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f9a604e1-45db-45d8-b635-9682426e7951 req-f87fcac4-aa44-4c54-a09b-669949346dab tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5287313 Dec 10 14:27:32.843818 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Allocated IP 172.20.0.1 (6ba405b9-cdef-4b06-9661-6ad5871b3c6b/0f3ba970-7746-4f0a-8fc3-e64be22456c1/1aa93550-1de5-47ad-9798-720589f428cb) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:32.847348 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=75912115-6b66-4256-a3e1-adf7c5e6c0ed,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:32.850837 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:32.876326 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:32.881732 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:32.888172 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:32.888836 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.894123 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.898375 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9d7899bb-a9e2-467f-bfc6-02634a8598ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:27:32.917558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] For port ca8d956f-a9bd-41fb-8601-a45a40775705, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:32.922379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] For port ca8d956f-a9bd-41fb-8601-a45a40775705, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ca8d956f-a9bd-41fb-8601-a45a40775705,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:32.940225 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:32.950235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:32.954716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6461a1e-650a-4864-8044-f107fdd026e3 None None] Sync routers for ids ['45744f4c-a5ae-4929-8e07-2115b36d27cf'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:32.955034 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d027ab78-d7e3-434d-8d70-37d2d4e2c02b tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "PUT /v2.0/routers/45744f4c-a5ae-4929-8e07-2115b36d27cf HTTP/1.1" status: 200 len: 709 time: 3.3599207 Dec 10 14:27:32.955600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56022) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:33.014648 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.032560 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6461a1e-650a-4864-8044-f107fdd026e3 None None] Routers {'45744f4c-a5ae-4929-8e07-2115b36d27cf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:33.033259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f6461a1e-650a-4864-8044-f107fdd026e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['45744f4c-a5ae-4929-8e07-2115b36d27cf'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:33.083351 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-976084ab-8127-493b-85aa-441e0493cf53 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 1.7644062 Dec 10 14:27:33.091262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56024) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:33.111320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Network 39fe2720-3149-4d03-a6a8-4d005fde2d99 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:33.118648 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:33.120939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.122912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-87e1c590-346e-4497-a31e-1adbe0ac8636 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.127935 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:33.135199 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f6461a1e-650a-4864-8044-f107fdd026e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:33.145637 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.175525 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-171016cb-6719-4847-8c81-04b8f3d82939 req-52a371c6-9827-46eb-8751-5078885dbbc8 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:33.176982 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-171016cb-6719-4847-8c81-04b8f3d82939 req-52a371c6-9827-46eb-8751-5078885dbbc8 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1709490 Dec 10 14:27:33.228938 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Pushing event updated for resources: {'Port': ['ID=76a9df83-322a-4e8f-b436-03d2c9bda760,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:33.233076 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.281112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.284650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] For port af294fd1-c085-4a25-98af-b92ec5593a0f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=af294fd1-c085-4a25-98af-b92ec5593a0f,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:33.285801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6461a1e-650a-4864-8044-f107fdd026e3 None None] Routers {'45744f4c-a5ae-4929-8e07-2115b36d27cf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:33.286725 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f6461a1e-650a-4864-8044-f107fdd026e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['45744f4c-a5ae-4929-8e07-2115b36d27cf'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:33.355029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Attempting to bind port 76a9df83-322a-4e8f-b436-03d2c9bda760 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:33.355404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Attempting to bind port 76a9df83-322a-4e8f-b436-03d2c9bda760 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '3750ad91-886c-452d-855d-30e37524fa87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': '39fe2720-3149-4d03-a6a8-4d005fde2d99'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:33.355770 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Attempting to bind port 76a9df83-322a-4e8f-b436-03d2c9bda760 on network 39fe2720-3149-4d03-a6a8-4d005fde2d99 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:33.361313 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-171016cb-6719-4847-8c81-04b8f3d82939 req-bdbb24bd-a179-470c-8f4c-bf08bacff91d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1687410 Dec 10 14:27:33.370999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:33.371660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Checking segment: {'id': '3750ad91-886c-452d-855d-30e37524fa87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': '39fe2720-3149-4d03-a6a8-4d005fde2d99'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:33.371800 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.372193 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Bound using segment: {'id': '3750ad91-886c-452d-855d-30e37524fa87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': '39fe2720-3149-4d03-a6a8-4d005fde2d99'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:33.372689 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Bound port: 76a9df83-322a-4e8f-b436-03d2c9bda760, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3750ad91-886c-452d-855d-30e37524fa87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': '39fe2720-3149-4d03-a6a8-4d005fde2d99'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:33.373074 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.378928 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-f6461a1e-650a-4864-8044-f107fdd026e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:33.379583 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6461a1e-650a-4864-8044-f107fdd026e3 None None] The sync data for ids ['45744f4c-a5ae-4929-8e07-2115b36d27cf'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:33.402381 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.404234 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.410113 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.464907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.469331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff6fe961-d142-4471-a565-603a93e103e0 None None] Pushing event updated for resources: {'Port': ['ID=ca8d956f-a9bd-41fb-8601-a45a40775705,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:33.484039 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.488036 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-00573e00-e5ca-477a-8ed2-5c1eb0196346 tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/routers/45744f4c-a5ae-4929-8e07-2115b36d27cf HTTP/1.1" status: 200 len: 744 time: 0.5294094 Dec 10 14:27:33.488677 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56028) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:33.581100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port d65b48a3-5269-4044-88c5-19f5ad2556da, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d65b48a3-5269-4044-88c5-19f5ad2556da,segment=NetworkSegment(d0822671-f7f9-4b59-9ff6-606e02d7296c),segment_id=d0822671-f7f9-4b59-9ff6-606e02d7296c)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:33.590413 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-109852df-0b79-42ec-8546-1b5a364652dc tempest-RoutersIpV6AdminTest-1071890131 tempest-RoutersIpV6AdminTest-1071890131-project-admin] 10.222.0.57 "GET /v2.0/ports?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&device_id=45744f4c-a5ae-4929-8e07-2115b36d27cf HTTP/1.1" status: 200 len: 205 time: 0.0988216 Dec 10 14:27:33.598239 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56030) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:33.624612 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=c9b105cc-327c-423e-a58c-c7d64bb8f971,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:33.643433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:33.695627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Pushing event updated for resources: {'Port': ['ID=af294fd1-c085-4a25-98af-b92ec5593a0f,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:33.713243 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.758668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Provisioning complete for port d65b48a3-5269-4044-88c5-19f5ad2556da triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:33.759403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e2bbf46-3f23-4e67-af0a-bdba212c462d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.768567 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-17a7941b-c571-46f2-a0ee-1918c81bb85f tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=45744f4c-a5ae-4929-8e07-2115b36d27cf HTTP/1.1" status: 200 len: 205 time: 0.1635306 Dec 10 14:27:33.822073 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.objects.ports [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103810) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:27:33.828612 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56032) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:33.830484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f626d3ef-873f-4c54-97a9-1ae67f72c198 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:33.838057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.876963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] For port 76a9df83-322a-4e8f-b436-03d2c9bda760, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:33.886813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: f626d3ef-873f-4c54-97a9-1ae67f72c198 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:27:33.887212 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f626d3ef-873f-4c54-97a9-1ae67f72c198 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:27:33.910876 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] For port 76a9df83-322a-4e8f-b436-03d2c9bda760, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=76a9df83-322a-4e8f-b436-03d2c9bda760,segment=NetworkSegment(3750ad91-886c-452d-855d-30e37524fa87),segment_id=3750ad91-886c-452d-855d-30e37524fa87)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:33.912421 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=d65b48a3-5269-4044-88c5-19f5ad2556da,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:33.980599 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:33.995276 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-72c862a0-3581-435d-b50b-8438e9d6b9c8 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.057687 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Subnet': ['ID=83de442a-78b9-444e-b49e-0a83671e669f,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:34.134299 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:34.160762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d037daa1-7744-4bd0-bffe-384410de612d None None] Provisioning complete for port 7099f252-8b6b-4127-8ac0-b819a3d01e75 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:34.164506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d037daa1-7744-4bd0-bffe-384410de612d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.170092 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbfc02df-bcfb-4869-915f-7cd01942f0ad None None] Pushing event updated for resources: {'Port': ['ID=76a9df83-322a-4e8f-b436-03d2c9bda760,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:34.174180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:34.183388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:34.194935 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Sync routers for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:34.223670 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:34.225284 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:34.238064 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6bff95d5-e88e-4bfd-8de6-67c5be7f735d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/routers/9d7899bb-a9e2-467f-bfc6-02634a8598ca/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.9303119 Dec 10 14:27:34.239497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d037daa1-7744-4bd0-bffe-384410de612d None None] Port 7099f252-8b6b-4127-8ac0-b819a3d01e75 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:34.240850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56038) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:34.242235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Checking segment: {'id': '08ecbe43-f39a-4738-bbee-012cc6c6772a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': 'f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:34.242613 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network hostable DHCP agents. Network: f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:34.267703 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-de2d9af0-9921-42a0-8d32-d5d8352b8473 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 75912115-6b66-4256-a3e1-adf7c5e6c0ed {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:34.268034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de2d9af0-9921-42a0-8d32-d5d8352b8473 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.280528 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d037daa1-7744-4bd0-bffe-384410de612d None None] Provisioning complete for port d65b48a3-5269-4044-88c5-19f5ad2556da triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:34.280528 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d037daa1-7744-4bd0-bffe-384410de612d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.353540 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3fd64c2-7ebc-4dab-bdbe-03076eec8632 req-d66477e3-2bf3-44ee-b7f0-c62f3ad1e1fd tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.355129 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c3fd64c2-7ebc-4dab-bdbe-03076eec8632 req-d66477e3-2bf3-44ee-b7f0-c62f3ad1e1fd tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.8787801 Dec 10 14:27:34.375726 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-72c862a0-3581-435d-b50b-8438e9d6b9c8 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.385266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device af294fd1-c085-4a25-98af-b92ec5593a0f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:34.402673 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'Port': ['ID=1aa93550-1de5-47ad-9798-720589f428cb,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:34.417969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.430130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-72c862a0-3581-435d-b50b-8438e9d6b9c8 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.489504 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:34.501709 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port af294fd1-c085-4a25-98af-b92ec5593a0f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:34.502294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.583388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d037daa1-7744-4bd0-bffe-384410de612d None None] Provisioning complete for port c9b105cc-327c-423e-a58c-c7d64bb8f971 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:34.584059 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d037daa1-7744-4bd0-bffe-384410de612d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.590697 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:34.594937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:34.604617 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de2d9af0-9921-42a0-8d32-d5d8352b8473 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.619239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:34.654592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-de2d9af0-9921-42a0-8d32-d5d8352b8473 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 75912115-6b66-4256-a3e1-adf7c5e6c0ed owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:34.772403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.781665 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.783255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.783822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.784315 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.784771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.785224 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.785721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.787023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.787489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:34.793441 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4bff034c-2b1f-430d-94a7-d8948bc53d88 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 7017 time: 0.5456312 Dec 10 14:27:34.796023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-72c862a0-3581-435d-b50b-8438e9d6b9c8 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.797003 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-72c862a0-3581-435d-b50b-8438e9d6b9c8 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Fanout notify agent at l3_agent the message router_deleted on router 45744f4c-a5ae-4929-8e07-2115b36d27cf {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:27:34.806488 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-72c862a0-3581-435d-b50b-8438e9d6b9c8 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:34.840608 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-72c862a0-3581-435d-b50b-8438e9d6b9c8 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/45744f4c-a5ae-4929-8e07-2115b36d27cf HTTP/1.1" status: 204 len: 168 time: 1.0104387 Dec 10 14:27:34.853376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56042) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:34.854410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56044) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:34.970232 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:27:30Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:31Z', 'revision_number': 2, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:35.012414 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c3fd64c2-7ebc-4dab-bdbe-03076eec8632 req-c92c236e-6901-4daa-9cee-65598630e692 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5028446 Dec 10 14:27:35.046251 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Checking router: 9d7899bb-a9e2-467f-bfc6-02634a8598ca for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:27:35.047318 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Updating router 9d7899bb-a9e2-467f-bfc6-02634a8598ca port 7099f252-8b6b-4127-8ac0-b819a3d01e75 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:27:35.053755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:35.069040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.071182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.095549 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.129786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d037daa1-7744-4bd0-bffe-384410de612d None None] Port c9b105cc-327c-423e-a58c-c7d64bb8f971 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:35.136522 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-793814ad-06c2-488a-88ca-83509b524994 None None] Network f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:35.139942 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6e271de4-1d7d-49e2-b3b8-6da8d7403e1a tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=45744f4c-a5ae-4929-8e07-2115b36d27cf HTTP/1.1" status: 200 len: 205 time: 0.1543267 Dec 10 14:27:35.148803 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56048) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:35.177046 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.178007 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.178699 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.179325 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.179970 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.180792 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.181438 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.182070 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.187705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.187705 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-38674323-5668-41be-b58b-e27d44a0f2fe tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 5856 time: 0.3288090 Dec 10 14:27:35.189887 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1b118a3f-dc28-40fc-b5c1-267184e7cd46 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 3.7350349 Dec 10 14:27:35.190806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56050) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:35.261970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56052) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:35.274293 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'port': {'network_id': 'f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5', 'name': 'tempest-NetworksIpV6TestAttrs-1848809230'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:35.294458 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-ca0df846-eeb4-4f45-ae2f-c4a93d8a03cc tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] delete failed (client error): The resource could not be found. Dec 10 14:27:35.297471 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ca0df846-eeb4-4f45-ae2f-c4a93d8a03cc tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/45744f4c-a5ae-4929-8e07-2115b36d27cf HTTP/1.1" status: 404 len: 336 time: 0.1394236 Dec 10 14:27:35.298927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56054) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:35.385795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 9b75e5f0-a26b-4378-a24a-22245f796466 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:35.400318 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-504bb361-31de-4fee-9532-bc4072da22e6 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=a5584c5a-aba0-475d-affd-2778e1409c17 HTTP/1.1" status: 200 len: 205 time: 0.0857468 Dec 10 14:27:35.413982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56056) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:35.470123 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-aadda5c5-7ee0-4436-b5ff-9d183d5e7327 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.491302 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-1a22c96b-f4b9-4485-8624-75bcf71467c8 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] delete failed (client error): The resource could not be found. Dec 10 14:27:35.493100 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1a22c96b-f4b9-4485-8624-75bcf71467c8 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/a5584c5a-aba0-475d-affd-2778e1409c17 HTTP/1.1" status: 404 len: 336 time: 0.0773959 Dec 10 14:27:35.513819 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56058) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:35.568810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-87928be4-5912-49d3-a6ab-c2e5779fab2d None None] Provisioning complete for port c9b105cc-327c-423e-a58c-c7d64bb8f971 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:35.569180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-87928be4-5912-49d3-a6ab-c2e5779fab2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.638313 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.660142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-87928be4-5912-49d3-a6ab-c2e5779fab2d None None] Port c9b105cc-327c-423e-a58c-c7d64bb8f971 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:35.668782 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5', 'network_id': 'f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5', 'project_id': '608b3110bcfe4055bf2af3eb17ae415d', 'fixed_ips': [{'subnet_id': '83de442a-78b9-444e-b49e-0a83671e669f'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:35.674449 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.684944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 9b75e5f0-a26b-4378-a24a-22245f796466 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:35.685322 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.712762 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5109224b-3df8-4671-b4f7-888c3fd4cb4f tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=e85edf19-4a36-4841-a1e2-a13da94d145d HTTP/1.1" status: 200 len: 205 time: 0.1967635 Dec 10 14:27:35.717969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56062) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:35.732383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c82acd77-977d-4a83-b85b-903ac8ff0c62 None None] Network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:35.748668 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.762586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de2d9af0-9921-42a0-8d32-d5d8352b8473 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.768638 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:35.867402 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-57c4b7c1-d990-442c-9d33-9a634f3d3ebb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:35.868956 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-57c4b7c1-d990-442c-9d33-9a634f3d3ebb service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1098 time: 0.2579815 Dec 10 14:27:36.008480 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 8a0ff370-ce59-491a-bb3e-3757f0043789 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:27:36.010829 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-43b14196-b6fd-4571-bd3c-95dbceb4b416 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] delete failed (client error): The resource could not be found. Dec 10 14:27:36.011912 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-43b14196-b6fd-4571-bd3c-95dbceb4b416 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/e85edf19-4a36-4841-a1e2-a13da94d145d HTTP/1.1" status: 404 len: 336 time: 0.2773221 Dec 10 14:27:36.018132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56064) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:36.021734 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Attempting to bind port 7099f252-8b6b-4127-8ac0-b819a3d01e75 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:36.022113 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Attempting to bind port 7099f252-8b6b-4127-8ac0-b819a3d01e75 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:36.027700 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Attempting to bind port 7099f252-8b6b-4127-8ac0-b819a3d01e75 on network 041ac3a9-0ca7-4449-9782-639f1235b461 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:36.057520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ab344eea-70ef-4a41-975c-ac477432cd5f None None] Provisioning complete for port ca8d956f-a9bd-41fb-8601-a45a40775705 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:36.057520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ab344eea-70ef-4a41-975c-ac477432cd5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:36.057768 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:36.057768 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Checking segment: {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:36.057768 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:36.057768 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Bound using segment: {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:36.057768 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Bound port: 7099f252-8b6b-4127-8ac0-b819a3d01e75, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:36.057768 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:36.073255 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dab97f7a-eaeb-47bb-b547-c82f7afb9ff6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3592 time: 0.8811636 Dec 10 14:27:36.111337 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d51ec44-99ab-44ea-9eef-a820b5d74cd3 None None] Pushing event updated for resources: {'Port': ['ID=7099f252-8b6b-4127-8ac0-b819a3d01e75,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:36.194686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-99761b5f-e27c-4ab8-8fd3-82b68499033a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:36.196203 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-99761b5f-e27c-4ab8-8fd3-82b68499033a service neutron] 10.222.0.39 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 912 time: 0.2783463 Dec 10 14:27:36.251300 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] For port 7099f252-8b6b-4127-8ac0-b819a3d01e75, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:36.259310 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] For port 7099f252-8b6b-4127-8ac0-b819a3d01e75, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7099f252-8b6b-4127-8ac0-b819a3d01e75,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:36.355060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ca8d956f-a9bd-41fb-8601-a45a40775705 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:36.370953 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-34d33117-7b2a-418e-9af1-c51b038274db service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 1000 time: 0.1663339 Dec 10 14:27:36.383769 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:36.414253 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:36.423600 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Allocated IP 2001:db8::f816:3eff:fe1a:4202 (f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5/83de442a-78b9-444e-b49e-0a83671e669f/57227d49-9f4e-4b29-93d1-0ae82bff1f57) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:36.429302 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-608c4f90-b5ee-41a0-9c22-8677c0aed846 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=f392bc21-f597-4d51-ad73-94752bd2ac24 HTTP/1.1" status: 200 len: 205 time: 0.3859644 Dec 10 14:27:36.429302 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de2d9af0-9921-42a0-8d32-d5d8352b8473 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=75912115-6b66-4256-a3e1-adf7c5e6c0ed,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:36.429814 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56068) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:36.459464 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-de2d9af0-9921-42a0-8d32-d5d8352b8473 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:36.459464 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-de2d9af0-9921-42a0-8d32-d5d8352b8473 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/75912115-6b66-4256-a3e1-adf7c5e6c0ed HTTP/1.1" status: 204 len: 168 time: 3.3575284 Dec 10 14:27:36.478435 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56070) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:36.503579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'mac_address': 'fa:16:3e:ec:2d:fa', 'name': 'tempest-PortsTestJSON-1412979381'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:36.531572 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ceb2515-3a93-434b-8c99-b7cf9a415db7 None None] Network 39fe2720-3149-4d03-a6a8-4d005fde2d99 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:36.552255 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d51ec44-99ab-44ea-9eef-a820b5d74cd3 None None] Pushing event updated for resources: {'Port': ['ID=7099f252-8b6b-4127-8ac0-b819a3d01e75,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:36.565914 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:36.566790 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:36.737450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ab344eea-70ef-4a41-975c-ac477432cd5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:36.775287 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:36.826176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:36.829835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:36.853469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb965be5-a13d-4be3-ad90-c43939a7f3f9 req-153a9220-d1e2-45be-8d97-4a9953f4af5d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:36.858256 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cb965be5-a13d-4be3-ad90-c43939a7f3f9 req-153a9220-d1e2-45be-8d97-4a9953f4af5d tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 1.1251988 Dec 10 14:27:36.869650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56072) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:36.880842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:36.896230 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-195611bc-d505-4f49-8db9-75745e130970 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/8a0ff370-ce59-491a-bb3e-3757f0043789/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.9051926 Dec 10 14:27:36.904258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-355f94b7-6436-482c-9283-b5b234337080 None None] Sync routers for ids ['8a0ff370-ce59-491a-bb3e-3757f0043789'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:36.933105 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56074) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:36.962545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-355f94b7-6436-482c-9283-b5b234337080 None None] Routers {'8a0ff370-ce59-491a-bb3e-3757f0043789'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:36.963184 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-355f94b7-6436-482c-9283-b5b234337080 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['8a0ff370-ce59-491a-bb3e-3757f0043789'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:36.970012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d74adc64-e9a8-4f32-8611-2e1bfe22df3c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1531334984', 'description': 'tempest-secgroup-smoke-1531334984 description', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:37.027332 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-5fad8b23-6743-49af-bd17-814744edb458 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] delete failed (client error): The resource could not be found. Dec 10 14:27:37.035493 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5fad8b23-6743-49af-bd17-814744edb458 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/f392bc21-f597-4d51-ad73-94752bd2ac24 HTTP/1.1" status: 404 len: 336 time: 0.5998158 Dec 10 14:27:37.036771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56078) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:37.047512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-b045707d-b5f2-4f7d-8495-231ca05b9d3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:37.052908 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-b045707d-b5f2-4f7d-8495-231ca05b9d3b service neutron] 10.222.0.39 "GET /v2.0/subnets?id=630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 200 len: 850 time: 0.6733906 Dec 10 14:27:37.083101 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-91046364-30d1-4918-854a-90f8fc1bffaa tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=2ec2eb93-7c95-47f2-b8b4-324cfda47ab5 HTTP/1.1" status: 200 len: 205 time: 0.0422184 Dec 10 14:27:37.092602 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-355f94b7-6436-482c-9283-b5b234337080 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:37.095420 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56080) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:37.113588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port ca8d956f-a9bd-41fb-8601-a45a40775705 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:37.114066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.130616 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ab344eea-70ef-4a41-975c-ac477432cd5f None None] For port ca8d956f-a9bd-41fb-8601-a45a40775705, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ca8d956f-a9bd-41fb-8601-a45a40775705,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:37.143685 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] device_id is not set on port 7a0c871e-30f3-418b-9c86-613ceefe1a9a yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:37.146837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-355f94b7-6436-482c-9283-b5b234337080 None None] Routers {'8a0ff370-ce59-491a-bb3e-3757f0043789'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:37.147514 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-355f94b7-6436-482c-9283-b5b234337080 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['8a0ff370-ce59-491a-bb3e-3757f0043789'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:37.173628 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-934ed952-048b-4dcf-a550-a8981e7ecea6 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] delete failed (client error): The resource could not be found. Dec 10 14:27:37.177028 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-934ed952-048b-4dcf-a550-a8981e7ecea6 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/2ec2eb93-7c95-47f2-b8b4-324cfda47ab5 HTTP/1.1" status: 404 len: 336 time: 0.0769742 Dec 10 14:27:37.178178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56082) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:37.195612 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:27:30Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:36Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:37.196969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.api [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 10 14:27:37.196969 dv-neutron-821401-2-hyperv neutron-server[103811]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 10 14:27:37.196969 dv-neutron-821401-2-hyperv neutron-server[103811]: [parameters: {'project_id_1': '7a25938276dc428b9a5723e37d120269', 'expiration_1': datetime.datetime(2021, 12, 10, 14, 27, 17, 133340)}] Dec 10 14:27:37.196969 dv-neutron-821401-2-hyperv neutron-server[103811]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103811) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:27:37.197806 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG oslo_db.api [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:27:37.223060 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-356ec17b-c6c1-44b8-b50b-b2cb70eeb26d tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "GET /v2.0/ports?device_id=8495a697-fa67-4075-9473-6536f238aea6 HTTP/1.1" status: 200 len: 205 time: 0.0402071 Dec 10 14:27:37.223239 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-d814fedd-4085-48ed-9d59-f754c8a8594b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:37.225166 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-d814fedd-4085-48ed-9d59-f754c8a8594b service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=1cc2d855-81bd-4d95-a565-455c7130be80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1427257 Dec 10 14:27:37.226372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56084) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:37.235782 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5029e7e8-6f3e-47c9-96db-91a5fa40e792 None None] The sync data for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv is: [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:27:30Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:36Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:37.309726 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-19213b0e-c851-458d-b79a-50a20ce24ca6 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] delete failed (client error): The resource could not be found. Dec 10 14:27:37.313750 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-19213b0e-c851-458d-b79a-50a20ce24ca6 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/routers/8495a697-fa67-4075-9473-6536f238aea6 HTTP/1.1" status: 404 len: 336 time: 0.0838640 Dec 10 14:27:37.351148 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56086) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:37.358727 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e15ac632-4995-4587-903d-1903d8b3b364 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:37.363142 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e15ac632-4995-4587-903d-1903d8b3b364 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports/c9b105cc-327c-423e-a58c-c7d64bb8f971 HTTP/1.1" status: 200 len: 982 time: 0.4287977 Dec 10 14:27:37.364693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-355f94b7-6436-482c-9283-b5b234337080 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:37.365147 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56088) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:37.369383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-355f94b7-6436-482c-9283-b5b234337080 None None] The sync data for ids ['8a0ff370-ce59-491a-bb3e-3757f0043789'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:37.384581 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d74adc64-e9a8-4f32-8611-2e1bfe22df3c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.436914 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ab344eea-70ef-4a41-975c-ac477432cd5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.450213 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-5211145c-4f0f-4b4b-9122-64bd5f6b63cb service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2090862 Dec 10 14:27:37.514258 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-07d9d14d-dd95-4bd1-983a-7e643a4d1906 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] DELETE failed (client error): The resource could not be found. Dec 10 14:27:37.514729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-07d9d14d-dd95-4bd1-983a-7e643a4d1906 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:27:37.527063 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-07d9d14d-dd95-4bd1-983a-7e643a4d1906 tempest-RoutersIpV6AdminTest-1301864430 tempest-RoutersIpV6AdminTest-1301864430-project] 10.222.0.57 "DELETE /v2.0/subnets/f2a70a35-c6fc-4572-a861-5de01fc40935 HTTP/1.1" status: 404 len: 337 time: 0.1627393 Dec 10 14:27:37.628342 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-78eb7038-37e5-4813-8786-bd6df14cf6c1 req-84a25aca-4627-47ad-821f-c8cb85f16bb6 service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1698394 Dec 10 14:27:37.656627 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cb965be5-a13d-4be3-ad90-c43939a7f3f9 req-48b2d4cf-b4a3-4ac8-8d77-b56494289ca2 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7577679 Dec 10 14:27:37.737852 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.765664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab344eea-70ef-4a41-975c-ac477432cd5f None None] Pushing event updated for resources: {'Port': ['ID=ca8d956f-a9bd-41fb-8601-a45a40775705,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:37.774807 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Provisioning complete for port 1aa93550-1de5-47ad-9798-720589f428cb triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:37.775202 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.820324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.820324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Port 1aa93550-1de5-47ad-9798-720589f428cb cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:37.820571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d74adc64-e9a8-4f32-8611-2e1bfe22df3c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.820657 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.823260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d65b48a3-5269-4044-88c5-19f5ad2556da up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:37.833981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.862357 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Provisioning complete for port ca8d956f-a9bd-41fb-8601-a45a40775705 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:37.862734 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.945181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.946301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.977486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d74adc64-e9a8-4f32-8611-2e1bfe22df3c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:37.980615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:37.996717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Network f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:38.003475 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:38.007795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d65b48a3-5269-4044-88c5-19f5ad2556da triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:38.008172 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.016498 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:38.061517 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Pushing event updated for resources: {'Port': ['ID=57227d49-9f4e-4b29-93d1-0ae82bff1f57,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:38.152679 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Attempting to bind port 57227d49-9f4e-4b29-93d1-0ae82bff1f57 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:38.153468 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Attempting to bind port 57227d49-9f4e-4b29-93d1-0ae82bff1f57 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '08ecbe43-f39a-4738-bbee-012cc6c6772a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': 'f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:38.153468 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Attempting to bind port 57227d49-9f4e-4b29-93d1-0ae82bff1f57 on network f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:38.164768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:38.164932 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Checking segment: {'id': '08ecbe43-f39a-4738-bbee-012cc6c6772a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': 'f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:38.165291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.165715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Bound using segment: {'id': '08ecbe43-f39a-4738-bbee-012cc6c6772a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': 'f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:38.166204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Bound port: 57227d49-9f4e-4b29-93d1-0ae82bff1f57, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '08ecbe43-f39a-4738-bbee-012cc6c6772a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': 'f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:38.166909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.178521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Provisioning complete for port 76a9df83-322a-4e8f-b436-03d2c9bda760 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:38.178853 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.231299 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d74adc64-e9a8-4f32-8611-2e1bfe22df3c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.233933 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d74adc64-e9a8-4f32-8611-2e1bfe22df3c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 1.3352470 Dec 10 14:27:38.233933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d74adc64-e9a8-4f32-8611-2e1bfe22df3c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroup': ['ID=75ce6861-87ca-43bd-a567-4e6d7abbcee4,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:38.235703 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'Port': ['ID=1aa93550-1de5-47ad-9798-720589f428cb,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:38.235869 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56094) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:38.247035 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Allocated IP 2001:db8::f816:3eff:fea2:2f22 (f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5/83de442a-78b9-444e-b49e-0a83671e669f/7a0c871e-30f3-418b-9c86-613ceefe1a9a) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:38.250629 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-db4e67f0-312c-4e9b-9164-811994ca22e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '75ce6861-87ca-43bd-a567-4e6d7abbcee4', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:38.298523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56096) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:38.315218 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.376955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db4e67f0-312c-4e9b-9164-811994ca22e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.423763 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port 37eb85ff-f7a8-4ef0-9557-efd81bc45629 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:38.461443 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:38.470435 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-145f165e-46cc-49d3-a0ab-3d1cdc956388 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.502823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:38.560123 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] For port 57227d49-9f4e-4b29-93d1-0ae82bff1f57, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:38.589230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] For port 57227d49-9f4e-4b29-93d1-0ae82bff1f57, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=57227d49-9f4e-4b29-93d1-0ae82bff1f57,segment=NetworkSegment(08ecbe43-f39a-4738-bbee-012cc6c6772a),segment_id=08ecbe43-f39a-4738-bbee-012cc6c6772a)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:38.596620 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.603244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db4e67f0-312c-4e9b-9164-811994ca22e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.672934 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.676919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] For port 76a9df83-322a-4e8f-b436-03d2c9bda760, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=76a9df83-322a-4e8f-b436-03d2c9bda760,segment=NetworkSegment(3750ad91-886c-452d-855d-30e37524fa87),segment_id=3750ad91-886c-452d-855d-30e37524fa87)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:38.711440 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db4e67f0-312c-4e9b-9164-811994ca22e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.794197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7bb6f0-aab6-4483-91a4-40ade804d5c3 None None] Pushing event updated for resources: {'Port': ['ID=57227d49-9f4e-4b29-93d1-0ae82bff1f57,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:38.795248 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-145f165e-46cc-49d3-a0ab-3d1cdc956388 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.815446 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.821526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db4e67f0-312c-4e9b-9164-811994ca22e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0506533f-7e04-41dc-9247-c234fc119992,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:38.862577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-145f165e-46cc-49d3-a0ab-3d1cdc956388 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.894230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ca8d956f-a9bd-41fb-8601-a45a40775705 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:38.909026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-145f165e-46cc-49d3-a0ab-3d1cdc956388 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=107bc860-eebd-4f9a-a63c-8c2962221a99,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:38.921826 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db4e67f0-312c-4e9b-9164-811994ca22e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.923131 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-db4e67f0-312c-4e9b-9164-811994ca22e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6862051 Dec 10 14:27:38.926746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56102) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:38.941652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-07d82d60-841a-45ca-99fe-23790306a0a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '75ce6861-87ca-43bd-a567-4e6d7abbcee4', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:38.952152 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Provisioning complete for port 7099f252-8b6b-4127-8ac0-b819a3d01e75 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:38.952556 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.967198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:38.974940 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-145f165e-46cc-49d3-a0ab-3d1cdc956388 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=ae76fba39e4448ce889ebd433a151ffd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6749651 Dec 10 14:27:38.982028 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56104) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:39.008887 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Pushing event updated for resources: {'Port': ['ID=76a9df83-322a-4e8f-b436-03d2c9bda760,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:39.053985 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-72fc73a3-cd82-45e9-b120-e8306a664d4b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.055349 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port ca8d956f-a9bd-41fb-8601-a45a40775705 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:39.055834 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.086885 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-72fc73a3-cd82-45e9-b120-e8306a664d4b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.156573 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07d82d60-841a-45ca-99fe-23790306a0a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.238307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-72fc73a3-cd82-45e9-b120-e8306a664d4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.243233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-72fc73a3-cd82-45e9-b120-e8306a664d4b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.249946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.250663 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-72fc73a3-cd82-45e9-b120-e8306a664d4b admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/107bc860-eebd-4f9a-a63c-8c2962221a99 HTTP/1.1" status: 204 len: 168 time: 0.2674999 Dec 10 14:27:39.269913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07d82d60-841a-45ca-99fe-23790306a0a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.285995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72fc73a3-cd82-45e9-b120-e8306a664d4b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=107bc860-eebd-4f9a-a63c-8c2962221a99,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:39.318058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 76a9df83-322a-4e8f-b436-03d2c9bda760 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:39.348200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07d82d60-841a-45ca-99fe-23790306a0a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.386839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07d82d60-841a-45ca-99fe-23790306a0a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c10f9e2-d473-47be-b454-f40e2bf63d19,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:39.432552 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] For port 7099f252-8b6b-4127-8ac0-b819a3d01e75, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7099f252-8b6b-4127-8ac0-b819a3d01e75,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:39.437943 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 76a9df83-322a-4e8f-b436-03d2c9bda760 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:39.438361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.498898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a084cdca-ed43-4dad-bd25-ca852f305e13 req-658868a4-4062-4c42-a766-05823d4969bd tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:39.500415 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a084cdca-ed43-4dad-bd25-ca852f305e13 req-658868a4-4062-4c42-a766-05823d4969bd tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2125237 Dec 10 14:27:39.502742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Router bd5934f5-df99-4165-8014-b21160f71cfb has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:27:39.505984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07d82d60-841a-45ca-99fe-23790306a0a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.507511 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-07d82d60-841a-45ca-99fe-23790306a0a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5797608 Dec 10 14:27:39.510356 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56108) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:39.510736 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.517403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-44c7adbe-fc68-49e8-b5e4-1df3e350729d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '75ce6861-87ca-43bd-a567-4e6d7abbcee4', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:39.555838 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7099f252-8b6b-4127-8ac0-b819a3d01e75 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:39.598979 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.600206 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6adb330e-57e8-4b73-af78-fec93cead444 None None] Pushing event updated for resources: {'Port': ['ID=7099f252-8b6b-4127-8ac0-b819a3d01e75,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:39.625335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 7099f252-8b6b-4127-8ac0-b819a3d01e75 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:39.625735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.633099 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.650762 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44c7adbe-fc68-49e8-b5e4-1df3e350729d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.657666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e4fbff2e-c0c9-45e1-91a0-713db61f62fe None None] Provisioning complete for port 76a9df83-322a-4e8f-b436-03d2c9bda760 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:39.658039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4fbff2e-c0c9-45e1-91a0-713db61f62fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.740294 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44c7adbe-fc68-49e8-b5e4-1df3e350729d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.789033 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a084cdca-ed43-4dad-bd25-ca852f305e13 req-e68208ba-c3d3-4bbd-8333-f43f17c79d3b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2678912 Dec 10 14:27:39.803342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e4fbff2e-c0c9-45e1-91a0-713db61f62fe None None] Provisioning complete for port 1aa93550-1de5-47ad-9798-720589f428cb triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:39.803342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4fbff2e-c0c9-45e1-91a0-713db61f62fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.822494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44c7adbe-fc68-49e8-b5e4-1df3e350729d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.841562 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e4fbff2e-c0c9-45e1-91a0-713db61f62fe None None] Port 1aa93550-1de5-47ad-9798-720589f428cb cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:39.849834 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44c7adbe-fc68-49e8-b5e4-1df3e350729d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b70e7e3a-e670-449a-b390-e474a50cea29,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:39.909850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.933574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44c7adbe-fc68-49e8-b5e4-1df3e350729d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:39.934866 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-44c7adbe-fc68-49e8-b5e4-1df3e350729d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4229577 Dec 10 14:27:39.937879 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56114) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:39.942665 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ee86beef-15f6-4ce0-a780-6e60547f5e1a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '75ce6861-87ca-43bd-a567-4e6d7abbcee4', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:39.988093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:40.009817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.009932 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Sync routers for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:40.010371 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0c844491-d428-49c6-87b3-440d289c0a25 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "PUT /v2.0/routers/bd5934f5-df99-4165-8014-b21160f71cfb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.5830615 Dec 10 14:27:40.052733 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.059399 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:40.061358 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:40.061673 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:40.062192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee86beef-15f6-4ce0-a780-6e60547f5e1a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.076966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:40.135235 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:40.141023 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:40.141966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.155133 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Port': ['ID=7a0c871e-30f3-418b-9c86-613ceefe1a9a,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:40.232179 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56120) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:40.242331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee86beef-15f6-4ce0-a780-6e60547f5e1a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.246817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:40.272236 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:40.276048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:40.282024 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:40.288063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:40.288716 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.305224 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee86beef-15f6-4ce0-a780-6e60547f5e1a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.320980 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9feef1b6-93ae-409d-a8dd-80ea4f06d2b8 None None] Network f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:40.354100 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee86beef-15f6-4ce0-a780-6e60547f5e1a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d9f8fdaa-420b-40bf-b683-b74459c75f67,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:40.365154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=37eb85ff-f7a8-4ef0-9557-efd81bc45629,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:40.378441 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2409abf7-18d6-41ce-bd78-9270ab4744d6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 951 time: 5.1094136 Dec 10 14:27:40.383655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56126) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:40.399940 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee86beef-15f6-4ce0-a780-6e60547f5e1a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.402467 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ee86beef-15f6-4ce0-a780-6e60547f5e1a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4635932 Dec 10 14:27:40.407859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56132) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:40.417598 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9f70459b-b9b9-4815-8c54-631333dd7634 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '75ce6861-87ca-43bd-a567-4e6d7abbcee4', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:40.458248 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-cb1ac9af-bd82-4b79-9362-808f979fe9ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:40.461506 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-cb1ac9af-bd82-4b79-9362-808f979fe9ef service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 1098 time: 0.1199434 Dec 10 14:27:40.472660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e4b30fc5-4759-4a88-a81b-c101d1c6a51d None None] Provisioning complete for port 57227d49-9f4e-4b29-93d1-0ae82bff1f57 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:40.473045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4b30fc5-4759-4a88-a81b-c101d1c6a51d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.489766 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-89d30554-5a8d-4ee9-adad-f237e719f19a admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=f9aa01fe07354a7bb501a9f380ddaed8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2555177 Dec 10 14:27:40.494677 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3a3dbb14-e600-4e90-a5ad-7c85f40e545b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 3.9993196 Dec 10 14:27:40.495980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56140) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:40.509338 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56142) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:40.566398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-5ce9e460-9755-43a6-a5b2-bdce71494b60 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Deleting subnet 83de442a-78b9-444e-b49e-0a83671e669f {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:27:40.602377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ce9e460-9755-43a6-a5b2-bdce71494b60 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.618003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b7eac9-b040-43cd-b72d-5e3df67a9974 req-b14488d5-43c1-4cff-a7a6-4d01ade88b49 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:40.619852 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-92b7eac9-b040-43cd-b72d-5e3df67a9974 req-b14488d5-43c1-4cff-a7a6-4d01ade88b49 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.3224785 Dec 10 14:27:40.692463 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4b30fc5-4759-4a88-a81b-c101d1c6a51d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.703402 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-2beec28b-f572-4dad-8977-004eb76cd267 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:40.705815 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-2beec28b-f572-4dad-8977-004eb76cd267 service neutron] 10.222.0.39 "GET /v2.0/networks?id=1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 200 len: 912 time: 0.2296801 Dec 10 14:27:40.707657 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-736bb802-1a69-4b30-9208-2b85a854e376 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:40.709338 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-736bb802-1a69-4b30-9208-2b85a854e376 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/37eb85ff-f7a8-4ef0-9557-efd81bc45629 HTTP/1.1" status: 200 len: 841 time: 0.1956923 Dec 10 14:27:40.719552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56144) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:40.739192 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f2b0b778-36ce-4700-a0f5-7e3ac708fdb3 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1577567629&fields=id&tenant_id=37199cbe89a04c3096fd8e1d31a3df63 HTTP/1.1" status: 200 len: 267 time: 0.2794328 Dec 10 14:27:40.761870 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e4b30fc5-4759-4a88-a81b-c101d1c6a51d None None] For port 57227d49-9f4e-4b29-93d1-0ae82bff1f57, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=57227d49-9f4e-4b29-93d1-0ae82bff1f57,segment=NetworkSegment(08ecbe43-f39a-4738-bbee-012cc6c6772a),segment_id=08ecbe43-f39a-4738-bbee-012cc6c6772a)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:40.765342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 57227d49-9f4e-4b29-93d1-0ae82bff1f57 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:40.781465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ce9e460-9755-43a6-a5b2-bdce71494b60 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.821396 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:35Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '1aa93550-1de5-47ad-9798-720589f428cb', 'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'mac_address': 'fa:16:3e:ad:c9:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 746, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:31Z', 'updated_at': '2021-12-10T14:27:36Z', 'revision_number': 2, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'subnets': [{'id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:40.852507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4b30fc5-4759-4a88-a81b-c101d1c6a51d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.857701 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Checking router: bd5934f5-df99-4165-8014-b21160f71cfb for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:27:40.858055 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Updating router bd5934f5-df99-4165-8014-b21160f71cfb port 1aa93550-1de5-47ad-9798-720589f428cb binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:27:40.892401 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.921190 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 57227d49-9f4e-4b29-93d1-0ae82bff1f57 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:40.921627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:40.927198 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-1ecd0412-cc4f-4e86-bb77-33bed7f9fd11 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 200 len: 1000 time: 0.2066343 Dec 10 14:27:40.930791 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-9f70459b-b9b9-4815-8c54-631333dd7634 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:27:40.968036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b30fc5-4759-4a88-a81b-c101d1c6a51d None None] Pushing event updated for resources: {'Port': ['ID=57227d49-9f4e-4b29-93d1-0ae82bff1f57,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:40.987981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f70459b-b9b9-4815-8c54-631333dd7634 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.012305 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d091651-6eed-489d-a53f-9006dd38d14c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.030498 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-92b7eac9-b040-43cd-b72d-5e3df67a9974 req-3ee6514e-4dd3-449f-b2e8-a848de3250ae tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3619440 Dec 10 14:27:41.053468 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 76a9df83-322a-4e8f-b436-03d2c9bda760 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:41.091537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f70459b-b9b9-4815-8c54-631333dd7634 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.097398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port c9b105cc-327c-423e-a58c-c7d64bb8f971 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:41.098071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.105568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-023d561b-bd12-415e-8c4d-ebec60916bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:41.111414 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-023d561b-bd12-415e-8c4d-ebec60916bd9 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 200 len: 850 time: 0.1722465 Dec 10 14:27:41.132126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 76a9df83-322a-4e8f-b436-03d2c9bda760 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:41.133121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.158635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-aa13569c-2d79-4ef2-891b-fd55f0f40833 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 37eb85ff-f7a8-4ef0-9557-efd81bc45629 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:41.158977 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aa13569c-2d79-4ef2-891b-fd55f0f40833 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.171739 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-09bdec3e-6709-4c52-b0c4-4ca51cb6b25e None None] Provisioning complete for port 57227d49-9f4e-4b29-93d1-0ae82bff1f57 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:41.172121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-09bdec3e-6709-4c52-b0c4-4ca51cb6b25e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.188135 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f70459b-b9b9-4815-8c54-631333dd7634 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.206928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.254958 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for c9b105cc-327c-423e-a58c-c7d64bb8f971 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:41.268042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f70459b-b9b9-4815-8c54-631333dd7634 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=59ba5586-e86e-4f9c-ac33-e8eafd96c075,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:41.285483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aa13569c-2d79-4ef2-891b-fd55f0f40833 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.292562 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7099f252-8b6b-4127-8ac0-b819a3d01e75 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:41.296372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-667b74ae-5e32-4026-9d61-7910491eb9d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:41.297125 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-667b74ae-5e32-4026-9d61-7910491eb9d7 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=1cc2d855-81bd-4d95-a565-455c7130be80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1782107 Dec 10 14:27:41.303227 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-aa13569c-2d79-4ef2-891b-fd55f0f40833 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 37eb85ff-f7a8-4ef0-9557-efd81bc45629 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:41.366093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d091651-6eed-489d-a53f-9006dd38d14c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.380311 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.384055 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f70459b-b9b9-4815-8c54-631333dd7634 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.385202 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9f70459b-b9b9-4815-8c54-631333dd7634 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.9759042 Dec 10 14:27:41.391794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56146) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:41.397805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-c4348fc4-26f4-4062-88ea-379101e8f4d1 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:41.398373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-be04d7f1-c031-4488-ad82-60a6352c48e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '75ce6861-87ca-43bd-a567-4e6d7abbcee4', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:41.400246 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-c4348fc4-26f4-4062-88ea-379101e8f4d1 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/networks?id=6ba405b9-cdef-4b06-9661-6ad5871b3c6b HTTP/1.1" status: 200 len: 796 time: 0.6388872 Dec 10 14:27:41.415271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 7099f252-8b6b-4127-8ac0-b819a3d01e75 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:41.415641 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.440979 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-09bdec3e-6709-4c52-b0c4-4ca51cb6b25e None None] Provisioning complete for port 7a0c871e-30f3-418b-9c86-613ceefe1a9a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:41.441354 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-09bdec3e-6709-4c52-b0c4-4ca51cb6b25e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.468079 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.476567 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-fa8892a5-146a-4184-9215-c6951ec8ac76 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/quotas/37199cbe89a04c3096fd8e1d31a3df63 HTTP/1.1" status: 200 len: 375 time: 0.0319300 Dec 10 14:27:41.489115 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-09bdec3e-6709-4c52-b0c4-4ca51cb6b25e None None] Port 7a0c871e-30f3-418b-9c86-613ceefe1a9a cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:41.540375 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-4b17f8dd-533c-4df0-ac30-d3f5f05ab9bb service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2350624 Dec 10 14:27:41.587413 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Attempting to bind port 1aa93550-1de5-47ad-9798-720589f428cb on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:41.587988 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Attempting to bind port 1aa93550-1de5-47ad-9798-720589f428cb by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:41.588393 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Attempting to bind port 1aa93550-1de5-47ad-9798-720589f428cb on network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:41.596752 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:41.597264 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Checking segment: {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:41.598140 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.598336 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Bound using segment: {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:41.598925 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Bound port: 1aa93550-1de5-47ad-9798-720589f428cb, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:41.599468 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.607747 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-be04d7f1-c031-4488-ad82-60a6352c48e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:27:41.632506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2bc192d2-ca99-4852-9f8d-673db3d40a6f None None] Provisioning complete for port 7a0c871e-30f3-418b-9c86-613ceefe1a9a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:41.632880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2bc192d2-ca99-4852-9f8d-673db3d40a6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.639034 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aa13569c-2d79-4ef2-891b-fd55f0f40833 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.643564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be04d7f1-c031-4488-ad82-60a6352c48e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.672783 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2bc192d2-ca99-4852-9f8d-673db3d40a6f None None] Port 7a0c871e-30f3-418b-9c86-613ceefe1a9a cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:41.690520 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] For port 1aa93550-1de5-47ad-9798-720589f428cb, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:41.695005 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] For port 1aa93550-1de5-47ad-9798-720589f428cb, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1aa93550-1de5-47ad-9798-720589f428cb,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:41.695870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ce9e460-9755-43a6-a5b2-bdce71494b60 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.702718 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ae823b-4ba6-4efe-9327-5761314bc22c None None] Pushing event updated for resources: {'Port': ['ID=1aa93550-1de5-47ad-9798-720589f428cb,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:41.706343 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-c9580aa7-464c-4144-900f-e18728087b02 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=37199cbe89a04c3096fd8e1d31a3df63&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1823585 Dec 10 14:27:41.712437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa13569c-2d79-4ef2-891b-fd55f0f40833 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=37eb85ff-f7a8-4ef0-9557-efd81bc45629,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:41.743345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-aa13569c-2d79-4ef2-891b-fd55f0f40833 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.749232 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-aa13569c-2d79-4ef2-891b-fd55f0f40833 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/37eb85ff-f7a8-4ef0-9557-efd81bc45629 HTTP/1.1" status: 204 len: 168 time: 0.9376841 Dec 10 14:27:41.756472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56148) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:41.771202 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.805455 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-0f86e843-c4e2-490d-a1cc-2a7b3284a7c7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:27:41.810229 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0f86e843-c4e2-490d-a1cc-2a7b3284a7c7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/37eb85ff-f7a8-4ef0-9557-efd81bc45629 HTTP/1.1" status: 404 len: 333 time: 0.0489261 Dec 10 14:27:41.815097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56150) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:41.821080 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'name': 'tempest-PortsTestJSON-1436616391'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:41.827598 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cae6c339-3260-4f22-bd86-ff73869f88b0 req-c9bb7cec-f768-4136-9ad8-b5b530d6973c service neutron] 10.222.0.39 "GET /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2798975 Dec 10 14:27:41.852605 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:41.853742 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:41.904688 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ae823b-4ba6-4efe-9327-5761314bc22c None None] Pushing event updated for resources: {'Port': ['ID=1aa93550-1de5-47ad-9798-720589f428cb,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:41.909607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be04d7f1-c031-4488-ad82-60a6352c48e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.912321 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-bbcfc606-d247-4578-b72c-60bab62983e5 None None] Provisioning complete for port 1aa93550-1de5-47ad-9798-720589f428cb triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:41.912866 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bbcfc606-d247-4578-b72c-60bab62983e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.935645 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-50ac5651-bc30-44b9-9200-8f3f35677fa5 service neutron] 10.222.0.57 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1935642 Dec 10 14:27:41.938717 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d091651-6eed-489d-a53f-9006dd38d14c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.941299 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d091651-6eed-489d-a53f-9006dd38d14c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:41.942447 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1d091651-6eed-489d-a53f-9006dd38d14c admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/5bcfca9b-3f66-4159-ac88-ef1172b3b515 HTTP/1.1" status: 204 len: 168 time: 1.4400494 Dec 10 14:27:41.976641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d091651-6eed-489d-a53f-9006dd38d14c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5bcfca9b-3f66-4159-ac88-ef1172b3b515,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:42.030538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ce9e460-9755-43a6-a5b2-bdce71494b60 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.071202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ce9e460-9755-43a6-a5b2-bdce71494b60 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Subnet': ['ID=83de442a-78b9-444e-b49e-0a83671e669f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:42.073317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ce9e460-9755-43a6-a5b2-bdce71494b60 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.078647 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:42.079746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56156) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:42.085715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8757dd19-4e92-40bb-aaed-0b5232ba99ea None None] Network f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:42.090061 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5ce9e460-9755-43a6-a5b2-bdce71494b60 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/subnets/83de442a-78b9-444e-b49e-0a83671e669f HTTP/1.1" status: 204 len: 168 time: 1.7019377 Dec 10 14:27:42.119406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.181795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa012c91-1015-451a-8772-eea3be0652d9 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:42.183683 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa012c91-1015-451a-8772-eea3be0652d9 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:42.188746 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=c9b105cc-327c-423e-a58c-c7d64bb8f971,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:42.191719 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fa012c91-1015-451a-8772-eea3be0652d9 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.1101587 Dec 10 14:27:42.198160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:42.201646 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.203810 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be04d7f1-c031-4488-ad82-60a6352c48e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.206213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56158) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:42.265110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bbcfc606-d247-4578-b72c-60bab62983e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.266040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:42.308241 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-3bc987e6-8c2f-4e7e-a363-a24b265775bc service neutron] 10.222.0.57 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3646727 Dec 10 14:27:42.326312 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-bbcfc606-d247-4578-b72c-60bab62983e5 None None] For port 1aa93550-1de5-47ad-9798-720589f428cb, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1aa93550-1de5-47ad-9798-720589f428cb,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:42.411551 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bbcfc606-d247-4578-b72c-60bab62983e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.463573 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be04d7f1-c031-4488-ad82-60a6352c48e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5ce59b5b-096d-4f82-9f37-600889cf9b85,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:42.477395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.487688 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:35Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '1aa93550-1de5-47ad-9798-720589f428cb', 'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'mac_address': 'fa:16:3e:ad:c9:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 746, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:31Z', 'updated_at': '2021-12-10T14:27:41Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'subnets': [{'id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:42.499368 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-838fb821-c985-4e0e-bd05-e9f11f9202bd None None] DHCP port deletion for f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:42.512606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd99457-fa2f-4ca5-ace5-8ce885446008 req-f1f69a2e-aea9-400a-9428-f5dc3c44667b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:42.514328 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0cd99457-fa2f-4ca5-ace5-8ce885446008 req-f1f69a2e-aea9-400a-9428-f5dc3c44667b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.3335068 Dec 10 14:27:42.572900 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be04d7f1-c031-4488-ad82-60a6352c48e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.584647 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-be04d7f1-c031-4488-ad82-60a6352c48e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 1.1902535 Dec 10 14:27:42.587191 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-787b3097-bbf0-45d2-b5c8-6e0f42bd7a6e None None] The sync data for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv is: [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:35Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '1aa93550-1de5-47ad-9798-720589f428cb', 'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'mac_address': 'fa:16:3e:ad:c9:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 746, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:31Z', 'updated_at': '2021-12-10T14:27:41Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'subnets': [{'id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:42.618587 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbcfc606-d247-4578-b72c-60bab62983e5 None None] Pushing event updated for resources: {'Port': ['ID=1aa93550-1de5-47ad-9798-720589f428cb,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:42.642753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2f1eba61-d75d-4257-a520-a6f5478a59b7 None None] Provisioning complete for port 1aa93550-1de5-47ad-9798-720589f428cb triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:42.645838 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2f1eba61-d75d-4257-a520-a6f5478a59b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.720114 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 57227d49-9f4e-4b29-93d1-0ae82bff1f57 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:42.772048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-12d75b83-4bc6-4047-87b9-b04b11ef53b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.827535 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-12d75b83-4bc6-4047-87b9-b04b11ef53b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): There was a conflict when trying to complete your request. Dec 10 14:27:42.832939 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-12d75b83-4bc6-4047-87b9-b04b11ef53b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:27:42.836826 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-12d75b83-4bc6-4047-87b9-b04b11ef53b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 HTTP/1.1" status: 409 len: 405 time: 0.6173625 Dec 10 14:27:42.852958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56166) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:42.858090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1144552031'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:42.885753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-838fb821-c985-4e0e-bd05-e9f11f9202bd None None] Deleting port 57227d49-9f4e-4b29-93d1-0ae82bff1f57 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:42.885864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-838fb821-c985-4e0e-bd05-e9f11f9202bd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:42.935937 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0cd99457-fa2f-4ca5-ace5-8ce885446008 req-3a5fd838-048f-4cc4-a27a-5d8a18dbd898 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2179966 Dec 10 14:27:42.943770 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 8a0ff370-ce59-491a-bb3e-3757f0043789 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:27:42.956984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.016989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:43.022930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.083021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:43.096829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] vlan segment allocate from pool success with {'vlan_id': 388, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:43.100093 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0f03188c-b8c8-4a62-8726-d9fba057a79e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/8a0ff370-ce59-491a-bb3e-3757f0043789/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7166378 Dec 10 14:27:43.105392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56182) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:43.158610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c45499f9-f762-47c8-ad08-ea2f66a8c4ab None None] Sync routers for ids ['8a0ff370-ce59-491a-bb3e-3757f0043789'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:43.165068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.165455 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Added segment 81dfbe5f-b26f-4202-bc76-1321bca680f6 of type vlan for network 0b95be25-9999-4628-a5fb-a4544733468b Dec 10 14:27:43.170611 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-39439a56-1b1e-4105-a8d3-44a617465042 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1531334984&fields=id&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 267 time: 0.0856197 Dec 10 14:27:43.181924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.206217 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.209264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-838fb821-c985-4e0e-bd05-e9f11f9202bd None None] For port 57227d49-9f4e-4b29-93d1-0ae82bff1f57, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=57227d49-9f4e-4b29-93d1-0ae82bff1f57,segment=NetworkSegment(08ecbe43-f39a-4738-bbee-012cc6c6772a),segment_id=08ecbe43-f39a-4738-bbee-012cc6c6772a)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:43.209708 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-838fb821-c985-4e0e-bd05-e9f11f9202bd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.229623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c45499f9-f762-47c8-ad08-ea2f66a8c4ab None None] Routers {'8a0ff370-ce59-491a-bb3e-3757f0043789'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:43.230268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c45499f9-f762-47c8-ad08-ea2f66a8c4ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['8a0ff370-ce59-491a-bb3e-3757f0043789'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:43.240735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-838fb821-c985-4e0e-bd05-e9f11f9202bd None None] Calling delete_port for 57227d49-9f4e-4b29-93d1-0ae82bff1f57 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:43.299790 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c45499f9-f762-47c8-ad08-ea2f66a8c4ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:43.362930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 57227d49-9f4e-4b29-93d1-0ae82bff1f57, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=57227d49-9f4e-4b29-93d1-0ae82bff1f57,segment=NetworkSegment(08ecbe43-f39a-4738-bbee-012cc6c6772a),segment_id=08ecbe43-f39a-4738-bbee-012cc6c6772a)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:43.365439 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c45499f9-f762-47c8-ad08-ea2f66a8c4ab None None] Routers {'8a0ff370-ce59-491a-bb3e-3757f0043789'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:43.366738 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c45499f9-f762-47c8-ad08-ea2f66a8c4ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['8a0ff370-ce59-491a-bb3e-3757f0043789'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:43.379035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:43.385561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.389119 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:43.389269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-3e96b9c6-276a-40f4-ad93-1c5c7237d794 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:43.394533 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-3e96b9c6-276a-40f4-ad93-1c5c7237d794 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/networks?id=041ac3a9-0ca7-4449-9782-639f1235b461 HTTP/1.1" status: 200 len: 797 time: 0.2074704 Dec 10 14:27:43.406772 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-c45499f9-f762-47c8-ad08-ea2f66a8c4ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:43.412461 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c45499f9-f762-47c8-ad08-ea2f66a8c4ab None None] The sync data for ids ['8a0ff370-ce59-491a-bb3e-3757f0043789'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:43.414010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:43.416677 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-ad334632-4185-4407-a9d7-9578e2a4b6b2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/quotas/c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 375 time: 0.0190103 Dec 10 14:27:43.419771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:43.420402 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.468453 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.515916 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:43.563718 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-2dacd4a7-7766-4637-9b91-bfad0b13f4da tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] remove_router_interface failed (client error): The resource could not be found. Dec 10 14:27:43.565966 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2dacd4a7-7766-4637-9b91-bfad0b13f4da tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/8a0ff370-ce59-491a-bb3e-3757f0043789/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.4593098 Dec 10 14:27:43.566565 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=57227d49-9f4e-4b29-93d1-0ae82bff1f57,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:43.572558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56192) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:43.579788 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-838fb821-c985-4e0e-bd05-e9f11f9202bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.603430 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4626921e-260a-4d18-b5e0-42ff351e1380 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=8a0ff370-ce59-491a-bb3e-3757f0043789 HTTP/1.1" status: 200 len: 205 time: 0.0268059 Dec 10 14:27:43.605386 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0804cdb8-23a0-4c20-bc07-7db9f178a6eb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 1.7887466 Dec 10 14:27:43.606008 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56194) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:43.612302 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56196) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:43.616384 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-838fb821-c985-4e0e-bd05-e9f11f9202bd None None] Pushing event deleted for resources: {'Port': ['ID=57227d49-9f4e-4b29-93d1-0ae82bff1f57,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:43.618385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-07e6e084-7ab8-4ffe-aa40-a1d359a4cbb2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:43.618558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-838fb821-c985-4e0e-bd05-e9f11f9202bd None None] No DVR routers for this DVR port 57227d49-9f4e-4b29-93d1-0ae82bff1f57 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:43.706705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.714689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:43.714689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.753799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2360289-04dd-476a-8338-8e648ab24147 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.854115 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.0000579 Dec 10 14:27:43.855333 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56204) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:43.857870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56206) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:43.872759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'subnet': {'network_id': '0b95be25-9999-4628-a5fb-a4544733468b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:43.891728 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07e6e084-7ab8-4ffe-aa40-a1d359a4cbb2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:43.897053 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-095d7797-dcf7-42ea-bc36-8dcb1377b417 req-bb3a51a9-dbfd-4a33-9202-88f27fbaa960 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 210 time: 0.0449111 Dec 10 14:27:43.907627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c3dd73-4d13-4b21-b1d7-b4ebd8daf948 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Network': ['ID=0b95be25-9999-4628-a5fb-a4544733468b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:43.923527 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 0b95be25-9999-4628-a5fb-a4544733468b details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:43.962079 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-e5f62323-d90d-4a5a-96e1-2f95004ce863 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5380278 Dec 10 14:27:44.073715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-5778bead-7b2b-4948-875d-363223b5b41d tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.074760 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5778bead-7b2b-4948-875d-363223b5b41d tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.2185419 Dec 10 14:27:44.103832 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56212) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.115199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-cbbd987e-a982-49c0-b2e7-aac4cdb891a7 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/address-group returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.116244 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cbbd987e-a982-49c0-b2e7-aac4cdb891a7 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/address-group HTTP/1.1" status: 200 len: 353 time: 0.0087543 Dec 10 14:27:44.124205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56214) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.130603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-12ef00e7-10ef-41b2-a121-d355404f3bff tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/address-scope returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.134704 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-12ef00e7-10ef-41b2-a121-d355404f3bff tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/address-scope HTTP/1.1" status: 200 len: 357 time: 0.0064518 Dec 10 14:27:44.136985 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-3591a7ce-5065-4880-a724-8f4f7915a520 service neutron] 10.222.0.57 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1607952 Dec 10 14:27:44.140397 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56216) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.146585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-a243979c-444b-43e2-a24a-29a3cc13dde7 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/router-admin-state-down-before-update returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.148139 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a243979c-444b-43e2-a24a-29a3cc13dde7 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/router-admin-state-down-before-update HTTP/1.1" status: 200 len: 506 time: 0.0068104 Dec 10 14:27:44.159097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56218) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.165646 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-b8eea642-decd-4797-a4de-e44bd15dd85b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/agent returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.174952 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b8eea642-decd-4797-a4de-e44bd15dd85b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/agent HTTP/1.1" status: 200 len: 347 time: 0.0044711 Dec 10 14:27:44.179495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56220) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.186244 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-9718610d-9bde-40c7-adec-f5bd247dc3d5 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/agent-resources-synced returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.187210 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9718610d-9bde-40c7-adec-f5bd247dc3d5 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/agent-resources-synced HTTP/1.1" status: 200 len: 417 time: 0.0060294 Dec 10 14:27:44.213136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56222) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.219337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-1a66f19f-201a-438c-ba6e-1425d1f5155b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/allowed-address-pairs returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.220286 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1a66f19f-201a-438c-ba6e-1425d1f5155b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/allowed-address-pairs HTTP/1.1" status: 200 len: 378 time: 0.0043616 Dec 10 14:27:44.223229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56224) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.233321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-ea1b7bc6-6384-4633-8bf4-cf7ad0e4e46a tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/auto-allocated-topology returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.234345 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ea1b7bc6-6384-4633-8bf4-cf7ad0e4e46a tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/auto-allocated-topology HTTP/1.1" status: 200 len: 394 time: 0.0065095 Dec 10 14:27:44.243052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e3ff78f-9e2d-4110-ada6-631337e72366 req-78753bab-eef5-495e-984f-7567b065a267 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:44.244652 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0e3ff78f-9e2d-4110-ada6-631337e72366 req-78753bab-eef5-495e-984f-7567b065a267 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1962576 Dec 10 14:27:44.245366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56226) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.248066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:44.251607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.266401 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-3d1a1522-2f15-4160-8edc-ec041911636c tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/availability_zone returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.269879 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3d1a1522-2f15-4160-8edc-ec041911636c tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/availability_zone HTTP/1.1" status: 200 len: 372 time: 0.0145147 Dec 10 14:27:44.277884 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56228) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.335381 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-622bb29b-f91d-42b8-915e-66ceff9e3eff tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/availability_zone_filter returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.336615 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-622bb29b-f91d-42b8-915e-66ceff9e3eff tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/availability_zone_filter HTTP/1.1" status: 200 len: 414 time: 0.0150588 Dec 10 14:27:44.361574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56230) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.370959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2360289-04dd-476a-8338-8e648ab24147 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.375340 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-e96c44d4-821e-49ec-ad42-d9a58621cb9d service neutron] 10.222.0.57 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2243421 Dec 10 14:27:44.379121 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-81ef2f04-3805-4b9a-9654-5c55c8135889 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/default-subnetpools returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.380241 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-81ef2f04-3805-4b9a-9654-5c55c8135889 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/default-subnetpools HTTP/1.1" status: 200 len: 405 time: 0.0177693 Dec 10 14:27:44.382418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2360289-04dd-476a-8338-8e648ab24147 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.386968 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56232) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.399230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-967cd572-9a41-44eb-ad60-4c2ce59c673c tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/dhcp_agent_scheduler returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.400254 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-967cd572-9a41-44eb-ad60-4c2ce59c673c tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/dhcp_agent_scheduler HTTP/1.1" status: 200 len: 381 time: 0.0121393 Dec 10 14:27:44.403734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56234) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.443201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-32b2c208-c35e-417c-b9c6-0458ec53242a tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/dvr returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.444970 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-32b2c208-c35e-417c-b9c6-0458ec53242a tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/dvr HTTP/1.1" status: 200 len: 387 time: 0.0395348 Dec 10 14:27:44.447476 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0e3ff78f-9e2d-4110-ada6-631337e72366 req-de780fef-e682-44ab-93ea-5b1e6f0d2dc5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1762500 Dec 10 14:27:44.447986 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56236) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.459220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-6d5ce6d4-aaba-42ef-b923-25ea010ce3bd tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/empty-string-filtering returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.461515 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6d5ce6d4-aaba-42ef-b923-25ea010ce3bd tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/empty-string-filtering HTTP/1.1" status: 200 len: 413 time: 0.0113215 Dec 10 14:27:44.464929 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56238) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.481134 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-6c42adc9-1365-492a-9b02-fb5a02af85ec tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/external-net returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.481134 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6c42adc9-1365-492a-9b02-fb5a02af85ec tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/external-net HTTP/1.1" status: 200 len: 394 time: 0.0062134 Dec 10 14:27:44.482662 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56240) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.488196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-a7608fc1-d0ae-4116-b0de-dd2dbe469064 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/extra_dhcp_opt returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.492019 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a7608fc1-d0ae-4116-b0de-dd2dbe469064 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/extra_dhcp_opt HTTP/1.1" status: 200 len: 498 time: 0.0055518 Dec 10 14:27:44.492975 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56244) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.498861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-5e1f95e4-da88-4676-8c05-13e561455c59 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/extraroute returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.499804 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5e1f95e4-da88-4676-8c05-13e561455c59 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/extraroute HTTP/1.1" status: 200 len: 375 time: 0.0046449 Dec 10 14:27:44.527069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56246) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.527069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-1f3c6d8f-934f-4b4e-aac9-4320b49cf8e2 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/extraroute-atomic returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.527069 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1f3c6d8f-934f-4b4e-aac9-4320b49cf8e2 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/extraroute-atomic HTTP/1.1" status: 200 len: 444 time: 0.0069435 Dec 10 14:27:44.550057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56248) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.555100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-8b5248de-9888-4262-a392-022c5ba0a8fe tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/filter-validation returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.557024 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8b5248de-9888-4262-a392-022c5ba0a8fe tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/filter-validation HTTP/1.1" status: 200 len: 392 time: 0.0056620 Dec 10 14:27:44.560354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56250) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.565797 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-08eaca91-c5fd-4576-8e70-b15a178fb1a0 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/fip-port-details returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.566969 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-08eaca91-c5fd-4576-8e70-b15a178fb1a0 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/fip-port-details HTTP/1.1" status: 200 len: 406 time: 0.0054979 Dec 10 14:27:44.570177 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56252) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.578230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-7c9882d1-ed38-4201-8fd1-48a4d5cbb351 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/flavors returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.579420 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7c9882d1-ed38-4201-8fd1-48a4d5cbb351 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/flavors HTTP/1.1" status: 200 len: 387 time: 0.0080981 Dec 10 14:27:44.585347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56254) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.586107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2360289-04dd-476a-8338-8e648ab24147 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.586728 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2360289-04dd-476a-8338-8e648ab24147 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Fanout notify agent at l3_agent the message router_deleted on router 8a0ff370-ce59-491a-bb3e-3757f0043789 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:27:44.601365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-94f95b6c-54e9-4762-9322-b07942a2963e tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/floatingip-pools returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.602743 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-94f95b6c-54e9-4762-9322-b07942a2963e tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/floatingip-pools HTTP/1.1" status: 200 len: 382 time: 0.0140288 Dec 10 14:27:44.615380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56256) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.617317 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d2360289-04dd-476a-8338-8e648ab24147 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.618547 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d2360289-04dd-476a-8338-8e648ab24147 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/8a0ff370-ce59-491a-bb3e-3757f0043789 HTTP/1.1" status: 204 len: 168 time: 1.0116103 Dec 10 14:27:44.621267 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-5db78dcb-62eb-494f-80f4-3da22e3bf5ba tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/ip-substring-filtering returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.623424 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5db78dcb-62eb-494f-80f4-3da22e3bf5ba tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/ip-substring-filtering HTTP/1.1" status: 200 len: 416 time: 0.0052502 Dec 10 14:27:44.628232 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56260) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.628760 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56258) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.635721 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1aa93550-1de5-47ad-9798-720589f428cb up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:44.641840 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-37a52118-a0ae-4fd3-bd49-b8c88760206a tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/router returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.643536 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-37a52118-a0ae-4fd3-bd49-b8c88760206a tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/router HTTP/1.1" status: 200 len: 450 time: 0.0132797 Dec 10 14:27:44.646805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56264) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.652832 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-bc1aa7c4-f88e-4c0c-ac6c-c0c8691dded1 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/ext-gw-mode returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.653894 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bc1aa7c4-f88e-4c0c-ac6c-c0c8691dded1 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/ext-gw-mode HTTP/1.1" status: 200 len: 462 time: 0.0050776 Dec 10 14:27:44.658483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56266) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.663552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-e5604c3e-8cd6-4ecb-802c-a267dc7a752e tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/l3-ha returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.664527 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e5604c3e-8cd6-4ecb-802c-a267dc7a752e tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/l3-ha HTTP/1.1" status: 200 len: 360 time: 0.0049500 Dec 10 14:27:44.667075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56268) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.673561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-3e115d1e-7f5d-4b23-b59d-1472f53446b0 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/l3-flavors returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.673830 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3e115d1e-7f5d-4b23-b59d-1472f53446b0 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/l3-flavors HTTP/1.1" status: 200 len: 366 time: 0.0058527 Dec 10 14:27:44.677773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56270) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.683272 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-50fd63e6-28f6-49d7-93bf-eeb6a5369cd9 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/l3-port-ip-change-not-allowed returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.686535 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-50fd63e6-28f6-49d7-93bf-eeb6a5369cd9 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/l3-port-ip-change-not-allowed HTTP/1.1" status: 200 len: 439 time: 0.0056038 Dec 10 14:27:44.687128 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56272) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.691327 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-e557cb93-3b20-4988-b1c8-2f4d300975c0 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/l3_agent_scheduler returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.699030 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e557cb93-3b20-4988-b1c8-2f4d300975c0 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/l3_agent_scheduler HTTP/1.1" status: 200 len: 374 time: 0.0104926 Dec 10 14:27:44.722547 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 1aa93550-1de5-47ad-9798-720589f428cb triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:44.722923 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.726608 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07e6e084-7ab8-4ffe-aa40-a1d359a4cbb2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.729591 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56276) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.739764 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-e6ecb764-d4a2-44c1-ab3d-3b9af3d41896 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/metering returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.743487 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e6ecb764-d4a2-44c1-ab3d-3b9af3d41896 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/metering HTTP/1.1" status: 200 len: 357 time: 0.0046344 Dec 10 14:27:44.743773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56280) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.748383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-6dd2ffe9-0db8-47fe-902a-4795de81afd9 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/metering_source_and_destination_fields returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.749626 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6dd2ffe9-0db8-47fe-902a-4795de81afd9 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/metering_source_and_destination_fields HTTP/1.1" status: 200 len: 515 time: 0.0047438 Dec 10 14:27:44.752065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56282) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.757693 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-ddc6eec9-d673-4998-bed6-72a766ee07c4 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/multi-provider returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.758819 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ddc6eec9-d673-4998-bed6-72a766ee07c4 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/multi-provider HTTP/1.1" status: 200 len: 406 time: 0.0057528 Dec 10 14:27:44.762441 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56284) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.768811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-2a6d612a-9c0b-4f36-8410-5fb910033dc0 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/net-mtu returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.771850 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2a6d612a-9c0b-4f36-8410-5fb910033dc0 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/net-mtu HTTP/1.1" status: 200 len: 370 time: 0.0083392 Dec 10 14:27:44.775060 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56286) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.779685 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-6b1e8a72-8330-426a-af2f-dfc306dd190d tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/net-mtu-writable returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.780786 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6b1e8a72-8330-426a-af2f-dfc306dd190d tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/net-mtu-writable HTTP/1.1" status: 200 len: 401 time: 0.0046911 Dec 10 14:27:44.787567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d823897e-633a-4647-a85e-ea23ecdcfb9c req-dd8501b1-5666-494f-9a7d-0b29398e36e5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:44.787567 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d823897e-633a-4647-a85e-ea23ecdcfb9c req-dd8501b1-5666-494f-9a7d-0b29398e36e5 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.2035632 Dec 10 14:27:44.789813 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56288) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.798467 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-18913b16-0274-4dde-b4b0-88bd3511d683 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/network_availability_zone returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.799683 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-18913b16-0274-4dde-b4b0-88bd3511d683 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/network_availability_zone HTTP/1.1" status: 200 len: 394 time: 0.0086868 Dec 10 14:27:44.802787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56290) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.812339 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-374cbb4a-77d1-4f4a-9bbd-b40655f5b5d8 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/network-ip-availability returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.813464 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-374cbb4a-77d1-4f4a-9bbd-b40655f5b5d8 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/network-ip-availability HTTP/1.1" status: 200 len: 410 time: 0.0096266 Dec 10 14:27:44.817655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56292) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.818121 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07e6e084-7ab8-4ffe-aa40-a1d359a4cbb2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.830366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-f2b61382-a2ec-40c5-8dd1-501cb8819c02 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/pagination returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.832080 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f2b61382-a2ec-40c5-8dd1-501cb8819c02 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/pagination HTTP/1.1" status: 200 len: 386 time: 0.0049875 Dec 10 14:27:44.844207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-a13b835f-6f45-44a0-9ee6-30db61e100d4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting subnet d6900cec-6324-4f02-95fb-5736fd986d4b {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:27:44.846348 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56294) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.853523 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-35588930-c659-4894-91f2-05df4c1367a7 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/port-device-profile returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.856885 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-35588930-c659-4894-91f2-05df4c1367a7 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/port-device-profile HTTP/1.1" status: 200 len: 383 time: 0.0055029 Dec 10 14:27:44.857024 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a13b835f-6f45-44a0-9ee6-30db61e100d4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.857981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56296) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.864645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-3c97a7b6-676f-4444-9efc-ce8917969586 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/port-mac-address-regenerate returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.865697 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3c97a7b6-676f-4444-9efc-ce8917969586 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/port-mac-address-regenerate HTTP/1.1" status: 200 len: 403 time: 0.0068169 Dec 10 14:27:44.870775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56298) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.871716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-07e6e084-7ab8-4ffe-aa40-a1d359a4cbb2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] In _notify_port_updated(), no bound segment for port a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051 on network e9b085a0-e0b5-4630-9607-8d0706a5122c {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:27:44.877208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07e6e084-7ab8-4ffe-aa40-a1d359a4cbb2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:44.877866 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07e6e084-7ab8-4ffe-aa40-a1d359a4cbb2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.882201 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-07e6e084-7ab8-4ffe-aa40-a1d359a4cbb2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "PUT /v2.0/ports/a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051 HTTP/1.1" status: 200 len: 818 time: 1.2659445 Dec 10 14:27:44.886234 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-d4c97322-0a12-41dc-9f38-606b971cbe1c tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/port-numa-affinity-policy returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.887214 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d4c97322-0a12-41dc-9f38-606b971cbe1c tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/port-numa-affinity-policy HTTP/1.1" status: 200 len: 392 time: 0.0069320 Dec 10 14:27:44.887780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56300) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.891634 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56302) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.907649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-4577f08b-1eed-4671-9036-1c4bdd102b32 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/binding returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.908733 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4577f08b-1eed-4671-9036-1c4bdd102b32 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/binding HTTP/1.1" status: 200 len: 387 time: 0.0082927 Dec 10 14:27:44.912437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56304) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.916747 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-bd72e865-c161-4fb8-a3d0-4b6c7e1f5348 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/binding-extended returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.920840 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bd72e865-c161-4fb8-a3d0-4b6c7e1f5348 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/binding-extended HTTP/1.1" status: 200 len: 406 time: 0.0042686 Dec 10 14:27:44.921311 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56306) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.927723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-517b139b-9356-430e-8c28-1ef4ceb93f99 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/port-security returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.929533 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-517b139b-9356-430e-8c28-1ef4ceb93f99 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/port-security HTTP/1.1" status: 200 len: 354 time: 0.0064144 Dec 10 14:27:44.933615 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56308) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.934718 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d823897e-633a-4647-a85e-ea23ecdcfb9c req-c0d40bf5-b5fa-45b7-89e2-4f656d411942 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1398473 Dec 10 14:27:44.936946 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a13b835f-6f45-44a0-9ee6-30db61e100d4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:44.942481 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-a912e65d-65b0-4618-9188-cf24f8e74506 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/project-id returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.946190 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a912e65d-65b0-4618-9188-cf24f8e74506 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/project-id HTTP/1.1" status: 200 len: 398 time: 0.0065851 Dec 10 14:27:44.946190 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07e6e084-7ab8-4ffe-aa40-a1d359a4cbb2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:44.947094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56312) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.953435 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-cf6b21df-b5a8-47fe-ba0b-a41c705fba39 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/provider returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.955076 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cf6b21df-b5a8-47fe-ba0b-a41c705fba39 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/provider HTTP/1.1" status: 200 len: 385 time: 0.0042982 Dec 10 14:27:44.963489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56314) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.970790 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-c5aed6e8-f1ed-4b74-bcce-bfa524617551 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/quota-check-limit returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.974536 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c5aed6e8-f1ed-4b74-bcce-bfa524617551 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/quota-check-limit HTTP/1.1" status: 200 len: 420 time: 0.0073392 Dec 10 14:27:44.976267 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56318) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.984320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-484b3840-d218-4ae0-943d-f72776231a62 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/quotas returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:44.988519 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-484b3840-d218-4ae0-943d-f72776231a62 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/quotas HTTP/1.1" status: 200 len: 386 time: 0.0066736 Dec 10 14:27:44.990009 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56320) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:44.997624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-9c6eaf82-0cff-47c1-925f-afdc904e9be2 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/quota_details returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.000996 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9c6eaf82-0cff-47c1-925f-afdc904e9be2 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/quota_details HTTP/1.1" status: 200 len: 407 time: 0.0075338 Dec 10 14:27:45.002105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56322) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.006184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-168cfb86-7256-4194-87cd-9668905fd0da tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/rbac-policies returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.009664 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-168cfb86-7256-4194-87cd-9668905fd0da tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/rbac-policies HTTP/1.1" status: 200 len: 417 time: 0.0046828 Dec 10 14:27:45.010200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56324) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.018463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-0b6f9a2a-a7c6-4ad2-ab59-0556ee8e8e29 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/rbac-address-group returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.019405 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0b6f9a2a-a7c6-4ad2-ab59-0556ee8e8e29 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/rbac-address-group HTTP/1.1" status: 200 len: 392 time: 0.0050735 Dec 10 14:27:45.021834 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56326) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.027230 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-b42640f6-08f4-41a8-a4c1-fe802b298354 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/rbac-address-scope returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.030370 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b42640f6-08f4-41a8-a4c1-fe802b298354 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/rbac-address-scope HTTP/1.1" status: 200 len: 384 time: 0.0054333 Dec 10 14:27:45.032677 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56328) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.037596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-8ca3d1e1-e213-4694-8fdd-0eb713bf6951 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/rbac-security-groups returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.040992 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8ca3d1e1-e213-4694-8fdd-0eb713bf6951 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/rbac-security-groups HTTP/1.1" status: 200 len: 404 time: 0.0054348 Dec 10 14:27:45.042006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56330) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.051610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-06f5c89d-a0d7-4bea-9827-bf2ab9023efb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:45.051948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06f5c89d-a0d7-4bea-9827-bf2ab9023efb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.060862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-27cfcfcc-9427-4af0-8370-607fe40883f7 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/rbac-subnetpool returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.061846 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-27cfcfcc-9427-4af0-8370-607fe40883f7 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/rbac-subnetpool HTTP/1.1" status: 200 len: 375 time: 0.0067723 Dec 10 14:27:45.066130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56332) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.067292 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b248f9de-af35-4f2c-ae10-3752f6523625 req-500a632d-b727-49cd-b558-d7aa0f1c6650 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 210 time: 0.0506625 Dec 10 14:27:45.072984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-d9e40014-3ebb-4f80-aa54-607cccdd7b88 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/revision-if-match returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.073984 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d9e40014-3ebb-4f80-aa54-607cccdd7b88 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/revision-if-match HTTP/1.1" status: 200 len: 441 time: 0.0069199 Dec 10 14:27:45.077820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56334) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.100002 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-8e28bbfe-65d2-4893-a1f3-457ea69df2b8 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/standard-attr-revisions returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.101013 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8e28bbfe-65d2-4893-a1f3-457ea69df2b8 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/standard-attr-revisions HTTP/1.1" status: 200 len: 423 time: 0.0202410 Dec 10 14:27:45.107372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56336) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.112642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-e2e92f7b-453c-4d13-b2be-7adb52203a8b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/router_availability_zone returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.113696 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e2e92f7b-453c-4d13-b2be-7adb52203a8b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/router_availability_zone HTTP/1.1" status: 200 len: 391 time: 0.0052783 Dec 10 14:27:45.117163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56338) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.121270 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-56b8ec92-9397-4780-8166-3d12f2b1409b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/security-groups-normalized-cidr returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.122346 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-56b8ec92-9397-4780-8166-3d12f2b1409b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/security-groups-normalized-cidr HTTP/1.1" status: 200 len: 445 time: 0.0043285 Dec 10 14:27:45.125752 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56340) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.131234 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:27:45.135024 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-72c9e191-dcc2-421b-8c51-27b6cc5ed666 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/port-security-groups-filtering returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.138585 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-72c9e191-dcc2-421b-8c51-27b6cc5ed666 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/port-security-groups-filtering HTTP/1.1" status: 200 len: 422 time: 0.0096066 Dec 10 14:27:45.142627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56342) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.148954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-ee26eb72-3eee-46f8-bc14-4b9811cae656 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/security-groups-remote-address-group returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.152434 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ee26eb72-3eee-46f8-bc14-4b9811cae656 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/security-groups-remote-address-group HTTP/1.1" status: 200 len: 448 time: 0.0064871 Dec 10 14:27:45.152434 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06f5c89d-a0d7-4bea-9827-bf2ab9023efb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.154537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56344) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.157071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.169050 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-0ee361b9-2da8-4d23-b1e4-89bcff33d5fd tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/security-groups-shared-filtering returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.170160 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0ee361b9-2da8-4d23-b1e4-89bcff33d5fd tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/security-groups-shared-filtering HTTP/1.1" status: 200 len: 435 time: 0.0146484 Dec 10 14:27:45.175651 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56346) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.180369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-de1dcd84-ad89-4ec6-afeb-b59198df0375 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/security-group returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.181556 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-de1dcd84-ad89-4ec6-afeb-b59198df0375 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/security-group HTTP/1.1" status: 200 len: 364 time: 0.0047069 Dec 10 14:27:45.182403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-06f5c89d-a0d7-4bea-9827-bf2ab9023efb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:45.184052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56348) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.190082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-12782ca4-cdb2-4510-a650-6df453fec4cb tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/service-type returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.191119 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-12782ca4-cdb2-4510-a650-6df453fec4cb tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/service-type HTTP/1.1" status: 200 len: 415 time: 0.0061374 Dec 10 14:27:45.193946 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56350) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.201332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-9b73fc93-3eef-44d0-934c-241b4354b9ca tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/sorting returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.202301 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9b73fc93-3eef-44d0-934c-241b4354b9ca tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/sorting HTTP/1.1" status: 200 len: 377 time: 0.0069163 Dec 10 14:27:45.205048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56352) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.207353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a13b835f-6f45-44a0-9ee6-30db61e100d4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.208954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-d2c834bc-ad9c-4eb9-8100-6b8d20de151c tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/standard-attr-description returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.212050 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d2c834bc-ad9c-4eb9-8100-6b8d20de151c tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/standard-attr-description HTTP/1.1" status: 200 len: 408 time: 0.0039635 Dec 10 14:27:45.212199 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56354) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.218083 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-f37982ad-d629-42ec-9279-039edcd73b5b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/stateful-security-group returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.219045 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f37982ad-d629-42ec-9279-039edcd73b5b tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/stateful-security-group HTTP/1.1" status: 200 len: 402 time: 0.0060010 Dec 10 14:27:45.230614 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56356) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.242945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [None req-1cfdc6ff-5ca9-4f11-9eae-d7568ac4c93e tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/subnet_onboard returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.243921 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1cfdc6ff-5ca9-4f11-9eae-d7568ac4c93e tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/subnet_onboard HTTP/1.1" status: 200 len: 391 time: 0.0084732 Dec 10 14:27:45.247131 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56358) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.251877 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-f6905964-2566-4dda-b9f7-4baf3e113ad6 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/subnet-service-types returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.254986 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f6905964-2566-4dda-b9f7-4baf3e113ad6 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/subnet-service-types HTTP/1.1" status: 200 len: 400 time: 0.0047743 Dec 10 14:27:45.256158 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56360) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.260753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-3d7b95aa-f7cb-4d75-adc3-22abd83cd18f tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/subnet_allocation returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.262752 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3d7b95aa-f7cb-4d75-adc3-22abd83cd18f tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/subnet_allocation HTTP/1.1" status: 200 len: 388 time: 0.0040815 Dec 10 14:27:45.266152 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Subnet': ['ID=3fa54dfa-b0f6-4e2f-93fc-e8e2d3f3cb62,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:45.267737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56362) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.275474 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-39eb63f7-2464-419f-abd1-9f0c6ac7605d tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/subnetpool-prefix-ops returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.278150 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-39eb63f7-2464-419f-abd1-9f0c6ac7605d tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/subnetpool-prefix-ops HTTP/1.1" status: 200 len: 418 time: 0.0092354 Dec 10 14:27:45.279169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56364) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.284083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Checking segment: {'id': '81dfbe5f-b26f-4202-bc76-1321bca680f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '0b95be25-9999-4628-a5fb-a4544733468b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:45.284435 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network hostable DHCP agents. Network: 0b95be25-9999-4628-a5fb-a4544733468b, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:45.292335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-21510f47-cf4a-4191-888e-65d6ef22e2aa tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/standard-attr-tag returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.294414 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-21510f47-cf4a-4191-888e-65d6ef22e2aa tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/standard-attr-tag HTTP/1.1" status: 200 len: 537 time: 0.0056086 Dec 10 14:27:45.296314 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56366) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.301398 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [None req-9935e026-f712-45f5-93cc-2c17cc257e90 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] http://10.222.0.57:9696/v2.0/extensions/standard-attr-timestamp returned with HTTP 200 {{(pid=103810) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:27:45.302366 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9935e026-f712-45f5-93cc-2c17cc257e90 tempest-ExtensionsTestJSON-1322396251 tempest-ExtensionsTestJSON-1322396251-project] 10.222.0.57 "GET /v2.0/extensions/standard-attr-timestamp HTTP/1.1" status: 200 len: 449 time: 0.0051732 Dec 10 14:27:45.405980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network 0b95be25-9999-4628-a5fb-a4544733468b is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:45.409753 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a13b835f-6f45-44a0-9ee6-30db61e100d4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.439589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a13b835f-6f45-44a0-9ee6-30db61e100d4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Subnet': ['ID=d6900cec-6324-4f02-95fb-5736fd986d4b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:45.443273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a13b835f-6f45-44a0-9ee6-30db61e100d4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.449527 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a13b835f-6f45-44a0-9ee6-30db61e100d4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/d6900cec-6324-4f02-95fb-5736fd986d4b HTTP/1.1" status: 204 len: 168 time: 0.8161602 Dec 10 14:27:45.450197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56370) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.452520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e1531da-795c-4032-95fe-57af8652d7ff None None] Network 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:45.503950 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06f5c89d-a0d7-4bea-9827-bf2ab9023efb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.517570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 0b95be25-9999-4628-a5fb-a4544733468b) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:45.532997 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:45.535357 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a528457-56d6-4fb8-bf78-c15ae04755fc None None] Network 0b95be25-9999-4628-a5fb-a4544733468b requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:45.536828 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.550535 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f5c89d-a0d7-4bea-9827-bf2ab9023efb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:45.560169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06f5c89d-a0d7-4bea-9827-bf2ab9023efb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.563665 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-06f5c89d-a0d7-4bea-9827-bf2ab9023efb tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051 HTTP/1.1" status: 204 len: 168 time: 0.6728289 Dec 10 14:27:45.566365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56374) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.581114 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.608369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0573c9a1-c668-456a-98e8-ffa3cdf76bef req-58ef9386-797e-4297-a254-690d68c13018 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:45.610323 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0573c9a1-c668-456a-98e8-ffa3cdf76bef req-58ef9386-797e-4297-a254-690d68c13018 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.0697441 Dec 10 14:27:45.656580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d40c773-156a-451d-83ae-fe242262a26d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:45.658512 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8d40c773-156a-451d-83ae-fe242262a26d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.0911412 Dec 10 14:27:45.661708 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56376) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.673847 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-74f7aa5c-8181-44d5-97ac-17e640e285ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.8044055 Dec 10 14:27:45.674026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56378) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.687786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-0b95be25-9999-4628-a5fb-a4544733468b', 'network_id': '0b95be25-9999-4628-a5fb-a4544733468b', 'project_id': '608b3110bcfe4055bf2af3eb17ae415d', 'fixed_ips': [{'subnet_id': '3fa54dfa-b0f6-4e2f-93fc-e8e2d3f3cb62'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:45.689700 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.691731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'port': {'network_id': '0b95be25-9999-4628-a5fb-a4544733468b', 'name': 'tempest-NetworksIpV6TestAttrs-758541685'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:45.695367 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0573c9a1-c668-456a-98e8-ffa3cdf76bef req-f06188d6-ed3b-45d6-8ff5-43c9e0805856 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0752463 Dec 10 14:27:45.722037 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a0353fd-f18e-45dd-96f8-2981f937987a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:27:45.724156 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2a0353fd-f18e-45dd-96f8-2981f937987a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/a06b2cc5-a2ca-4e11-a3f2-4c10f98a9051 HTTP/1.1" status: 404 len: 333 time: 0.0608244 Dec 10 14:27:45.727726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56380) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.735637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-548760356'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:45.772297 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38b087d1-f787-41f0-95d8-a2d6224a82c6 None None] DHCP port deletion for 6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:45.794659 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port d65b48a3-5269-4044-88c5-19f5ad2556da {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:45.795026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.890613 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-dd982554-51c7-4993-95a7-944b36d5f40d req-b3521954-df94-493c-a09f-9352ae9baccc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 210 time: 0.0805979 Dec 10 14:27:45.894100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:45.894680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Allocated IP 2001:db8::f816:3eff:feef:a421 (0b95be25-9999-4628-a5fb-a4544733468b/3fa54dfa-b0f6-4e2f-93fc-e8e2d3f3cb62/8ade82c0-e629-4d59-a6c3-ac7f80a0366e) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:45.897502 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-38b087d1-f787-41f0-95d8-a2d6224a82c6 None None] Deleting port d65b48a3-5269-4044-88c5-19f5ad2556da {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:45.897902 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-38b087d1-f787-41f0-95d8-a2d6224a82c6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.914001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.936206 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port d65b48a3-5269-4044-88c5-19f5ad2556da, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d65b48a3-5269-4044-88c5-19f5ad2556da,segment=NetworkSegment(d0822671-f7f9-4b59-9ff6-606e02d7296c),segment_id=d0822671-f7f9-4b59-9ff6-606e02d7296c)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:45.936206 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:45.950720 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56392) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:45.965930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for d65b48a3-5269-4044-88c5-19f5ad2556da owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:45.992713 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] vlan segment allocate from pool success with {'vlan_id': 385, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:46.003322 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.003792 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Added segment 362599c9-ac81-4c25-8900-88406483b3d7 of type vlan for network b306ad62-3944-4c37-b4b8-73240f2a74a5 Dec 10 14:27:46.031989 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-38b087d1-f787-41f0-95d8-a2d6224a82c6 None None] For port d65b48a3-5269-4044-88c5-19f5ad2556da, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d65b48a3-5269-4044-88c5-19f5ad2556da,segment=NetworkSegment(d0822671-f7f9-4b59-9ff6-606e02d7296c),segment_id=d0822671-f7f9-4b59-9ff6-606e02d7296c)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:46.040514 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-38b087d1-f787-41f0-95d8-a2d6224a82c6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.049305 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-38b087d1-f787-41f0-95d8-a2d6224a82c6 None None] Calling delete_port for d65b48a3-5269-4044-88c5-19f5ad2556da owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:46.052964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.080008 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:46.084035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.106092 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] device_id is not set on port 05a98750-60ac-4416-ae03-0d4e11a81dde yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:46.129959 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1c27d91-326b-4c87-b82b-94455fff3f22 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.182896 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3c944e4c-e0d9-4179-84c9-c21ac056afc3 req-b6dfff41-bf48-4658-8796-de13a8307cef tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 210 time: 0.0372987 Dec 10 14:27:46.188181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.193612 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.203919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-38b087d1-f787-41f0-95d8-a2d6224a82c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.207381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No DVR routers for this DVR port d65b48a3-5269-4044-88c5-19f5ad2556da on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:46.228649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=d65b48a3-5269-4044-88c5-19f5ad2556da,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:46.234908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.241827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:46.242596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.243704 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38b087d1-f787-41f0-95d8-a2d6224a82c6 None None] Pushing event deleted for resources: {'Port': ['ID=d65b48a3-5269-4044-88c5-19f5ad2556da,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:46.247117 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38b087d1-f787-41f0-95d8-a2d6224a82c6 None None] No DVR routers for this DVR port d65b48a3-5269-4044-88c5-19f5ad2556da on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:46.309297 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.325793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1c27d91-326b-4c87-b82b-94455fff3f22 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.326003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.333218 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Network': ['ID=b306ad62-3944-4c37-b4b8-73240f2a74a5,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:46.355717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:46.358760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:46.372474 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd0822671-f7f9-4b59-9ff6-606e02d7296c') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:46.372766 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd0822671-f7f9-4b59-9ff6-606e02d7296c') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:46.387031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.388648 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Network 0b95be25-9999-4628-a5fb-a4544733468b is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:46.405523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Allocated IP 2001:db8::f816:3eff:fe6c:bdba (0b95be25-9999-4628-a5fb-a4544733468b/3fa54dfa-b0f6-4e2f-93fc-e8e2d3f3cb62/05a98750-60ac-4416-ae03-0d4e11a81dde) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:46.413697 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.421494 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:46.422560 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Releasing vlan 384 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:46.422959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.423946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:46.426034 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:46.436957 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bb28b037-fbcc-4c72-987a-309d4ef454c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.7072518 Dec 10 14:27:46.441856 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56400) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:46.442482 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Pushing event updated for resources: {'Port': ['ID=8ade82c0-e629-4d59-a6c3-ac7f80a0366e,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:46.447179 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:46.486582 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1c27d91-326b-4c87-b82b-94455fff3f22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.504854 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Attempting to bind port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:46.506569 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Attempting to bind port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '81dfbe5f-b26f-4202-bc76-1321bca680f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '0b95be25-9999-4628-a5fb-a4544733468b'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:46.506569 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Attempting to bind port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e on network 0b95be25-9999-4628-a5fb-a4544733468b {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:46.515068 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:46.515668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Checking segment: {'id': '81dfbe5f-b26f-4202-bc76-1321bca680f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '0b95be25-9999-4628-a5fb-a4544733468b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:46.516469 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.516975 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Bound using segment: {'id': '81dfbe5f-b26f-4202-bc76-1321bca680f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '0b95be25-9999-4628-a5fb-a4544733468b'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:46.525386 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Bound port: 8ade82c0-e629-4d59-a6c3-ac7f80a0366e, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '81dfbe5f-b26f-4202-bc76-1321bca680f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '0b95be25-9999-4628-a5fb-a4544733468b'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:46.525386 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.559953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c27d91-326b-4c87-b82b-94455fff3f22 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8bb6d1c8-cc7e-43df-b2ca-4d481cffcd6c,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:46.568963 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c1c27d91-326b-4c87-b82b-94455fff3f22 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=82022e50808346868e413b8300d1cd29&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6133933 Dec 10 14:27:46.570150 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56402) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:46.612681 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] For port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:46.616075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] For port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8ade82c0-e629-4d59-a6c3-ac7f80a0366e,segment=NetworkSegment(81dfbe5f-b26f-4202-bc76-1321bca680f6),segment_id=81dfbe5f-b26f-4202-bc76-1321bca680f6)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:46.618620 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d65b48a3-5269-4044-88c5-19f5ad2556da no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:46.625434 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c093ef3-2108-4746-a139-0eac4c73ef28 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.644411 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: d65b48a3-5269-4044-88c5-19f5ad2556da {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:27:46.644411 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d65b48a3-5269-4044-88c5-19f5ad2556da not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:27:46.655193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c093ef3-2108-4746-a139-0eac4c73ef28 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.696273 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.700009 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.718655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.725405 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/networks/6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63 HTTP/1.1" status: 204 len: 168 time: 1.2706780 Dec 10 14:27:46.726148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b439a010-8d27-44e3-90c0-e1a2823ca18a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Network': ['ID=6d4ba5cb-fc2f-4e55-bd9d-d04d480b1c63,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:46.726903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56406) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:46.733516 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-885714718'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:46.743052 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.776534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:46.780185 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.781209 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c093ef3-2108-4746-a139-0eac4c73ef28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.783868 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5c093ef3-2108-4746-a139-0eac4c73ef28 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.784993 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5c093ef3-2108-4746-a139-0eac4c73ef28 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/8bb6d1c8-cc7e-43df-b2ca-4d481cffcd6c HTTP/1.1" status: 204 len: 168 time: 0.2139413 Dec 10 14:27:46.830104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42589cb-b863-4836-8a41-83de5c0ab82f None None] Pushing event updated for resources: {'Port': ['ID=8ade82c0-e629-4d59-a6c3-ac7f80a0366e,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:46.833212 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c093ef3-2108-4746-a139-0eac4c73ef28 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8bb6d1c8-cc7e-43df-b2ca-4d481cffcd6c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:46.859448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.875602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f42de85-ca8a-4e87-b190-b5ea308b73a0 req-94b19049-f8b0-4943-9338-6a018c2d9219 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:46.883176 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6f42de85-ca8a-4e87-b190-b5ea308b73a0 req-94b19049-f8b0-4943-9338-6a018c2d9219 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1146941 Dec 10 14:27:46.954524 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network 0b95be25-9999-4628-a5fb-a4544733468b is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:46.955296 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Port': ['ID=05a98750-60ac-4416-ae03-0d4e11a81dde,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:46.960636 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:46.964035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:46.969879 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:46.970603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:46.981825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:46.985319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.013046 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6f42de85-ca8a-4e87-b190-b5ea308b73a0 req-d458e934-4a01-4d29-b203-6ba0970b96e4 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1289866 Dec 10 14:27:47.015109 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9d85ab28-cbde-44e9-95f5-bb06cf835d1b req-465d62d8-627f-4057-b49f-a31391a604a3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 210 time: 0.0459833 Dec 10 14:27:47.032646 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] vlan segment allocate from pool success with {'vlan_id': 375, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:47.052171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.052524 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added segment 8de8e937-5bff-4a3e-827d-1cfc8b554f61 of type vlan for network 14ab07af-159c-44cd-a6ff-1432f951a733 Dec 10 14:27:47.104602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.122531 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d7990e5a-dc05-4959-9e28-e7e1111f18c7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 1.4429858 Dec 10 14:27:47.122531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56416) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:47.193805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-989ab519-4298-4552-b2cf-9d332ffbd1ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Deleting subnet 3fa54dfa-b0f6-4e2f-93fc-e8e2d3f3cb62 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:27:47.197980 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-989ab519-4298-4552-b2cf-9d332ffbd1ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.217126 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.224043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:47.224697 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.279090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-989ab519-4298-4552-b2cf-9d332ffbd1ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.324463 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fe2488b8-203c-4aaa-ad95-697a56917eec req-659f0fa8-729f-4747-849b-18375486bb1d tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 210 time: 0.0745213 Dec 10 14:27:47.337326 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Network': ['ID=14ab07af-159c-44cd-a6ff-1432f951a733,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:47.347654 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 14ab07af-159c-44cd-a6ff-1432f951a733 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:47.356754 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2d53a083-b01a-4bf8-b013-3c4f73db19a2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.6280291 Dec 10 14:27:47.360033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56424) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:47.366476 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'subnet': {'network_id': '14ab07af-159c-44cd-a6ff-1432f951a733', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:47.391817 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.501736 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=dbf56665-f742-4f90-84a3-d3b89d971e5b,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:47.525739 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-989ab519-4298-4552-b2cf-9d332ffbd1ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.565334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Checking segment: {'id': '362599c9-ac81-4c25-8900-88406483b3d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:47.565740 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network hostable DHCP agents. Network: b306ad62-3944-4c37-b4b8-73240f2a74a5, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:47.599351 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:47.604944 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.703052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:47.754925 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-989ab519-4298-4552-b2cf-9d332ffbd1ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.786452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-989ab519-4298-4552-b2cf-9d332ffbd1ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Subnet': ['ID=3fa54dfa-b0f6-4e2f-93fc-e8e2d3f3cb62,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:47.792105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-989ab519-4298-4552-b2cf-9d332ffbd1ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.797049 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-989ab519-4298-4552-b2cf-9d332ffbd1ab tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/subnets/3fa54dfa-b0f6-4e2f-93fc-e8e2d3f3cb62 HTTP/1.1" status: 204 len: 168 time: 0.6734288 Dec 10 14:27:47.800184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56434) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:47.814164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, b306ad62-3944-4c37-b4b8-73240f2a74a5) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:47.824599 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5490c288-0f46-43f6-9d19-62ba1630b405 None None] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:47.842721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:47.843650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:47.876945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8b20b59-6561-4752-8fc4-b55b1e6130d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:47.878719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8b20b59-6561-4752-8fc4-b55b1e6130d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:47.880474 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d8b20b59-6561-4752-8fc4-b55b1e6130d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.0789280 Dec 10 14:27:47.884952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56440) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:47.970261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-1d847113-3cbf-46ee-a958-c6b2bcaca4de tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:47.970261 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-1d847113-3cbf-46ee-a958-c6b2bcaca4de tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.39 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.0599494 Dec 10 14:27:47.973769 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-495507c4-d0c2-497d-92a6-fd47e6fc6954 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5311620 Dec 10 14:27:47.976641 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56444) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:47.981926 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-38efd986-6751-45ec-8ed0-3a6eb4e9d974 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:47.984410 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-b306ad62-3944-4c37-b4b8-73240f2a74a5', 'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5', 'project_id': '7a25938276dc428b9a5723e37d120269', 'fixed_ips': [{'subnet_id': 'dbf56665-f742-4f90-84a3-d3b89d971e5b'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:47.986111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.110379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9da995a2-eea4-4953-81fc-01454837fa55 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.120507 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-9da995a2-eea4-4953-81fc-01454837fa55 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): There was a conflict when trying to complete your request. Dec 10 14:27:48.121199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9da995a2-eea4-4953-81fc-01454837fa55 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:27:48.125510 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9da995a2-eea4-4953-81fc-01454837fa55 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/0b95be25-9999-4628-a5fb-a4544733468b HTTP/1.1" status: 409 len: 405 time: 0.2370017 Dec 10 14:27:48.130500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56458) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:48.136368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-341742986'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:48.173054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.188873 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62a3de0f-5403-4afc-83a9-877d311475a6 None None] Network 0b95be25-9999-4628-a5fb-a4544733468b requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:48.194860 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Allocated IP 172.20.0.2 (b306ad62-3944-4c37-b4b8-73240f2a74a5/dbf56665-f742-4f90-84a3-d3b89d971e5b/66f3c31e-7d3b-4d1f-bdd7-127ca6665343) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:48.211593 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a1b3ec05-7684-49e4-ba3e-7a92ea22ac63 req-950f3d25-906c-47e8-8a72-b5ef20c47774 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 210 time: 0.0464308 Dec 10 14:27:48.290596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Deleting port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:48.290826 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.307453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Subnet': ['ID=16d8bf94-466d-415d-a96c-b139907b0409,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:48.339136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-886587fd-5b84-4dbd-97f0-c7e8da6a66e1 req-f082332d-8f3f-4f62-9f64-edcd1d9ad2da tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:48.340704 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-886587fd-5b84-4dbd-97f0-c7e8da6a66e1 req-f082332d-8f3f-4f62-9f64-edcd1d9ad2da tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 945 time: 0.1282256 Dec 10 14:27:48.353563 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Checking segment: {'id': '8de8e937-5bff-4a3e-827d-1cfc8b554f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '14ab07af-159c-44cd-a6ff-1432f951a733'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:48.354755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56462) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:48.354906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network hostable DHCP agents. Network: 14ab07af-159c-44cd-a6ff-1432f951a733, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:48.361970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:48.368657 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.441036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ce6e8d3c-ef50-458f-8827-b39e59ff058b None None] Provisioning complete for port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:48.441327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ce6e8d3c-ef50-458f-8827-b39e59ff058b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.468564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] For port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:48.468936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.479436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] vlan segment allocate from pool success with {'vlan_id': 377, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:48.485762 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-886587fd-5b84-4dbd-97f0-c7e8da6a66e1 req-3633a37e-cf0a-48b9-b8e9-677bbc8aaed8 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups?id=ad7787c2-a452-4578-90f6-78c6a9cab94a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1273887 Dec 10 14:27:48.488482 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-919eb8e5-92d4-4a8e-8265-87470a542980 req-1f01c4ab-5d1c-4521-af00-db9ce267f109 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 210 time: 0.0365369 Dec 10 14:27:48.502343 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.502343 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Added segment 56d7470d-f28a-4779-a14f-529843bbc41a of type vlan for network c62b7db1-efd7-483a-896e-5dce85876171 Dec 10 14:27:48.561578 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 14ab07af-159c-44cd-a6ff-1432f951a733 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:48.580034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.626046 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-test-network-647005935'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:48.628923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38efd986-6751-45ec-8ed0-3a6eb4e9d974 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:48.632477 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.632960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38efd986-6751-45ec-8ed0-3a6eb4e9d974 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.635566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8ade82c0-e629-4d59-a6c3-ac7f80a0366e up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:48.701874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1178c263-b469-4b4f-83bc-2bf34abdfdee None None] DHCP port deletion for 0b95be25-9999-4628-a5fb-a4544733468b request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:48.717379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ce6e8d3c-ef50-458f-8827-b39e59ff058b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.743850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 14ab07af-159c-44cd-a6ff-1432f951a733) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:48.749037 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:48.749775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.754364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.762634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:48.763905 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.808889 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.ipam_backend_mixin [None req-38efd986-6751-45ec-8ed0-3a6eb4e9d974 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet dbf56665-f742-4f90-84a3-d3b89d971e5b (CIDR: 172.20.0.0/28) Dec 10 14:27:48.811118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.811536 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.811893 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Floating IP 0247fae1-143d-4fab-8336-554866ced01e disassociated. External IP: 172.26.2.92, port: 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d. Dec 10 14:27:48.812240 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Calling delete_port for 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d owned by compute:nova {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:48.847456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Network': ['ID=c62b7db1-efd7-483a-896e-5dce85876171,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:48.868437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Made reservation on behalf of 434937b7dbcf4235973f66596f613320 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:48.872052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.877929 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-38efd986-6751-45ec-8ed0-3a6eb4e9d974 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:27:48.878425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-38efd986-6751-45ec-8ed0-3a6eb4e9d974 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:27:48.896152 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f96e0972-7c7d-4b83-89fa-9c68e158e9de None None] Network 14ab07af-159c-44cd-a6ff-1432f951a733 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:48.898722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network c62b7db1-efd7-483a-896e-5dce85876171 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:48.901824 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.911773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:48.977014 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a3490a8c-fcb7-4a00-a0c5-8f48bca25a4e tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.8422098 Dec 10 14:27:48.977331 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56468) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:48.982765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'subnet': {'network_id': 'c62b7db1-efd7-483a-896e-5dce85876171', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:49.022766 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.032629 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-38efd986-6751-45ec-8ed0-3a6eb4e9d974 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.0542545 Dec 10 14:27:49.033263 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0593d0e3-6847-4592-b15e-2dff729a08e6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6719573 Dec 10 14:27:49.040735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56470) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:49.041144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56472) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:49.051936 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:49.058074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3aa90ec1-518b-474e-b6e8-78191dd9f054 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1432590576', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:49.068975 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:49.098458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:49.098836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.101112 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:49.106193 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ce6e8d3c-ef50-458f-8827-b39e59ff058b None None] For port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8ade82c0-e629-4d59-a6c3-ac7f80a0366e,segment=NetworkSegment(81dfbe5f-b26f-4202-bc76-1321bca680f6),segment_id=81dfbe5f-b26f-4202-bc76-1321bca680f6)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:49.111653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:49.130044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Pushing event updated for resources: {'Port': ['ID=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:49.149506 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.182127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] vlan segment allocate from pool success with {'vlan_id': 352, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:49.198182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event updated for resources: {'SecurityGroup': ['ID=beaacf1b-edd1-498a-bdf3-f87824b7c1b0,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:49.201097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.201463 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Added segment 6081c79d-9666-4657-8a41-970ffd023cf7 of type vlan for network 9264f64b-25b6-4652-b639-e1b55314100e Dec 10 14:27:49.210168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1178c263-b469-4b4f-83bc-2bf34abdfdee None None] Deleting port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:49.210436 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1178c263-b469-4b4f-83bc-2bf34abdfdee None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.210932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.244065 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ce6e8d3c-ef50-458f-8827-b39e59ff058b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.251474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-14ab07af-159c-44cd-a6ff-1432f951a733', 'network_id': '14ab07af-159c-44cd-a6ff-1432f951a733', 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'fixed_ips': [{'subnet_id': '16d8bf94-466d-415d-a96c-b139907b0409'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:49.254309 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.264951 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Pushing event deleted for resources: {'Port': ['ID=43abbe6e-ce29-43e5-89c8-32eadeb4aa8d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:49.277790 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.315617 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-48f07157-7b54-4cab-b09a-b10bd829cc16 req-ec81e67e-77f7-42b8-9bf5-4f2683ad846f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 210 time: 0.0435174 Dec 10 14:27:49.318006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3aa90ec1-518b-474e-b6e8-78191dd9f054 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.319198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3aa90ec1-518b-474e-b6e8-78191dd9f054 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.335504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Attempting to bind port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:49.337750 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Attempting to bind port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '362599c9-ac81-4c25-8900-88406483b3d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:49.338247 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Attempting to bind port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 on network b306ad62-3944-4c37-b4b8-73240f2a74a5 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:49.369157 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:49.369629 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Checking segment: {'id': '362599c9-ac81-4c25-8900-88406483b3d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:49.370039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.370430 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Bound using segment: {'id': '362599c9-ac81-4c25-8900-88406483b3d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:49.370906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Bound port: 66f3c31e-7d3b-4d1f-bdd7-127ca6665343, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '362599c9-ac81-4c25-8900-88406483b3d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:49.371288 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.376079 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1178c263-b469-4b4f-83bc-2bf34abdfdee None None] For port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8ade82c0-e629-4d59-a6c3-ac7f80a0366e,segment=NetworkSegment(81dfbe5f-b26f-4202-bc76-1321bca680f6),segment_id=81dfbe5f-b26f-4202-bc76-1321bca680f6)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:49.376466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1178c263-b469-4b4f-83bc-2bf34abdfdee None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.402177 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3aa90ec1-518b-474e-b6e8-78191dd9f054 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.436163 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1178c263-b469-4b4f-83bc-2bf34abdfdee None None] Calling delete_port for 8ade82c0-e629-4d59-a6c3-ac7f80a0366e owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:49.442426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6e8d3c-ef50-458f-8827-b39e59ff058b None None] Pushing event updated for resources: {'Port': ['ID=8ade82c0-e629-4d59-a6c3-ac7f80a0366e,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:49.443938 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:49.448809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.461350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:27:49.468618 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.474742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:49.475936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.538448 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3aa90ec1-518b-474e-b6e8-78191dd9f054 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.569700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:49.579768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.588186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event updated for resources: {'Network': ['ID=9264f64b-25b6-4652-b639-e1b55314100e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:49.633753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 9264f64b-25b6-4652-b639-e1b55314100e details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:49.697049 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-698a41af-fe0e-43a6-98f5-5601b35e4f46 req-c4950b0b-1bf4-46c0-aebe-4a14cb038e1b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 210 time: 0.0947723 Dec 10 14:27:49.758110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] For port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:49.790850 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8efd0445-2110-4c2b-9aef-ff4e013153d7 req-053dcb40-9b7c-4468-9e0f-4d9d8412fd65 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 210 time: 0.1566279 Dec 10 14:27:49.797828 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3aa90ec1-518b-474e-b6e8-78191dd9f054 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:49.799030 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3aa90ec1-518b-474e-b6e8-78191dd9f054 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.7568781 Dec 10 14:27:49.805917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56484) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:49.810120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] For port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,segment=NetworkSegment(362599c9-ac81-4c25-8900-88406483b3d7),segment_id=362599c9-ac81-4c25-8900-88406483b3d7)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:49.816251 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Allocated IP 2001:db8::2 (14ab07af-159c-44cd-a6ff-1432f951a733/16d8bf94-466d-415d-a96c-b139907b0409/2b25586f-b2f1-4855-9bd5-4260a27cafb4) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:50.001961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.023849 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.107360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:50.112045 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b107e2c0-f00e-451b-a672-6809bf19eed3 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 1.7534182 Dec 10 14:27:50.115552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56488) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:50.119159 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15419313-cba8-41b1-9416-9001b2836909 None None] Sync routers for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:50.124809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a61b7cd5-e069-40ba-a36f-f8f977953345 None None] Pushing event updated for resources: {'Port': ['ID=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:50.131187 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Request body: {'subnet': {'network_id': '9264f64b-25b6-4652-b639-e1b55314100e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:50.132973 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15419313-cba8-41b1-9416-9001b2836909 None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:50.133639 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-15419313-cba8-41b1-9416-9001b2836909 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:50.155572 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1178c263-b469-4b4f-83bc-2bf34abdfdee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.198422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1178c263-b469-4b4f-83bc-2bf34abdfdee None None] Pushing event deleted for resources: {'Port': ['ID=8ade82c0-e629-4d59-a6c3-ac7f80a0366e,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:50.229623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.232065 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1178c263-b469-4b4f-83bc-2bf34abdfdee None None] No DVR routers for this DVR port 8ade82c0-e629-4d59-a6c3-ac7f80a0366e on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:50.287516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] No DVR routers for this DVR port 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d on host hv-neutron-8214 {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:27:50.294735 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.300157 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ab50af45-5919-489f-8cde-3b18a7b02b6c req-d033d762-f9e7-4fa3-bbe2-7c61b016a272 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.39 "DELETE /v2.0/ports/43abbe6e-ce29-43e5-89c8-32eadeb4aa8d HTTP/1.1" status: 204 len: 173 time: 2.3249600 Dec 10 14:27:50.300856 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '861150e5-b254-4a49-9e82-64b522c2d27d', 'name': 'network-vif-deleted', 'tag': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:27:50.305133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fee4d951-29ed-4792-a4d9-2d8e496fbf0c" -d '{"events": [{"server_uuid": "861150e5-b254-4a49-9e82-64b522c2d27d", "name": "network-vif-deleted", "tag": "43abbe6e-ce29-43e5-89c8-32eadeb4aa8d"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:27:50.322228 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Network 14ab07af-159c-44cd-a6ff-1432f951a733 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:50.326439 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:50.348735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:50.365471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Pushing event updated for resources: {'Port': ['ID=2b25586f-b2f1-4855-9bd5-4260a27cafb4,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:50.387232 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-15419313-cba8-41b1-9416-9001b2836909 None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:50.405517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:27:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4f9ce3d-b974-4718-8f6c-5ebadbdf2c5f x-openstack-request-id: req-c4f9ce3d-b974-4718-8f6c-5ebadbdf2c5f {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:27:50.406141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "861150e5-b254-4a49-9e82-64b522c2d27d", "name": "network-vif-deleted", "tag": "43abbe6e-ce29-43e5-89c8-32eadeb4aa8d", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:27:50.406672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-c4f9ce3d-b974-4718-8f6c-5ebadbdf2c5f {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:27:50.407323 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '861150e5-b254-4a49-9e82-64b522c2d27d', 'name': 'network-vif-deleted', 'tag': '43abbe6e-ce29-43e5-89c8-32eadeb4aa8d', 'status': 'completed', 'code': 200} Dec 10 14:27:50.483447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Made reservation on behalf of 434937b7dbcf4235973f66596f613320 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:50.488401 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.536800 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-73f9f180-366a-46c7-9a52-020c1e52de67 req-acfb0655-9ad1-4787-8329-76c24a583d4c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 210 time: 0.0954766 Dec 10 14:27:50.553151 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Attempting to bind port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:50.557885 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Attempting to bind port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '8de8e937-5bff-4a3e-827d-1cfc8b554f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '14ab07af-159c-44cd-a6ff-1432f951a733'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:50.558293 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Attempting to bind port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 on network 14ab07af-159c-44cd-a6ff-1432f951a733 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:50.565148 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:50.565618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Checking segment: {'id': '8de8e937-5bff-4a3e-827d-1cfc8b554f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '14ab07af-159c-44cd-a6ff-1432f951a733'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:50.565963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.566358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Bound using segment: {'id': '8de8e937-5bff-4a3e-827d-1cfc8b554f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '14ab07af-159c-44cd-a6ff-1432f951a733'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:50.571890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Bound port: 2b25586f-b2f1-4855-9bd5-4260a27cafb4, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8de8e937-5bff-4a3e-827d-1cfc8b554f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '14ab07af-159c-44cd-a6ff-1432f951a733'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:50.572352 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.719862 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] For port 2b25586f-b2f1-4855-9bd5-4260a27cafb4, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:50.728011 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:50.756480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] For port 2b25586f-b2f1-4855-9bd5-4260a27cafb4, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=2b25586f-b2f1-4855-9bd5-4260a27cafb4,segment=NetworkSegment(8de8e937-5bff-4a3e-827d-1cfc8b554f61),segment_id=8de8e937-5bff-4a3e-827d-1cfc8b554f61)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:50.800922 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-15419313-cba8-41b1-9416-9001b2836909 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:21Z', 'revision_number': 5, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:50.817456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:50.817908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.852178 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15419313-cba8-41b1-9416-9001b2836909 None None] Checking router: 196472fe-b965-4c82-9c4d-82a1d2dbdf83 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:27:50.870913 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15419313-cba8-41b1-9416-9001b2836909 None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:50.871744 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-15419313-cba8-41b1-9416-9001b2836909 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:50.891976 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.912819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:50.966044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94bff266-bfc9-4e45-a3d2-efe75091bcca None None] Pushing event updated for resources: {'Port': ['ID=2b25586f-b2f1-4855-9bd5-4260a27cafb4,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:50.985182 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-15419313-cba8-41b1-9416-9001b2836909 None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:27:50.985809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:51.011200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:51.037002 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,segment=NetworkSegment(362599c9-ac81-4c25-8900-88406483b3d7),segment_id=362599c9-ac81-4c25-8900-88406483b3d7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:51.104357 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:27:51.110549 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event updated for resources: {'Subnet': ['ID=c04497f6-020c-4007-b3ba-096d9ce6cff5,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:51.153173 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-01b88f8a-5f4b-48b8-8b14-81859fe1152c req-4e3f0e6b-6595-434f-97dc-0f2265b9055b tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/ports?device_id=861150e5-b254-4a49-9e82-64b522c2d27d HTTP/1.1" status: 200 len: 210 time: 0.2681720 Dec 10 14:27:51.154082 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:51.156025 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fa14775a-df8c-408b-81c5-bbfe2df7f969 req-07f32745-0154-4a70-95be-ff586e9ba198 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 210 time: 0.1160865 Dec 10 14:27:51.157608 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:51.196870 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Checking segment: {'id': '6081c79d-9666-4657-8a41-970ffd023cf7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '9264f64b-25b6-4652-b639-e1b55314100e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:51.197785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Network hostable DHCP agents. Network: 9264f64b-25b6-4652-b639-e1b55314100e, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:51.247141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:51.256971 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8ade82c0-e629-4d59-a6c3-ac7f80a0366e no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:51.281872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 8ade82c0-e629-4d59-a6c3-ac7f80a0366e {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:27:51.282370 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8ade82c0-e629-4d59-a6c3-ac7f80a0366e not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:27:51.396461 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Network 9264f64b-25b6-4652-b639-e1b55314100e is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:51.445167 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-15419313-cba8-41b1-9416-9001b2836909 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:21Z', 'revision_number': 5, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:51.454184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Checking segment: {'id': '56d7470d-f28a-4779-a14f-529843bbc41a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'c62b7db1-efd7-483a-896e-5dce85876171'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:51.454547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network hostable DHCP agents. Network: c62b7db1-efd7-483a-896e-5dce85876171, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:51.457682 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Subnet': ['ID=72f25b80-d812-4dab-8383-84723400ea81,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:51.504549 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15419313-cba8-41b1-9416-9001b2836909 None None] The sync data for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv is: [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:24:10Z', 'revision_number': 4, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757', 'name': '', 'network_id': '1cc2d855-81bd-4d95-a565-455c7130be80', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'mac_address': 'fa:16:3e:f8:0f:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:07Z', 'updated_at': '2021-12-10T14:24:21Z', 'revision_number': 5, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'subnets': [{'id': '630f1e53-2aa8-4b5b-8620-d9290269bc74', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:51.518293 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:51.652092 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 9264f64b-25b6-4652-b639-e1b55314100e) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:51.664880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7611d22-61f3-4e7b-ac6e-cb44fb43058c None None] Network 9264f64b-25b6-4652-b639-e1b55314100e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:51.671492 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:51.671492 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:51.671739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:51.717048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-2eff45d0-95b0-41de-9a12-fd12d1da7482 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:51.718625 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-2eff45d0-95b0-41de-9a12-fd12d1da7482 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.39 "GET /v2.0/networks?id=6ba405b9-cdef-4b06-9661-6ad5871b3c6b HTTP/1.1" status: 200 len: 796 time: 0.2408078 Dec 10 14:27:51.724446 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:51.760698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network c62b7db1-efd7-483a-896e-5dce85876171 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:51.788606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:51.789243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:51.810074 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5d545de5-3e94-41ac-9a88-9e714e4dcadf req-0de1bf72-8bfe-419a-a612-35a68328a229 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 210 time: 0.1432157 Dec 10 14:27:51.829622 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-9264f64b-25b6-4652-b639-e1b55314100e', 'network_id': '9264f64b-25b6-4652-b639-e1b55314100e', 'project_id': '434937b7dbcf4235973f66596f613320', 'fixed_ips': [{'subnet_id': 'c04497f6-020c-4007-b3ba-096d9ce6cff5'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:51.832355 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, c62b7db1-efd7-483a-896e-5dce85876171) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:51.833942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=c128e8d3-22fe-4f9d-8194-b65cbe4354ba,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:51.835265 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:51.842080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:51.842686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:51.849067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f7176d1-cfde-4e49-ba46-943f630641e5 None None] Network c62b7db1-efd7-483a-896e-5dce85876171 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:51.855648 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fd83764e-87c2-40d9-8d80-8bf2bdc381d8 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.7362342 Dec 10 14:27:51.857683 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56506) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:51.867264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Request body: {'port': {'network_id': '9264f64b-25b6-4652-b639-e1b55314100e', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-237817761'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:51.878370 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b3e59368-385d-4b09-acb5-6e3acc1705d2 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=37199cbe89a04c3096fd8e1d31a3df63 HTTP/1.1" status: 200 len: 380 time: 0.1462584 Dec 10 14:27:51.894768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'port': {'device_id': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'admin_state_up': True, 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'security_groups': ['3c07f7e7-ccab-408a-a625-67551419384e']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:52.006129 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71728072-dac1-44d2-98e2-70a530db8eef None None] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:52.020623 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-215bfae9-ecf8-4c1a-8e1f-fda31c49e3a2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 2.9724903 Dec 10 14:27:52.025101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 2001:db8::1 (14ab07af-159c-44cd-a6ff-1432f951a733/16d8bf94-466d-415d-a96c-b139907b0409/10206198-dd66-4654-bd4d-1ec4a76c42ae) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:52.025889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56510) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:52.035903 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5', 'fixed_ips': [{'subnet_id': 'dbf56665-f742-4f90-84a3-d3b89d971e5b'}, {'subnet_id': 'c128e8d3-22fe-4f9d-8194-b65cbe4354ba'}], 'name': 'tempest-PortsTestJSON-700025834'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:52.053929 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-40a2134e-c211-4e1c-8329-06ba7c6660cc tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 818 time: 3.0745554 Dec 10 14:27:52.059891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56512) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:52.330760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Allocated IP 2001:db8::2 (9264f64b-25b6-4652-b639-e1b55314100e/c04497f6-020c-4007-b3ba-096d9ce6cff5/5c343f63-64fe-47d9-bcf4-b97cb0eadea3) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:52.352452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:52.364840 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-510b5737-8610-40fb-8a6f-03f2bd553271 None None] Provisioning complete for port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:52.365585 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-510b5737-8610-40fb-8a6f-03f2bd553271 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:52.369363 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:27:52.399692 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cc717956-54d9-40f7-9895-50b24b873f7a req-c3f4b6b3-8b50-472d-b396-db934fe0df4f tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 210 time: 0.0653648 Dec 10 14:27:52.427232 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56526) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:52.459177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Made reservation on behalf of 37199cbe89a04c3096fd8e1d31a3df63 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:52.465123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:52.495360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:52.556356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:52.564532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0da61ecc-6b23-46f2-a1b9-d3bc2bf20308 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:52.676429 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13624aa0-bae2-4497-93d8-d6ba27f15504 None None] Network 14ab07af-159c-44cd-a6ff-1432f951a733 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:52.711414 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Allocated IP 172.20.0.12 (6ba405b9-cdef-4b06-9661-6ad5871b3c6b/0f3ba970-7746-4f0a-8fc3-e64be22456c1/2648b8af-c0bf-4811-b353-779f2426f8b8) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:52.713383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:52.727075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b22786c-35b6-40f9-badc-f26f3d806b36 None None] New status for floating IP 0247fae1-143d-4fab-8336-554866ced01e: DOWN {{(pid=103812) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:27:52.733239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0da61ecc-6b23-46f2-a1b9-d3bc2bf20308 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:52.754940 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:27:52.754940 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 43abbe6e-ce29-43e5-89c8-32eadeb4aa8d not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:27:52.791673 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 2b25586f-b2f1-4855-9bd5-4260a27cafb4 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:52.812568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:52.848402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-926481e8-b2f4-4e4e-8a8c-143068005409 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:52.849890 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-926481e8-b2f4-4e4e-8a8c-143068005409 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/networks?id=041ac3a9-0ca7-4449-9782-639f1235b461 HTTP/1.1" status: 200 len: 797 time: 0.2499261 Dec 10 14:27:52.882678 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfe7228d-f543-47f8-a0ef-c01528cf111c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-c62b7db1-efd7-483a-896e-5dce85876171', 'network_id': 'c62b7db1-efd7-483a-896e-5dce85876171', 'project_id': '608b3110bcfe4055bf2af3eb17ae415d', 'fixed_ips': [{'subnet_id': '72f25b80-d812-4dab-8383-84723400ea81'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:52.883554 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bfe7228d-f543-47f8-a0ef-c01528cf111c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:52.927988 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Subnet': ['ID=72f25b80-d812-4dab-8383-84723400ea81,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:52.969494 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-43378810-5e89-48a4-aba2-ce16ca260fb0 req-88d49ec7-65c9-4492-9a40-dbd1aed25056 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 210 time: 0.0493710 Dec 10 14:27:52.989469 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-b00d4a23-25b9-4518-82e5-f9f82930d7e6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 380 time: 0.1276770 Dec 10 14:27:53.007849 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'port': {'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'admin_state_up': True, 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'security_groups': ['75ce6861-87ca-43bd-a567-4e6d7abbcee4']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:53.037960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.044630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.051023 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Made reservation on behalf of 434937b7dbcf4235973f66596f613320 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:53.056056 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.072334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.074320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0da61ecc-6b23-46f2-a1b9-d3bc2bf20308 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.077341 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0da61ecc-6b23-46f2-a1b9-d3bc2bf20308 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.080863 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0da61ecc-6b23-46f2-a1b9-d3bc2bf20308 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "DELETE /v2.0/security-groups/ad7787c2-a452-4578-90f6-78c6a9cab94a HTTP/1.1" status: 204 len: 168 time: 0.6501982 Dec 10 14:27:53.084912 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56530) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:53.091192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port 93a5fd60-e98c-445d-8f5c-78cbde7497fc yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:53.101288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c62b7db1-efd7-483a-896e-5dce85876171']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:53.120192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '56d7470d-f28a-4779-a14f-529843bbc41a') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:53.121106 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '56d7470d-f28a-4779-a14f-529843bbc41a') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:53.166096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da61ecc-6b23-46f2-a1b9-d3bc2bf20308 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad7787c2-a452-4578-90f6-78c6a9cab94a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:53.168403 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] device_id is not set on port c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:53.175364 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-5ac64f1e-f70f-4c48-94b3-008cce7d2f4a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] show failed (client error): The resource could not be found. Dec 10 14:27:53.175364 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5ac64f1e-f70f-4c48-94b3-008cce7d2f4a tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "GET /v2.0/security-groups/ad7787c2-a452-4578-90f6-78c6a9cab94a HTTP/1.1" status: 404 len: 347 time: 0.0864749 Dec 10 14:27:53.177445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.187930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56532) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:53.198786 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=10206198-dd66-4654-bd4d-1ec4a76c42ae,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:53.205474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 14ab07af-159c-44cd-a6ff-1432f951a733 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:53.210739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:53.242214 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:53.242875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.306937 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.322112 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.326588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:53.327242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.355739 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Releasing vlan 377 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:27:53.356231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:27:53.383087 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:27:53.399714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2142fd4-3299-4513-8dec-cab30a9f6cfb None None] Update dhcp port {'port': {'network_id': 'b306ad62-3944-4c37-b4b8-73240f2a74a5', 'fixed_ips': [{'subnet_id': 'dbf56665-f742-4f90-84a3-d3b89d971e5b', 'ip_address': '172.20.0.2'}, {'subnet_id': 'c128e8d3-22fe-4f9d-8194-b65cbe4354ba'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': '66f3c31e-7d3b-4d1f-bdd7-127ca6665343'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:27:53.451227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a2142fd4-3299-4513-8dec-cab30a9f6cfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.453780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e79e0f2d-fc7b-478d-83fb-2accc04402c8 None None] Network c62b7db1-efd7-483a-896e-5dce85876171 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:53.470473 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:53.477865 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.488494 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.581216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Deleting port 4cd3dc5b-2842-490d-b8c8-d5f38ff8da7a {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:53.581595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.582286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.640151 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.644563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.655039 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/c62b7db1-efd7-483a-896e-5dce85876171 HTTP/1.1" status: 204 len: 168 time: 1.5916121 Dec 10 14:27:53.663584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56540) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:53.681533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.765803 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'Port': ['ID=2648b8af-c0bf-4811-b353-779f2426f8b8,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:53.773452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d41c49-9e1f-40f1-a847-bbd7d2d111f0 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Network': ['ID=c62b7db1-efd7-483a-896e-5dce85876171,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:53.789329 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:53.789688 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Network 9264f64b-25b6-4652-b639-e1b55314100e is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:53.791824 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.794969 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:53.797472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:53.812587 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:53.836013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:53.846738 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Pushing event updated for resources: {'Port': ['ID=5c343f63-64fe-47d9-bcf4-b97cb0eadea3,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:53.858070 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ea997e43-09de-418c-9084-40f21b82f9a8 None None] Provisioning complete for port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:53.861961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ea997e43-09de-418c-9084-40f21b82f9a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.917653 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.918011 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.930154 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:53.930853 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:53.959658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Calling delete_port for 4cd3dc5b-2842-490d-b8c8-d5f38ff8da7a owned by network:floatingip {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:53.965607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.3 (b306ad62-3944-4c37-b4b8-73240f2a74a5/dbf56665-f742-4f90-84a3-d3b89d971e5b/93a5fd60-e98c-445d-8f5c-78cbde7497fc) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:53.978120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.24 (b306ad62-3944-4c37-b4b8-73240f2a74a5/c128e8d3-22fe-4f9d-8194-b65cbe4354ba/93a5fd60-e98c-445d-8f5c-78cbde7497fc) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:53.997162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 2b25586f-b2f1-4855-9bd5-4260a27cafb4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=2b25586f-b2f1-4855-9bd5-4260a27cafb4,segment=NetworkSegment(8de8e937-5bff-4a3e-827d-1cfc8b554f61),segment_id=8de8e937-5bff-4a3e-827d-1cfc8b554f61)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:54.019046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Attempting to bind port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:54.027974 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Attempting to bind port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6081c79d-9666-4657-8a41-970ffd023cf7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '9264f64b-25b6-4652-b639-e1b55314100e'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:54.027974 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Attempting to bind port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 on network 9264f64b-25b6-4652-b639-e1b55314100e {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:54.034947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:54.035409 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Checking segment: {'id': '6081c79d-9666-4657-8a41-970ffd023cf7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '9264f64b-25b6-4652-b639-e1b55314100e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:54.035856 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.036954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Bound using segment: {'id': '6081c79d-9666-4657-8a41-970ffd023cf7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '9264f64b-25b6-4652-b639-e1b55314100e'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:54.041801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Bound port: 5c343f63-64fe-47d9-bcf4-b97cb0eadea3, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6081c79d-9666-4657-8a41-970ffd023cf7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '9264f64b-25b6-4652-b639-e1b55314100e'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:54.042301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.050009 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-b816c740-e16f-47e2-9847-82121ce1e6a8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1611078 Dec 10 14:27:54.064867 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Request body: {'port': {'device_id': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:54.104978 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.105750 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:54.165573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1521680789'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:54.177905 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.219930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ea997e43-09de-418c-9084-40f21b82f9a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.222457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.6 (041ac3a9-0ca7-4449-9782-639f1235b461/0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a/a0f8cb62-50c9-49f8-bbab-6c182aabaf0e) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:54.232761 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.246500 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-917c9dde-fd9d-4f87-bbf8-bef86077d9d5 req-1bc9b945-148f-405b-8fd8-c821b4d77808 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 210 time: 0.0727444 Dec 10 14:27:54.281514 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=2b25586f-b2f1-4855-9bd5-4260a27cafb4,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:54.313299 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7edfd194-6b11-4777-881f-1702406129f4 req-ece66106-bb83-445e-9608-1b0cd0fe0649 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:54.314975 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7edfd194-6b11-4777-881f-1702406129f4 req-ece66106-bb83-445e-9608-1b0cd0fe0649 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 932 time: 0.8021233 Dec 10 14:27:54.318410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Allocated IP 2001:db8::2f9 (9264f64b-25b6-4652-b639-e1b55314100e/c04497f6-020c-4007-b3ba-096d9ce6cff5/c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:54.333408 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-ea997e43-09de-418c-9084-40f21b82f9a8 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:27:54.334111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-ea997e43-09de-418c-9084-40f21b82f9a8 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:27:54.341652 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] For port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:54.358694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] For port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5c343f63-64fe-47d9-bcf4-b97cb0eadea3,segment=NetworkSegment(6081c79d-9666-4657-8a41-970ffd023cf7),segment_id=6081c79d-9666-4657-8a41-970ffd023cf7)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:54.361739 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:54.367105 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.391607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.420081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:54.423515 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.441849 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.479224 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.510876 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce33c30b-3d62-44e2-881a-87330854e7c3 None None] Pushing event updated for resources: {'Port': ['ID=5c343f63-64fe-47d9-bcf4-b97cb0eadea3,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:54.546412 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Pushing event deleted for resources: {'Port': ['ID=4cd3dc5b-2842-490d-b8c8-d5f38ff8da7a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:54.562627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-316bdc8b-a450-4d1e-a8b6-dee24ab6c24c None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:27:54.613213 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7edfd194-6b11-4777-881f-1702406129f4 req-e1504f42-75c9-4142-af8e-fb0761d7911d tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2857976 Dec 10 14:27:54.614624 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] vlan segment allocate from pool success with {'vlan_id': 358, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:27:54.667129 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 2b25586f-b2f1-4855-9bd5-4260a27cafb4 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:54.697065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks [] for floatingip, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.699715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.700888 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5a33e5c8-615d-4f06-a8a9-f90d610ec3c9 tempest-ServerActionsTestJSON-1445028928 tempest-ServerActionsTestJSON-1445028928-project] 10.222.0.57 "DELETE /v2.0/floatingips/0247fae1-143d-4fab-8336-554866ced01e HTTP/1.1" status: 204 len: 168 time: 1.5020609 Dec 10 14:27:54.701932 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.702283 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Added segment 8e524f44-5b33-4782-abbc-2f5ec518845c of type vlan for network 71506bf4-82ba-4d44-821e-cfb5b7c7af48 Dec 10 14:27:54.707485 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56544) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:54.726095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:54.726468 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.761503 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.848389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.869340 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:54.937238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.033457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.049544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-a2142fd4-3299-4513-8dec-cab30a9f6cfb None None] Allocated IP 172.20.0.18 (b306ad62-3944-4c37-b4b8-73240f2a74a5/c128e8d3-22fe-4f9d-8194-b65cbe4354ba/66f3c31e-7d3b-4d1f-bdd7-127ca6665343) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:55.083792 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.086629 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:55.088037 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.142778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.196999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a2142fd4-3299-4513-8dec-cab30a9f6cfb None None] For port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,segment=NetworkSegment(362599c9-ac81-4c25-8900-88406483b3d7),segment_id=362599c9-ac81-4c25-8900-88406483b3d7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:55.198791 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.199449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Network': ['ID=71506bf4-82ba-4d44-821e-cfb5b7c7af48,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:55.208144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.208881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.212251 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network 041ac3a9-0ca7-4449-9782-639f1235b461 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:55.213614 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-bc0d41eb-22e9-48eb-a09c-381879c91cf1 None None] Provisioning complete for port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:55.213843 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bc0d41eb-22e9-48eb-a09c-381879c91cf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.218771 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 71506bf4-82ba-4d44-821e-cfb5b7c7af48 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:27:55.225809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:55.237322 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:55.294659 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-256cc313-390c-44ae-b05c-a1f218cd8d12 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.2042170 Dec 10 14:27:55.297034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56548) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:55.317586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'subnet': {'network_id': '71506bf4-82ba-4d44-821e-cfb5b7c7af48', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:55.325845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:55.345384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Network 9264f64b-25b6-4652-b639-e1b55314100e is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:55.346241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a2142fd4-3299-4513-8dec-cab30a9f6cfb None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.380069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:55.381151 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2648b8af-c0bf-4811-b353-779f2426f8b8 {{(pid=103810) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:27:55.405375 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.415978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:55.423666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a2142fd4-3299-4513-8dec-cab30a9f6cfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.430511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:55.440171 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:55.454154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:55.454303 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.provisioning_blocks [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Transition to ACTIVE for port object 2648b8af-c0bf-4811-b353-779f2426f8b8 will not be triggered until provisioned by entity L2. {{(pid=103810) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:27:55.454821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.461597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:55.467591 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:55.468230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.536647 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2142fd4-3299-4513-8dec-cab30a9f6cfb None None] Pushing event updated for resources: {'Port': ['ID=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:55.544956 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-bc0d41eb-22e9-48eb-a09c-381879c91cf1 None None] Provisioning complete for port 10206198-dd66-4654-bd4d-1ec4a76c42ae triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:55.545598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bc0d41eb-22e9-48eb-a09c-381879c91cf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.545836 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=93a5fd60-e98c-445d-8f5c-78cbde7497fc,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:55.551905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.602382 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-bc0d41eb-22e9-48eb-a09c-381879c91cf1 None None] Port 10206198-dd66-4654-bd4d-1ec4a76c42ae cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:55.634369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event updated for resources: {'Port': ['ID=c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:55.641012 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:55.642576 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.739317 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Pushing event updated for resources: {'Port': ['ID=2648b8af-c0bf-4811-b353-779f2426f8b8,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:55.761049 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-07efc21d-cf01-4f5e-b867-c60d133c9ae4 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 941 time: 3.9022024 Dec 10 14:27:55.767477 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56552) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:55.770481 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-204a7be7-35c0-4bd3-b135-8cad0ebf1c77 None None] Provisioning complete for port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:55.770786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-204a7be7-35c0-4bd3-b135-8cad0ebf1c77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:55.775074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2befd7-3fc5-4b19-b553-e8ad74d99dea req-41ec827b-0ca2-47fe-aa83-d68e57132361 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:55.795065 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8a2befd7-3fc5-4b19-b553-e8ad74d99dea req-41ec827b-0ca2-47fe-aa83-d68e57132361 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 931 time: 0.3712416 Dec 10 14:27:55.804689 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a15feda0-8334-490f-834f-d34176ad18e8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.8082757 Dec 10 14:27:55.824935 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Request body: {'port': {'network_id': '9264f64b-25b6-4652-b639-e1b55314100e', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-857068237', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:55.826453 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.api.validators [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] bootfile-name is not in valid_values {{(pid=103810) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:27:55.826914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.api.validators [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] tftp-server is not in valid_values {{(pid=103810) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:27:55.827361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.api.validators [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] server-ip-address is not in valid_values {{(pid=103810) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:27:55.852212 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-204a7be7-35c0-4bd3-b135-8cad0ebf1c77 None None] Port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:55.855246 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Request body: {'port': {'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:55.917702 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fe02f311-3ff3-4c5d-a2b8-074c8ec84cc0 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1003 time: 3.8904748 Dec 10 14:27:55.929780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56554) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:55.937200 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=10206198-dd66-4654-bd4d-1ec4a76c42ae,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:55.940981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'dbf56665-f742-4f90-84a3-d3b89d971e5b'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:55.968706 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 14ab07af-159c-44cd-a6ff-1432f951a733 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:55.982322 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:56.015766 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Attempting to bind port 2648b8af-c0bf-4811-b353-779f2426f8b8 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:56.016261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Attempting to bind port 2648b8af-c0bf-4811-b353-779f2426f8b8 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:56.016421 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Attempting to bind port 2648b8af-c0bf-4811-b353-779f2426f8b8 on network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:56.034701 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8a2befd7-3fc5-4b19-b553-e8ad74d99dea req-cf4826e0-3c79-4932-868c-5dbe96ebb2be tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2377353 Dec 10 14:27:56.046759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:56.054935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.087275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Port 2648b8af-c0bf-4811-b353-779f2426f8b8 on network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:27:56.087601 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Attempting to bind port 2648b8af-c0bf-4811-b353-779f2426f8b8 on network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:56.128652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.130691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:56.131026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Checking segment: {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:56.132023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Bound using segment: {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:56.132458 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Bound port: 2648b8af-c0bf-4811-b353-779f2426f8b8, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'aaba56c6-c9a2-4aa8-9651-0a759874ef75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b'}}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:56.132794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.160945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef22fa1-619a-4953-9cc6-fb1d175d10d5 req-1174134f-860b-491d-a9c4-bc200c4274b9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:56.163728 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4ef22fa1-619a-4953-9cc6-fb1d175d10d5 req-1174134f-860b-491d-a9c4-bc200c4274b9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 944 time: 0.4399037 Dec 10 14:27:56.172385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.342470 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afd16e81-83ac-49e5-8593-ba8b3d00623f None None] Network 9264f64b-25b6-4652-b639-e1b55314100e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:56.408248 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:56.431288 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-87555010-d863-400b-89ad-a67bd5e13a51 None None] Provisioning complete for port 10206198-dd66-4654-bd4d-1ec4a76c42ae triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:56.438271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-87555010-d863-400b-89ad-a67bd5e13a51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.468467 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Made reservation on behalf of 434937b7dbcf4235973f66596f613320 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:27:56.472039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.498359 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-87555010-d863-400b-89ad-a67bd5e13a51 None None] Port 10206198-dd66-4654-bd4d-1ec4a76c42ae cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:56.502088 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:56.509890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a0cc83a-4610-45ff-be04-61b14f7fb7d2 None None] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:56.524518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] device_id is not set on port 3f65f411-82bd-416a-a49b-ee1e2cac992a yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:27:56.564226 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-87555010-d863-400b-89ad-a67bd5e13a51 None None] Provisioning complete for port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:56.565164 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-87555010-d863-400b-89ad-a67bd5e13a51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.647188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.738758 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-87555010-d863-400b-89ad-a67bd5e13a51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.797904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-87555010-d863-400b-89ad-a67bd5e13a51 None None] For port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5c343f63-64fe-47d9-bcf4-b97cb0eadea3,segment=NetworkSegment(6081c79d-9666-4657-8a41-970ffd023cf7),segment_id=6081c79d-9666-4657-8a41-970ffd023cf7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:56.801060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:56.812293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:56.812896 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.814358 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] 10.222.0.39 "PUT /v2.0/ports/2648b8af-c0bf-4811-b353-779f2426f8b8 HTTP/1.1" status: 200 len: 1094 time: 2.7539856 Dec 10 14:27:56.817006 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:27:56.820886 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-881bb859-51b9-483e-a21b-ff8228125477" -d '{"events": [{"name": "network-changed", "server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:27:56.876462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f59b36-c368-43a7-9c7d-58274b6ea9d2 service neutron] Pushing event updated for resources: {'Port': ['ID=2648b8af-c0bf-4811-b353-779f2426f8b8,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:56.895193 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-87555010-d863-400b-89ad-a67bd5e13a51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:56.953027 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Delete allocated IP 172.20.0.24 (b306ad62-3944-4c37-b4b8-73240f2a74a5/c128e8d3-22fe-4f9d-8194-b65cbe4354ba) {{(pid=103810) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 10 14:27:57.014279 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87555010-d863-400b-89ad-a67bd5e13a51 None None] Pushing event updated for resources: {'Port': ['ID=5c343f63-64fe-47d9-bcf4-b97cb0eadea3,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:57.022923 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4ef22fa1-619a-4953-9cc6-fb1d175d10d5 req-7e24ebca-6201-45f2-a892-f95d38c1ab73 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.8350530 Dec 10 14:27:57.038649 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:57.039043 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.051992 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:27:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b35805b-9b17-4371-9c77-9bffa828627b x-openstack-request-id: req-2b35805b-9b17-4371-9c77-9bffa828627b {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:27:57.052637 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:27:57.053140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-2b35805b-9b17-4371-9c77-9bffa828627b {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:27:57.054523 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'status': 'completed', 'code': 200} Dec 10 14:27:57.099949 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-fd19bcd9-945c-4978-8bc7-7adbc0c1ef75 None None] Provisioning complete for port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:57.100335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fd19bcd9-945c-4978-8bc7-7adbc0c1ef75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.128461 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 1b850feb-581a-47dc-bffc-30078cf4d321 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:27:57.164683 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.223506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:57.258785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a0f8cb62-50c9-49f8-bbab-6c182aabaf0e {{(pid=103811) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:27:57.337862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Allocated IP 2001:db8::283 (9264f64b-25b6-4652-b639-e1b55314100e/c04497f6-020c-4007-b3ba-096d9ce6cff5/3f65f411-82bd-416a-a49b-ee1e2cac992a) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:57.353660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:57.354114 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.380974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.416461 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:27:57.427694 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c49bfe63-6032-468b-a2b9-d062e1dc1dec None None] Sync routers for ids ['1b850feb-581a-47dc-bffc-30078cf4d321'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:27:57.435808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbd6d197-dbd4-4e96-90de-e415ee0b4370 req-41267753-d636-4b66-baf1-fcf59a15afb6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:57.439696 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fbd6d197-dbd4-4e96-90de-e415ee0b4370 req-41267753-d636-4b66-baf1-fcf59a15afb6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 931 time: 0.2401669 Dec 10 14:27:57.441372 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-954149b2-d213-4b52-b80d-56b2bb3b544e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/1b850feb-581a-47dc-bffc-30078cf4d321/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.6344306 Dec 10 14:27:57.445315 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881bb859-51b9-483e-a21b-ff8228125477 req-4699ba9e-a431-4754-997d-83423337ae9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:57.446922 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-881bb859-51b9-483e-a21b-ff8228125477 req-4699ba9e-a431-4754-997d-83423337ae9e service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=37199cbe89a04c3096fd8e1d31a3df63&device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 1097 time: 0.3910208 Dec 10 14:27:57.447478 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c49bfe63-6032-468b-a2b9-d062e1dc1dec None None] Routers {'1b850feb-581a-47dc-bffc-30078cf4d321'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:57.448125 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c49bfe63-6032-468b-a2b9-d062e1dc1dec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['1b850feb-581a-47dc-bffc-30078cf4d321'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:57.457255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Provisioning complete for port 93a5fd60-e98c-445d-8f5c-78cbde7497fc triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:57.458142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.458358 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56560) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:57.524705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.544374 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Port 93a5fd60-e98c-445d-8f5c-78cbde7497fc cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:57.547975 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c49bfe63-6032-468b-a2b9-d062e1dc1dec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:57.557777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.provisioning_blocks [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Transition to ACTIVE for port object a0f8cb62-50c9-49f8-bbab-6c182aabaf0e will not be triggered until provisioned by entity L2. {{(pid=103811) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:27:57.578957 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c49bfe63-6032-468b-a2b9-d062e1dc1dec None None] Routers {'1b850feb-581a-47dc-bffc-30078cf4d321'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:27:57.579597 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c49bfe63-6032-468b-a2b9-d062e1dc1dec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['1b850feb-581a-47dc-bffc-30078cf4d321'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:57.629639 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c49bfe63-6032-468b-a2b9-d062e1dc1dec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:27:57.630542 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c49bfe63-6032-468b-a2b9-d062e1dc1dec None None] The sync data for ids ['1b850feb-581a-47dc-bffc-30078cf4d321'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:27:57.631944 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-fbd6d197-dbd4-4e96-90de-e415ee0b4370 req-9a0ae1f1-1802-42aa-af01-b630d1a8b393 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1098223 Dec 10 14:27:57.656422 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.662460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Provisioning complete for port c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:57.662970 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.703835 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad8a1058-27cf-44c3-96f5-7a43bc146de3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:57.705885 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ad8a1058-27cf-44c3-96f5-7a43bc146de3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports/10206198-dd66-4654-bd4d-1ec4a76c42ae HTTP/1.1" status: 200 len: 911 time: 0.2357285 Dec 10 14:27:57.708453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56562) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:57.709272 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Port c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:57.716395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.760690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.780487 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Provisioning complete for port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:57.780859 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.904349 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Pushing event updated for resources: {'Port': ['ID=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:57.954991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Subnet': ['ID=090cf417-3e34-4ec3-b647-f1470883aaa8,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:57.957343 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Provisioning complete for port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:57.958024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-37c5a8df-2af1-4f0e-9e89-bb611cb4faef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:57.987641 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=93a5fd60-e98c-445d-8f5c-78cbde7497fc,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:58.021880 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881bb859-51b9-483e-a21b-ff8228125477 req-554145db-3dfe-4df3-850a-f024289e2389 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:58.023570 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-881bb859-51b9-483e-a21b-ff8228125477 req-554145db-3dfe-4df3-850a-f024289e2389 service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=37199cbe89a04c3096fd8e1d31a3df63&shared=False HTTP/1.1" status: 200 len: 897 time: 0.5434597 Dec 10 14:27:58.120932 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Checking segment: {'id': '8e524f44-5b33-4782-abbc-2f5ec518845c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': '71506bf4-82ba-4d44-821e-cfb5b7c7af48'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:58.122053 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network hostable DHCP agents. Network: 71506bf4-82ba-4d44-821e-cfb5b7c7af48, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:27:58.171772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] In _notify_port_updated(), no bound segment for port 93a5fd60-e98c-445d-8f5c-78cbde7497fc on network b306ad62-3944-4c37-b4b8-73240f2a74a5 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:27:58.177375 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:58.178625 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.182550 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-40c2a175-0376-434b-ba8a-7241a1ab8e08 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "PUT /v2.0/ports/93a5fd60-e98c-445d-8f5c-78cbde7497fc HTTP/1.1" status: 200 len: 918 time: 2.2482378 Dec 10 14:27:58.184757 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56566) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:58.218141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Attempting to bind port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:58.218465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Attempting to bind port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:58.218800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Attempting to bind port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e on network 041ac3a9-0ca7-4449-9782-639f1235b461 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:58.223143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-02a01105-22a1-4c46-b286-f95f4f33b5de None None] Provisioning complete for port 93a5fd60-e98c-445d-8f5c-78cbde7497fc triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:58.224005 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-02a01105-22a1-4c46-b286-f95f4f33b5de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.248323 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e on network 041ac3a9-0ca7-4449-9782-639f1235b461 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:27:58.248651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Attempting to bind port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e on network 041ac3a9-0ca7-4449-9782-639f1235b461 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:58.261572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:58.261941 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Checking segment: {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:58.262284 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Bound using segment: {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'} {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:58.262721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Bound port: a0f8cb62-50c9-49f8-bbab-6c182aabaf0e, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461'}}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:58.263079 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.265639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-02a01105-22a1-4c46-b286-f95f4f33b5de None None] Port 93a5fd60-e98c-445d-8f5c-78cbde7497fc cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:58.276984 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-02a01105-22a1-4c46-b286-f95f4f33b5de None None] Provisioning complete for port c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:58.277484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-02a01105-22a1-4c46-b286-f95f4f33b5de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.313867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network 71506bf4-82ba-4d44-821e-cfb5b7c7af48 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:27:58.316220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-02a01105-22a1-4c46-b286-f95f4f33b5de None None] Port c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:58.348721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de0a3e7-ccfc-409c-a52a-1a8d6b8eef35 req-2a503e5d-5d0f-4bfb-bac0-42c6747db189 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:58.351000 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7de0a3e7-ccfc-409c-a52a-1a8d6b8eef35 req-2a503e5d-5d0f-4bfb-bac0-42c6747db189 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 944 time: 0.1581199 Dec 10 14:27:58.439265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 71506bf4-82ba-4d44-821e-cfb5b7c7af48) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:58.447189 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10e95a31-07db-4f10-a11d-bcf62711f9b2 None None] Network 71506bf4-82ba-4d44-821e-cfb5b7c7af48 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:27:58.464615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:58.465216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.481911 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] For port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e, host hv-neutron-8214, cleared binding levels {{(pid=103811) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:58.489980 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7de0a3e7-ccfc-409c-a52a-1a8d6b8eef35 req-b54e67cd-1491-47d0-afda-a3e4a30b402f tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1204188 Dec 10 14:27:58.554643 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'dbf56665-f742-4f90-84a3-d3b89d971e5b'}, {'subnet_id': 'c128e8d3-22fe-4f9d-8194-b65cbe4354ba'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:27:58.555295 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] For port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103811) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:58.586202 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-71506bf4-82ba-4d44-821e-cfb5b7c7af48', 'network_id': '71506bf4-82ba-4d44-821e-cfb5b7c7af48', 'project_id': '608b3110bcfe4055bf2af3eb17ae415d', 'fixed_ips': [{'subnet_id': '090cf417-3e34-4ec3-b647-f1470883aaa8'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:27:58.587181 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.602033 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:27:58.604213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.618856 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.650379 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-802f8a0f-768e-42f2-8b27-ea6820bcfd5a tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 3.3398492 Dec 10 14:27:58.650972 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56568) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:58.689604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.781744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Allocated IP 2001:db8::2 (71506bf4-82ba-4d44-821e-cfb5b7c7af48/090cf417-3e34-4ec3-b647-f1470883aaa8/6dcd0752-fec0-4be3-946b-3795cd972c21) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:58.786381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881bb859-51b9-483e-a21b-ff8228125477 req-5238fef8-82f9-49cd-ac31-83dd4b58af8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:58.786558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:58.787234 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.787819 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-881bb859-51b9-483e-a21b-ff8228125477 req-5238fef8-82f9-49cd-ac31-83dd4b58af8d service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.7540421 Dec 10 14:27:58.819553 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:58.820443 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.822043 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] 10.222.0.39 "PUT /v2.0/ports/a0f8cb62-50c9-49f8-bbab-6c182aabaf0e HTTP/1.1" status: 200 len: 1093 time: 2.9712152 Dec 10 14:27:58.832828 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:27:58.843530 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb5586ed-12a4-4d6d-93e7-759bdfd519aa" -d '{"events": [{"name": "network-changed", "server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:27:58.922019 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.927056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:58.961821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:27:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0168dc37-c29b-423f-9356-aada8baf50b9 x-openstack-request-id: req-0168dc37-c29b-423f-9356-aada8baf50b9 {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:27:58.962506 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:27:58.962973 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-0168dc37-c29b-423f-9356-aada8baf50b9 {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:27:58.963585 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'status': 'completed', 'code': 200} Dec 10 14:27:59.029139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.054747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Deleting port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:59.054747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.058782 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1c4704f-634c-41c4-ac79-2d367227677b service neutron] Pushing event updated for resources: {'Port': ['ID=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:59.068071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Network 9264f64b-25b6-4652-b639-e1b55314100e is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:59.089510 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:59.114555 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.129335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:59.141652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.143145 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.167090 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Network 71506bf4-82ba-4d44-821e-cfb5b7c7af48 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:27:59.173484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:27:59.176285 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event updated for resources: {'Port': ['ID=3f65f411-82bd-416a-a49b-ee1e2cac992a,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:59.177568 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:27:59.182157 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Pushing event updated for resources: {'Port': ['ID=6dcd0752-fec0-4be3-946b-3795cd972c21,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:59.183594 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5586ed-12a4-4d6d-93e7-759bdfd519aa req-cc93df05-d487-4460-84c2-9d5fbd7bca9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.186511 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-bb5586ed-12a4-4d6d-93e7-759bdfd519aa req-cc93df05-d487-4460-84c2-9d5fbd7bca9c service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 1096 time: 0.2359436 Dec 10 14:27:59.272676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Attempting to bind port 6dcd0752-fec0-4be3-946b-3795cd972c21 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:27:59.273348 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Attempting to bind port 6dcd0752-fec0-4be3-946b-3795cd972c21 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '8e524f44-5b33-4782-abbc-2f5ec518845c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': '71506bf4-82ba-4d44-821e-cfb5b7c7af48'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:27:59.273898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Attempting to bind port 6dcd0752-fec0-4be3-946b-3795cd972c21 on network 71506bf4-82ba-4d44-821e-cfb5b7c7af48 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:27:59.284288 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:27:59.285100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Checking segment: {'id': '8e524f44-5b33-4782-abbc-2f5ec518845c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': '71506bf4-82ba-4d44-821e-cfb5b7c7af48'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:27:59.285813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.287258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Bound using segment: {'id': '8e524f44-5b33-4782-abbc-2f5ec518845c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': '71506bf4-82ba-4d44-821e-cfb5b7c7af48'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:27:59.288725 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Bound port: 6dcd0752-fec0-4be3-946b-3795cd972c21, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e524f44-5b33-4782-abbc-2f5ec518845c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': '71506bf4-82ba-4d44-821e-cfb5b7c7af48'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:27:59.289351 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.364269 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-30d93bbb-0fe9-4c46-bc6d-545ddf27900f tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1149 time: 3.5457032 Dec 10 14:27:59.389712 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56574) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:59.392533 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] For port 6dcd0752-fec0-4be3-946b-3795cd972c21, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:27:59.395956 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] For port 6dcd0752-fec0-4be3-946b-3795cd972c21, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6dcd0752-fec0-4be3-946b-3795cd972c21,segment=NetworkSegment(8e524f44-5b33-4782-abbc-2f5ec518845c),segment_id=8e524f44-5b33-4782-abbc-2f5ec518845c)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:27:59.408379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.417609 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a4b14f-b1ce-47f5-bde4-06c9ef9fdb0b req-b5b8612d-d2ac-4f78-affc-031c6f8399db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.419024 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-38a4b14f-b1ce-47f5-bde4-06c9ef9fdb0b req-b5b8612d-d2ac-4f78-affc-031c6f8399db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 943 time: 0.6711900 Dec 10 14:27:59.436446 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-113bdc4b-909c-46ee-b78d-63a047d06fec None None] Provisioning complete for port 3f65f411-82bd-416a-a49b-ee1e2cac992a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:27:59.437345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-113bdc4b-909c-46ee-b78d-63a047d06fec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.441244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] For port 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:27:59.441639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.449095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-e318b80d-802d-4071-8e77-64c6689ff816 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.450167 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-e318b80d-802d-4071-8e77-64c6689ff816 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=37199cbe89a04c3096fd8e1d31a3df63&device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 1097 time: 0.5602062 Dec 10 14:27:59.472201 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-113bdc4b-909c-46ee-b78d-63a047d06fec None None] Port 3f65f411-82bd-416a-a49b-ee1e2cac992a cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:27:59.480128 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.500779 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Calling delete_port for 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:27:59.542058 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-3164fdd0-e9f0-4228-b754-56b998d03f80 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2648b8af-c0bf-4811-b353-779f2426f8b8 HTTP/1.1" status: 200 len: 217 time: 0.0811932 Dec 10 14:27:59.548992 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15fbe643-dd84-45a9-9d9e-054f4e85bf5f None None] Pushing event updated for resources: {'Port': ['ID=6dcd0752-fec0-4be3-946b-3795cd972c21,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:27:59.597268 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5586ed-12a4-4d6d-93e7-759bdfd519aa req-b345db2a-5f45-4375-bc1c-36d997670c5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.599681 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-bb5586ed-12a4-4d6d-93e7-759bdfd519aa req-b345db2a-5f45-4375-bc1c-36d997670c5d service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&shared=False HTTP/1.1" status: 200 len: 898 time: 0.3978209 Dec 10 14:27:59.620530 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-811a00e4-2270-460c-89b8-f8656c00cadb tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.627413 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-811a00e4-2270-460c-89b8-f8656c00cadb tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.632686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-811a00e4-2270-460c-89b8-f8656c00cadb tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.636969 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-811a00e4-2270-460c-89b8-f8656c00cadb tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2622 time: 0.2437613 Dec 10 14:27:59.654367 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56578) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:27:59.714155 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.21 (b306ad62-3944-4c37-b4b8-73240f2a74a5/c128e8d3-22fe-4f9d-8194-b65cbe4354ba/93a5fd60-e98c-445d-8f5c-78cbde7497fc) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:27:59.729729 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-38a4b14f-b1ce-47f5-bde4-06c9ef9fdb0b req-5260c654-406b-43e4-91eb-1e5a6d85fb48 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2894773 Dec 10 14:27:59.794312 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-7b610b55-0551-4a7b-9cc6-c17b1eefadd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.796058 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-7b610b55-0551-4a7b-9cc6-c17b1eefadd6 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=0f3ba970-7746-4f0a-8fc3-e64be22456c1 HTTP/1.1" status: 200 len: 834 time: 0.2428999 Dec 10 14:27:59.937784 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5586ed-12a4-4d6d-93e7-759bdfd519aa req-9052c1ed-cdfd-462a-832e-3444375cfde7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.939286 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-bb5586ed-12a4-4d6d-93e7-759bdfd519aa req-9052c1ed-cdfd-462a-832e-3444375cfde7 service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3316283 Dec 10 14:27:59.944541 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Deleting port 6dcd0752-fec0-4be3-946b-3795cd972c21 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:27:59.944859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:27:59.957631 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3940b0df-e63d-456b-b58a-5e1e4a07e2ce req-7fbf0678-91ae-4f19-805b-323b86b6ff96 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:27:59.959794 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3940b0df-e63d-456b-b58a-5e1e4a07e2ce req-7fbf0678-91ae-4f19-805b-323b86b6ff96 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 944 time: 0.3175092 Dec 10 14:28:00.041364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-7da46914-2b1b-4c9e-ac20-7de2c2b286d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:00.042879 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-7da46914-2b1b-4c9e-ac20-7de2c2b286d8 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=6ba405b9-cdef-4b06-9661-6ad5871b3c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2367427 Dec 10 14:28:00.069955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.078646 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-754cc427-6a50-4fc0-abcd-4a65e51c20c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:00.080180 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-754cc427-6a50-4fc0-abcd-4a65e51c20c9 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 1096 time: 0.0985141 Dec 10 14:28:00.144232 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-7b3c1157-1922-4281-9140-0e9e556ef8cc service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e HTTP/1.1" status: 200 len: 217 time: 0.0419524 Dec 10 14:28:00.144858 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.149043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0438b8c6-c188-412e-bec8-565e98513481 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Deleting port 3f65f411-82bd-416a-a49b-ee1e2cac992a {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:00.149391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0438b8c6-c188-412e-bec8-565e98513481 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.192243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 10206198-dd66-4654-bd4d-1ec4a76c42ae {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:00.192573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.240396 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3940b0df-e63d-456b-b58a-5e1e4a07e2ce req-e865ee2b-1d2f-45a0-a66b-6d4c7355acd4 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2593260 Dec 10 14:28:00.290175 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-18dfa01c-616c-4d6d-879e-51edb21a81fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:00.291968 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-18dfa01c-616c-4d6d-879e-51edb21a81fc service neutron] 10.222.0.39 "GET /v2.0/subnets?id=0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a HTTP/1.1" status: 200 len: 834 time: 0.1389303 Dec 10 14:28:00.296308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.299999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=93a5fd60-e98c-445d-8f5c-78cbde7497fc,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:00.300787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] For port 6dcd0752-fec0-4be3-946b-3795cd972c21, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6dcd0752-fec0-4be3-946b-3795cd972c21,segment=NetworkSegment(8e524f44-5b33-4782-abbc-2f5ec518845c),segment_id=8e524f44-5b33-4782-abbc-2f5ec518845c)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:00.302144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.382689 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-2a8182de-31fc-466b-82f4-664c6318dd0c service neutron] 10.222.0.39 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3271904 Dec 10 14:28:00.390624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Pushing event deleted for resources: {'Port': ['ID=452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:00.394644 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Calling delete_port for 6dcd0752-fec0-4be3-946b-3795cd972c21 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:00.421575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.458213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] In _notify_port_updated(), no bound segment for port 93a5fd60-e98c-445d-8f5c-78cbde7497fc on network b306ad62-3944-4c37-b4b8-73240f2a74a5 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:28:00.464900 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:00.470273 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.474339 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ffef74f9-25fa-4199-aae3-d0c062ce45e8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "PUT /v2.0/ports/93a5fd60-e98c-445d-8f5c-78cbde7497fc HTTP/1.1" status: 200 len: 998 time: 1.9214482 Dec 10 14:28:00.475293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56580) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:00.477171 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-daffad2b-4b0a-440d-95a2-bd20654976b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:00.478728 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-daffad2b-4b0a-440d-95a2-bd20654976b7 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=041ac3a9-0ca7-4449-9782-639f1235b461&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1762557 Dec 10 14:28:00.502140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0438b8c6-c188-412e-bec8-565e98513481 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.507328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 10206198-dd66-4654-bd4d-1ec4a76c42ae owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:00.604159 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0438b8c6-c188-412e-bec8-565e98513481 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Calling delete_port for 3f65f411-82bd-416a-a49b-ee1e2cac992a owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:00.715773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-687f80fe-17b3-43d2-8b9d-9f5b767790a3 None None] Provisioning complete for port 93a5fd60-e98c-445d-8f5c-78cbde7497fc triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:00.716875 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-687f80fe-17b3-43d2-8b9d-9f5b767790a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.781337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-687f80fe-17b3-43d2-8b9d-9f5b767790a3 None None] Port 93a5fd60-e98c-445d-8f5c-78cbde7497fc cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:00.783214 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6dcd0752-fec0-4be3-946b-3795cd972c21 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:00.837056 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-468054ca-c5f7-4bd9-8b81-eafe9e240f81 req-5a67305c-212a-4b75-960c-4950385057bb service neutron] 10.222.0.39 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4402137 Dec 10 14:28:00.851497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 6dcd0752-fec0-4be3-946b-3795cd972c21 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:00.851871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.876421 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-a818179d-02da-4d32-ba16-0ffd1f21e845 service neutron] 10.222.0.39 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3833632 Dec 10 14:28:00.877010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.954135 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:00.981038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a272291-65ab-4a29-a607-477c5b0d763c None None] Network 71506bf4-82ba-4d44-821e-cfb5b7c7af48 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:00.999473 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-dd8039e1-3766-4b46-8918-933c8945b7af tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 93a5fd60-e98c-445d-8f5c-78cbde7497fc {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:00.999746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd8039e1-3766-4b46-8918-933c8945b7af tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:01.069221 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa02ca6-426e-4c37-858e-24e6fea9e8d5 req-75db42f4-bad4-4b9e-8432-99137599c636 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:01.070873 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6aa02ca6-426e-4c37-858e-24e6fea9e8d5 req-75db42f4-bad4-4b9e-8432-99137599c636 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 943 time: 0.1422710 Dec 10 14:28:01.079079 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:01.125718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Port': ['ID=6dcd0752-fec0-4be3-946b-3795cd972c21,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:01.164696 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-97baab20-1f6b-45fd-9807-e9166d172e86 req-84302b53-64fe-4c33-83fb-3472044ac29f service neutron] 10.222.0.39 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2776570 Dec 10 14:28:01.176050 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0438b8c6-c188-412e-bec8-565e98513481 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:01.185152 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd8039e1-3766-4b46-8918-933c8945b7af tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:01.190192 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6aa02ca6-426e-4c37-858e-24e6fea9e8d5 req-ea199033-28cd-43f6-a017-da0242239da5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1121027 Dec 10 14:28:01.222338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:01.228238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e5ccab2f-c302-41b5-9a53-621012e48809 None None] Could not find standard attr ID for object 6dcd0752-fec0-4be3-946b-3795cd972c21. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:28:01.259288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No DVR routers for this DVR port 6dcd0752-fec0-4be3-946b-3795cd972c21 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:01.266596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0438b8c6-c188-412e-bec8-565e98513481 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event deleted for resources: {'Port': ['ID=3f65f411-82bd-416a-a49b-ee1e2cac992a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:01.350740 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0438b8c6-c188-412e-bec8-565e98513481 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:01.359874 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0438b8c6-c188-412e-bec8-565e98513481 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "DELETE /v2.0/ports/3f65f411-82bd-416a-a49b-ee1e2cac992a HTTP/1.1" status: 204 len: 168 time: 1.6981599 Dec 10 14:28:01.374627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56586) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:01.383177 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Request body: {'port': {'name': 'tempest-new-port-name-542176138', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:01.386825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.api.validators [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] bootfile-name is not in valid_values {{(pid=103811) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:28:01.386825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.api.validators [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] tftp-server is not in valid_values {{(pid=103811) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:28:01.386825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.api.validators [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] server-ip-address is not in valid_values {{(pid=103811) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 10 14:28:01.441622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:01.635150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-dd8039e1-3766-4b46-8918-933c8945b7af tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 93a5fd60-e98c-445d-8f5c-78cbde7497fc owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:01.748611 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:28:01.776936 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:01.817492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:01.823239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=10206198-dd66-4654-bd4d-1ec4a76c42ae,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:01.860638 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8e0cb6-996b-448e-977a-27f3c75192c3 req-8a1ec91d-f3ca-42a4-9721-ed30167a1fa1 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:01.862194 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cf8e0cb6-996b-448e-977a-27f3c75192c3 req-8a1ec91d-f3ca-42a4-9721-ed30167a1fa1 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 944 time: 0.4745839 Dec 10 14:28:01.947986 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:01.954755 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-07cfcc0b-4154-4c09-91b4-922fc32f21cd admin admin] 10.222.0.57 "PUT /v2.0/routers/196472fe-b965-4c82-9c4d-82a1d2dbdf83/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2462306 Dec 10 14:28:01.957741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56588) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:01.961713 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] Sync routers for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:01.986178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:01.988478 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.002086 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.004174 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.067111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Subnet': ['ID=090cf417-3e34-4ec3-b647-f1470883aaa8,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:02.088100 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.098212 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a230384d-1b5c-4b75-84e6-85f7b4a19ace None None] Network 71506bf4-82ba-4d44-821e-cfb5b7c7af48 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:02.117601 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cf8e0cb6-996b-448e-977a-27f3c75192c3 req-abbd1f54-6ead-46b9-b59c-e38140f80364 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2424164 Dec 10 14:28:02.131514 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd8039e1-3766-4b46-8918-933c8945b7af tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.169821 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:02.175682 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd8039e1-3766-4b46-8918-933c8945b7af tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=93a5fd60-e98c-445d-8f5c-78cbde7497fc,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:02.327090 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.335042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.349199 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd8039e1-3766-4b46-8918-933c8945b7af tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.355076 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dd8039e1-3766-4b46-8918-933c8945b7af tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/93a5fd60-e98c-445d-8f5c-78cbde7497fc HTTP/1.1" status: 204 len: 168 time: 1.8730385 Dec 10 14:28:02.358544 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56592) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:02.389053 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['71506bf4-82ba-4d44-821e-cfb5b7c7af48']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.398907 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-6738fc5f-9ae6-410b-9b07-edfe7deab26f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:28:02.402005 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6738fc5f-9ae6-410b-9b07-edfe7deab26f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/93a5fd60-e98c-445d-8f5c-78cbde7497fc HTTP/1.1" status: 404 len: 333 time: 0.0441453 Dec 10 14:28:02.404109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56594) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:02.428241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e16aa92-4df6-427c-aaa8-76187cb34992 None None] DHCP port deletion for 71506bf4-82ba-4d44-821e-cfb5b7c7af48 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:02.447448 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e524f44-5b33-4782-abbc-2f5ec518845c') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.448488 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e524f44-5b33-4782-abbc-2f5ec518845c') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.467556 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185'}], 'enable_snat': True}, 'gw_port_id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:28:00Z', 'revision_number': 5, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port': {'id': 'f4d181cd-97c1-4460-a212-39807e75d9f6', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:d3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:24:04Z', 'updated_at': '2021-12-10T14:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.502702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.502990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-f7654ccb-c048-4072-8577-3868f0ffff4d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet c128e8d3-22fe-4f9d-8194-b65cbe4354ba {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:02.504227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] Checking router: 196472fe-b965-4c82-9c4d-82a1d2dbdf83 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:28:02.516303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] Routers {'196472fe-b965-4c82-9c4d-82a1d2dbdf83'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:02.517285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.524097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f7654ccb-c048-4072-8577-3868f0ffff4d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.545311 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67028849-a462-4144-9a5a-b4faad44624b req-bd9a2f59-8e70-46e6-9b59-a64243463de5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:02.546849 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-67028849-a462-4144-9a5a-b4faad44624b req-bd9a2f59-8e70-46e6-9b59-a64243463de5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 943 time: 0.2349830 Dec 10 14:28:02.551540 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 1b850feb-581a-47dc-bffc-30078cf4d321 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:28:02.553364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.575214 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Releasing vlan 358 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:02.575630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:02.578638 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:02.599643 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Deleting port f4d181cd-97c1-4460-a212-39807e75d9f6 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:02.602652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.621450 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f7654ccb-c048-4072-8577-3868f0ffff4d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.624760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6dcd0752-fec0-4be3-946b-3795cd972c21 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:02.649908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 6dcd0752-fec0-4be3-946b-3795cd972c21 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:02.650365 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6dcd0752-fec0-4be3-946b-3795cd972c21 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:02.672059 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] Set router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:02.734485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:28:02Z', 'revision_number': 6, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.758574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.762162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6df11f41-271b-4dd6-9bf7-732dd17194cf None None] The sync data for ids ['196472fe-b965-4c82-9c4d-82a1d2dbdf83'] in dv-neutron-821401-2-hyperv is: [{'id': '196472fe-b965-4c82-9c4d-82a1d2dbdf83', 'name': 'tempest-ServerActionsTestJSON-545692020-router', 'tenant_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:24:03Z', 'updated_at': '2021-12-10T14:28:02Z', 'revision_number': 6, 'project_id': '5f6602a0e1ae4bc9b52f0259e63b6e7a', 'gw_port_host': None}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:02.763839 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-67028849-a462-4144-9a5a-b4faad44624b req-f6144754-7d0e-4061-9493-704fda235298 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2087870 Dec 10 14:28:02.764973 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:02.773201 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7df707b0-2d4c-4f49-b625-44ffb5754445 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/1b850feb-581a-47dc-bffc-30078cf4d321/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0631485 Dec 10 14:28:02.773776 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56596) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:02.788799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.794470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] For port f4d181cd-97c1-4460-a212-39807e75d9f6, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4d181cd-97c1-4460-a212-39807e75d9f6,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:02.794985 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.799183 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f767de7-8ab7-498b-9c38-52f27ceca34b None None] Sync routers for ids ['1b850feb-581a-47dc-bffc-30078cf4d321'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:02.812902 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f767de7-8ab7-498b-9c38-52f27ceca34b None None] Routers {'1b850feb-581a-47dc-bffc-30078cf4d321'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:02.813910 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8f767de7-8ab7-498b-9c38-52f27ceca34b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['1b850feb-581a-47dc-bffc-30078cf4d321'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.815505 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Calling delete_port for f4d181cd-97c1-4460-a212-39807e75d9f6 owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:02.817019 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-af359a29-d42d-4cc5-954c-5aba0052dd13 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b850feb-581a-47dc-bffc-30078cf4d321 HTTP/1.1" status: 200 len: 205 time: 0.0421395 Dec 10 14:28:02.822630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.826015 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/71506bf4-82ba-4d44-821e-cfb5b7c7af48 HTTP/1.1" status: 204 len: 168 time: 4.1742947 Dec 10 14:28:02.829719 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56598) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:02.830220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56600) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:02.831141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.842944 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-365003684'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:02.852881 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8f767de7-8ab7-498b-9c38-52f27ceca34b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.862737 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f767de7-8ab7-498b-9c38-52f27ceca34b None None] Routers {'1b850feb-581a-47dc-bffc-30078cf4d321'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:02.863672 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8f767de7-8ab7-498b-9c38-52f27ceca34b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:27:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['1b850feb-581a-47dc-bffc-30078cf4d321'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.869205 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f7654ccb-c048-4072-8577-3868f0ffff4d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.874232 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b0ff4d1f-a084-4c1c-9c18-26e8ef8ca753 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.900740 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8f767de7-8ab7-498b-9c38-52f27ceca34b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:02.901891 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f767de7-8ab7-498b-9c38-52f27ceca34b None None] The sync data for ids ['1b850feb-581a-47dc-bffc-30078cf4d321'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:02.914377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716c6693-72a5-4b1c-9ad5-2ae58c121bd8 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Network': ['ID=71506bf4-82ba-4d44-821e-cfb5b7c7af48,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:02.967274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] In _notify_port_updated(), no bound segment for port c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 on network 9264f64b-25b6-4652-b639-e1b55314100e {{(pid=103811) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:28:02.974158 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:02.975388 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:02.978275 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "PUT /v2.0/ports/c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 HTTP/1.1" status: 200 len: 1129 time: 1.6023545 Dec 10 14:28:02.980461 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56602) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:03.004158 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aa28faa2-8879-462d-8359-a323f7e5d83c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.008062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event updated for resources: {'Port': ['ID=c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:03.044699 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-773142ea-ab1e-4737-8701-654b97c89021 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:03.049408 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-773142ea-ab1e-4737-8701-654b97c89021 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "GET /v2.0/ports/c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 HTTP/1.1" status: 200 len: 1129 time: 0.0608673 Dec 10 14:28:03.049809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56604) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:03.063948 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.063948 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.064394 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.064892 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.065377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.065898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.066474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.066876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.067351 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.067829 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.068302 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.068820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.069301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d43042e3-a2df-484b-98bd-ba91c8c858bd tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:03.076992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:03.082166 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.192750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f7654ccb-c048-4072-8577-3868f0ffff4d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.235478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7654ccb-c048-4072-8577-3868f0ffff4d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=c128e8d3-22fe-4f9d-8194-b65cbe4354ba,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:03.242336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f7654ccb-c048-4072-8577-3868f0ffff4d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.245593 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f7654ccb-c048-4072-8577-3868f0ffff4d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/c128e8d3-22fe-4f9d-8194-b65cbe4354ba HTTP/1.1" status: 204 len: 168 time: 0.8403015 Dec 10 14:28:03.249550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56608) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:03.251275 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3ee2d15-80b1-4afc-930a-9017de7684ae None None] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:03.287780 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aa28faa2-8879-462d-8359-a323f7e5d83c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.298532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aa28faa2-8879-462d-8359-a323f7e5d83c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.305632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] vlan segment allocate from pool success with {'vlan_id': 365, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:03.308842 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9eb8e235-513a-471a-b495-72651221de81 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Deleting port c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:03.309085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9eb8e235-513a-471a-b495-72651221de81 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.329239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.329811 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Added segment f083fa7f-10f4-47fb-a189-5b95398b801d of type vlan for network 07df8653-218f-4c6d-aa5b-3639ee6f5791 Dec 10 14:28:03.329961 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-987f148d-a4a2-49db-ac64-229ef9a30637 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet dbf56665-f742-4f90-84a3-d3b89d971e5b {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:03.335874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.346104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-afa375dd-9ff9-47e2-9a98-b4d623b95eee None None] Provisioning complete for port c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:03.346104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-afa375dd-9ff9-47e2-9a98-b4d623b95eee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.366540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-987f148d-a4a2-49db-ac64-229ef9a30637 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.418688 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-afa375dd-9ff9-47e2-9a98-b4d623b95eee None None] Port c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:03.426482 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Pushing event deleted for resources: {'Port': ['ID=f4d181cd-97c1-4460-a212-39807e75d9f6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:03.448174 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-987f148d-a4a2-49db-ac64-229ef9a30637 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.451844 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be0bf6d5-2023-4772-a5eb-3c7c9436b294 req-48dec1d1-444d-4eb2-ac2d-a122ac7b3c8c tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:03.453455 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-be0bf6d5-2023-4772-a5eb-3c7c9436b294 req-48dec1d1-444d-4eb2-ac2d-a122ac7b3c8c tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 944 time: 0.2350879 Dec 10 14:28:03.457481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.471054 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9bb2a6d-4e56-4c32-bc1b-7844215e2c0a None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:03.504076 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aa28faa2-8879-462d-8359-a323f7e5d83c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.504595 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa28faa2-8879-462d-8359-a323f7e5d83c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Fanout notify agent at l3_agent the message router_deleted on router 1b850feb-581a-47dc-bffc-30078cf4d321 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:28:03.513756 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aa28faa2-8879-462d-8359-a323f7e5d83c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.522873 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-aa28faa2-8879-462d-8359-a323f7e5d83c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/1b850feb-581a-47dc-bffc-30078cf4d321 HTTP/1.1" status: 204 len: 168 time: 0.6815624 Dec 10 14:28:03.522873 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56610) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:03.553253 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9eb8e235-513a-471a-b495-72651221de81 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.564296 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-be0bf6d5-2023-4772-a5eb-3c7c9436b294 req-b8071d20-e515-4264-a179-a4f6c596accc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1017580 Dec 10 14:28:03.572649 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.575333 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9eb8e235-513a-471a-b495-72651221de81 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Calling delete_port for c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:03.582137 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:03.582393 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.582546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.618526 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-78a21b8c-f637-41ec-beec-15f2458790f6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting subnet 16d8bf94-466d-415d-a96c-b139907b0409 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:03.655391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78a21b8c-f637-41ec-beec-15f2458790f6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.698181 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.8570449 Dec 10 14:28:03.700724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56612) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:03.708022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Request body: {'subnet': {'network_id': '07df8653-218f-4c6d-aa5b-3639ee6f5791', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:03.712054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4328e15c-b74f-4cb4-9c63-8c78743213d7 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Network': ['ID=07df8653-218f-4c6d-aa5b-3639ee6f5791,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:03.728162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 07df8653-218f-4c6d-aa5b-3639ee6f5791 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:03.734658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.736522 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.765253 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78a21b8c-f637-41ec-beec-15f2458790f6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.845394 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-987f148d-a4a2-49db-ac64-229ef9a30637 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.869931 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.871150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 196472fe-b965-4c82-9c4d-82a1d2dbdf83 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:28:03.887945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.889452 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-44b15035-8b4f-4682-a327-b3b61022cbe1 admin admin] 10.222.0.57 "DELETE /v2.0/routers/196472fe-b965-4c82-9c4d-82a1d2dbdf83 HTTP/1.1" status: 204 len: 168 time: 1.9309349 Dec 10 14:28:03.894842 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56616) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:03.906050 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78a21b8c-f637-41ec-beec-15f2458790f6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.956886 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-c6beba05-3402-46ff-9a52-5c61b4130b14 admin admin] Deleting subnet 630f1e53-2aa8-4b5b-8620-d9290269bc74 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:03.961124 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6beba05-3402-46ff-9a52-5c61b4130b14 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:03.997062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Made reservation on behalf of 608b3110bcfe4055bf2af3eb17ae415d for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:04.001277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.012292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6beba05-3402-46ff-9a52-5c61b4130b14 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.142252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-987f148d-a4a2-49db-ac64-229ef9a30637 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.172193 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987f148d-a4a2-49db-ac64-229ef9a30637 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=dbf56665-f742-4f90-84a3-d3b89d971e5b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:04.184672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6beba05-3402-46ff-9a52-5c61b4130b14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.197256 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9f67eba-787d-4dcc-9fed-05ec61b24b9b None None] Network b306ad62-3944-4c37-b4b8-73240f2a74a5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:04.206696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-987f148d-a4a2-49db-ac64-229ef9a30637 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.212456 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-987f148d-a4a2-49db-ac64-229ef9a30637 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/dbf56665-f742-4f90-84a3-d3b89d971e5b HTTP/1.1" status: 204 len: 168 time: 0.9596231 Dec 10 14:28:04.213343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56618) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:04.292706 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9eb8e235-513a-471a-b495-72651221de81 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.297542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.300951 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e8f842e2-efca-44b0-8036-e765396400a0 None None] Provisioning complete for port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:04.301547 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e8f842e2-efca-44b0-8036-e765396400a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.344808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a1ce0a-73dc-4679-9fca-9ad0b1c2c214 req-edc9cad3-2c97-425f-b595-3b2fa97ea0de tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:04.346413 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-75a1ce0a-73dc-4679-9fca-9ad0b1c2c214 req-edc9cad3-2c97-425f-b595-3b2fa97ea0de tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 943 time: 0.4089079 Dec 10 14:28:04.403346 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 2648b8af-c0bf-4811-b353-779f2426f8b8 details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:28:04.436121 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78a21b8c-f637-41ec-beec-15f2458790f6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.473136 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-75a1ce0a-73dc-4679-9fca-9ad0b1c2c214 req-125282c7-db24-48ad-bdd7-0e0ab61d4a38 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1176381 Dec 10 14:28:04.477861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78a21b8c-f637-41ec-beec-15f2458790f6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Subnet': ['ID=16d8bf94-466d-415d-a96c-b139907b0409,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:04.483445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-78a21b8c-f637-41ec-beec-15f2458790f6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.491346 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-78a21b8c-f637-41ec-beec-15f2458790f6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/16d8bf94-466d-415d-a96c-b139907b0409 HTTP/1.1" status: 204 len: 168 time: 0.9681973 Dec 10 14:28:04.491559 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5385fac-bbe0-4e48-9a55-f77f9273a076 None None] DHCP port deletion for b306ad62-3944-4c37-b4b8-73240f2a74a5 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:04.491682 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56620) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:04.544509 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cff6c896-8ad7-4ad9-a153-6e4e2250704a None None] Network 14ab07af-159c-44cd-a6ff-1432f951a733 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:04.638250 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:04.644463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb8e235-513a-471a-b495-72651221de81 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event deleted for resources: {'Port': ['ID=c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:04.676561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.680992 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'port_id': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'mac_address': 'fa:16:3e:a5:15:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:28:04.690040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9eb8e235-513a-471a-b495-72651221de81 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.692139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d5385fac-bbe0-4e48-9a55-f77f9273a076 None None] Deleting port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:04.692741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d5385fac-bbe0-4e48-9a55-f77f9273a076 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.695755 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9eb8e235-513a-471a-b495-72651221de81 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "DELETE /v2.0/ports/c9e64f8d-3d59-4f0f-86d3-d1dc3a0880e7 HTTP/1.1" status: 204 len: 168 time: 1.6427960 Dec 10 14:28:04.696817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56624) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:04.702015 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:04.784494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:04.785681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.794872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:04.795341 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 452ed99a-8bd0-4d0d-bc1a-f0e0a6d6d757 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:04.795866 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:04.839251 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6beba05-3402-46ff-9a52-5c61b4130b14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.854136 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.858058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-4eacfc9e-28ad-4c33-b87b-a2e3a1eecf79 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Deleting subnet c04497f6-020c-4007-b3ba-096d9ce6cff5 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:04.876209 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4eacfc9e-28ad-4c33-b87b-a2e3a1eecf79 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.886571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f281b65f-57ce-4fad-9afa-c712d1da8acf req-c5879948-7b34-4b84-81dd-09e0e9ebe86b tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:04.887125 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6beba05-3402-46ff-9a52-5c61b4130b14 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=630f1e53-2aa8-4b5b-8620-d9290269bc74,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:04.888420 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f281b65f-57ce-4fad-9afa-c712d1da8acf req-c5879948-7b34-4b84-81dd-09e0e9ebe86b tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 944 time: 0.2057829 Dec 10 14:28:04.895259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2648b8af-c0bf-4811-b353-779f2426f8b8 {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:28:04.901697 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d5385fac-bbe0-4e48-9a55-f77f9273a076 None None] For port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,segment=NetworkSegment(362599c9-ac81-4c25-8900-88406483b3d7),segment_id=362599c9-ac81-4c25-8900-88406483b3d7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:04.905206 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d5385fac-bbe0-4e48-9a55-f77f9273a076 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.935463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6beba05-3402-46ff-9a52-5c61b4130b14 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:04.947153 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c6beba05-3402-46ff-9a52-5c61b4130b14 admin admin] 10.222.0.57 "DELETE /v2.0/subnets/630f1e53-2aa8-4b5b-8620-d9290269bc74 HTTP/1.1" status: 204 len: 168 time: 1.0410295 Dec 10 14:28:04.947317 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b0d5b70-7197-455b-9e73-3283af5a15a7 None None] Network 1cc2d855-81bd-4d95-a565-455c7130be80 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:04.947435 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56626) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:04.960055 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d5385fac-bbe0-4e48-9a55-f77f9273a076 None None] Calling delete_port for 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:04.963024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:04.969527 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] For port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,segment=NetworkSegment(362599c9-ac81-4c25-8900-88406483b3d7),segment_id=362599c9-ac81-4c25-8900-88406483b3d7)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:04.970040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.007955 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] DHCP port deletion for 14ab07af-159c-44cd-a6ff-1432f951a733 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:05.018303 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:28:05.029830 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:05.032757 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.047178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4eacfc9e-28ad-4c33-b87b-a2e3a1eecf79 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.068584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.094260 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f281b65f-57ce-4fad-9afa-c712d1da8acf req-8c1680ce-d073-477a-a0ec-2fbb1d45b88a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1839881 Dec 10 14:28:05.118386 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:05.118750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.197073 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event updated for resources: {'Subnet': ['ID=51bcb3f8-31ce-4d4a-baf7-8671b48110e6,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:05.243400 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Deleting port 37236f76-568d-45f5-8305-f465552d6622 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:05.243400 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.243718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.243718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device a0f8cb62-50c9-49f8-bbab-6c182aabaf0e details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:28:05.264887 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Checking segment: {'id': 'f083fa7f-10f4-47fb-a189-5b95398b801d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '07df8653-218f-4c6d-aa5b-3639ee6f5791'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:05.265526 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network hostable DHCP agents. Network: 07df8653-218f-4c6d-aa5b-3639ee6f5791, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:05.273066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port 2b25586f-b2f1-4855-9bd5-4260a27cafb4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=2b25586f-b2f1-4855-9bd5-4260a27cafb4,segment=NetworkSegment(8de8e937-5bff-4a3e-827d-1cfc8b554f61),segment_id=8de8e937-5bff-4a3e-827d-1cfc8b554f61)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:05.273066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.293567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 2b25586f-b2f1-4855-9bd5-4260a27cafb4 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:05.293796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] For port 37236f76-568d-45f5-8305-f465552d6622, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=37236f76-568d-45f5-8305-f465552d6622,segment=NetworkSegment(1af6b7ee-efdc-44ed-822a-b8fd8a223e56),segment_id=1af6b7ee-efdc-44ed-822a-b8fd8a223e56)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:05.294078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.305173 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4eacfc9e-28ad-4c33-b87b-a2e3a1eecf79 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.312859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Calling delete_port for 37236f76-568d-45f5-8305-f465552d6622 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:05.314884 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.352499 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.363850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:05.369133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No DVR routers for this DVR port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:05.386685 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Network 07df8653-218f-4c6d-aa5b-3639ee6f5791 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:05.413905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e826c9ea-af02-42bc-bb68-a0ebc2815915 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.453831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=2648b8af-c0bf-4811-b353-779f2426f8b8,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:05.479776 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 07df8653-218f-4c6d-aa5b-3639ee6f5791) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:05.488745 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:05.489355 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.498742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38706898-02db-4d24-8d7f-7b1ebef9c507 None None] Network 07df8653-218f-4c6d-aa5b-3639ee6f5791 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:05.505516 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4d181cd-97c1-4460-a212-39807e75d9f6 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:05.508532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d5385fac-bbe0-4e48-9a55-f77f9273a076 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.510095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.514619 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4eacfc9e-28ad-4c33-b87b-a2e3a1eecf79 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.520170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.550561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b306ad62-3944-4c37-b4b8-73240f2a74a5']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:05.568968 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '362599c9-ac81-4c25-8900-88406483b3d7') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:05.572150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '362599c9-ac81-4c25-8900-88406483b3d7') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:05.583437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.588466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eacfc9e-28ad-4c33-b87b-a2e3a1eecf79 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event deleted for resources: {'Subnet': ['ID=c04497f6-020c-4007-b3ba-096d9ce6cff5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:05.610277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.614394 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-255a6d39-50f6-4a11-ad20-298e9dd50b2b None None] DHCP port deletion for 1cc2d855-81bd-4d95-a565-455c7130be80 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:05.616400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: f4d181cd-97c1-4460-a212-39807e75d9f6 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:05.616751 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4d181cd-97c1-4460-a212-39807e75d9f6 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:05.620276 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Releasing vlan 385 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:05.620934 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:05.624583 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:05.627276 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5385fac-bbe0-4e48-9a55-f77f9273a076 None None] Pushing event deleted for resources: {'Port': ['ID=66f3c31e-7d3b-4d1f-bdd7-127ca6665343,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:05.643130 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3fe97b3e-883c-473f-819c-520c83ff8cbf tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 1.9340222 Dec 10 14:28:05.643324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] Deleting port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:05.643324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.644394 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5385fac-bbe0-4e48-9a55-f77f9273a076 None None] No DVR routers for this DVR port 66f3c31e-7d3b-4d1f-bdd7-127ca6665343 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:05.645216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4eacfc9e-28ad-4c33-b87b-a2e3a1eecf79 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.647533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56630) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:05.649032 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4eacfc9e-28ad-4c33-b87b-a2e3a1eecf79 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "DELETE /v2.0/subnets/c04497f6-020c-4007-b3ba-096d9ce6cff5 HTTP/1.1" status: 204 len: 168 time: 0.9496293 Dec 10 14:28:05.650681 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No DVR routers for this DVR port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:05.652291 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56632) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:05.655912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d9a6d68-4bde-413f-bacc-6ba553573ffa None None] Network 9264f64b-25b6-4652-b639-e1b55314100e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:05.668461 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=2b25586f-b2f1-4855-9bd5-4260a27cafb4,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:05.695544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:05.725737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.771134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-255a6d39-50f6-4a11-ad20-298e9dd50b2b None None] The port '37236f76-568d-45f5-8305-f465552d6622' was deleted {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 10 14:28:05.813801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:28:05.829371 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] No DVR routers for this DVR port 37236f76-568d-45f5-8305-f465552d6622 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:05.838186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Pushing event deleted for resources: {'Port': ['ID=37236f76-568d-45f5-8305-f465552d6622,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:05.848109 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30db5928-4d13-45a7-b5d9-cebb6d7955c7 req-2872ee7e-51e6-4569-87c2-8832a2a4d1d1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:05.853469 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] For port 2b25586f-b2f1-4855-9bd5-4260a27cafb4, host dv-neutron-821401-2-hyperv, got binding levels [] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:05.853469 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.853702 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-30db5928-4d13-45a7-b5d9-cebb6d7955c7 req-2872ee7e-51e6-4569-87c2-8832a2a4d1d1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 943 time: 0.2412217 Dec 10 14:28:05.853702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.858024 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.866123 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:28:05.896530 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['14ab07af-159c-44cd-a6ff-1432f951a733']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:05.906452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-07df8653-218f-4c6d-aa5b-3639ee6f5791', 'network_id': '07df8653-218f-4c6d-aa5b-3639ee6f5791', 'project_id': '608b3110bcfe4055bf2af3eb17ae415d', 'fixed_ips': [{'subnet_id': '51bcb3f8-31ce-4d4a-baf7-8671b48110e6'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:05.907636 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.909772 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8de8e937-5bff-4a3e-827d-1cfc8b554f61') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:05.910210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] Calling delete_port for 2b25586f-b2f1-4855-9bd5-4260a27cafb4 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:05.910347 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8de8e937-5bff-4a3e-827d-1cfc8b554f61') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:05.911188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.911924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.912901 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.913583 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.913583 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.914426 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.914426 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.914605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.914924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.915412 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.915775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.916112 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.916451 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:05.916795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.ipam_backend_mixin [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] Port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 was not found and therefore no delete operation was performed {{(pid=103812) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 10 14:28:05.931010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.932278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.968528 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.975931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] Pushing event deleted for resources: {'Port': ['ID=2b25586f-b2f1-4855-9bd5-4260a27cafb4,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:05.980204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:05.984583 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e347f873-4714-436c-b739-0db31c64c0ed None None] No DVR routers for this DVR port 2b25586f-b2f1-4855-9bd5-4260a27cafb4 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:05.996699 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-30db5928-4d13-45a7-b5d9-cebb6d7955c7 req-07760c4d-30be-4002-aacd-1e5679fe415a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1272151 Dec 10 14:28:05.997357 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Releasing vlan 375 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:05.997848 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:06.003080 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:06.007281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.047249 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.054078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.054410 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a0f8cb62-50c9-49f8-bbab-6c182aabaf0e {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:28:06.059185 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/networks/b306ad62-3944-4c37-b4b8-73240f2a74a5 HTTP/1.1" status: 204 len: 168 time: 1.8450012 Dec 10 14:28:06.069985 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.072421 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56634) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:06.090645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Deleting port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:06.093734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.099064 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:06.135031 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a500576c-7fb9-4030-85e8-faeb54403dd1 None None] DHCP port deletion for 9264f64b-25b6-4652-b639-e1b55314100e request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:06.136038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a49c3ec-5d0a-47ed-b43c-ee8ce6d0b217 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Network': ['ID=b306ad62-3944-4c37-b4b8-73240f2a74a5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:06.168739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.172769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1cc2d855-81bd-4d95-a565-455c7130be80']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:06.187935 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.189220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.190275 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Allocated IP 2001:db8::f816:3eff:fea4:c59f (07df8653-218f-4c6d-aa5b-3639ee6f5791/51bcb3f8-31ce-4d4a-baf7-8671b48110e6/54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:06.194102 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/networks/14ab07af-159c-44cd-a6ff-1432f951a733 HTTP/1.1" status: 204 len: 168 time: 1.7021725 Dec 10 14:28:06.202299 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56638) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:06.217508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-827420336', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:06.220087 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1af6b7ee-efdc-44ed-822a-b8fd8a223e56') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:06.220387 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1af6b7ee-efdc-44ed-822a-b8fd8a223e56') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:06.230636 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c5d92b8-9c7f-4773-942c-120873b6f203 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:06.237252 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5c5d92b8-9c7f-4773-942c-120873b6f203 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.1588402 Dec 10 14:28:06.239958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.242770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56640) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:06.248140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1397383b-dca9-481c-b602-1a615e3895fe tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Network': ['ID=14ab07af-159c-44cd-a6ff-1432f951a733,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:06.271838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.284793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] For port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5c343f63-64fe-47d9-bcf4-b97cb0eadea3,segment=NetworkSegment(6081c79d-9666-4657-8a41-970ffd023cf7),segment_id=6081c79d-9666-4657-8a41-970ffd023cf7)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:06.285320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.301726 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.307627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.314409 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Releasing vlan 389 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:06.314806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.317463 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Calling delete_port for 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:06.323274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:06.330543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c12ecc-6f61-40a0-adf6-57efc61fc36e req-0cea207a-fb7a-4dc4-9ef5-ffab495ba4af tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:06.332220 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-50c12ecc-6f61-40a0-adf6-57efc61fc36e req-0cea207a-fb7a-4dc4-9ef5-ffab495ba4af tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 945 time: 0.1066194 Dec 10 14:28:06.339790 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-a500576c-7fb9-4030-85e8-faeb54403dd1 None None] Deleting port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:06.340274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a500576c-7fb9-4030-85e8-faeb54403dd1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:06.344131 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:06.397894 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.399292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.424211 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e8b3cdce-8cd2-4d2b-a329-a487bd8101a7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.1764934 Dec 10 14:28:06.427196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56642) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:06.440518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-848450938'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:06.446541 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a500576c-7fb9-4030-85e8-faeb54403dd1 None None] For port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5c343f63-64fe-47d9-bcf4-b97cb0eadea3,segment=NetworkSegment(6081c79d-9666-4657-8a41-970ffd023cf7),segment_id=6081c79d-9666-4657-8a41-970ffd023cf7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:06.447057 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a500576c-7fb9-4030-85e8-faeb54403dd1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.464595 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-50c12ecc-6f61-40a0-adf6-57efc61fc36e req-d6f0db52-6918-485b-9c14-a143c79c497e tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1216958 Dec 10 14:28:06.492054 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['a0f8cb62-50c9-49f8-bbab-6c182aabaf0e'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:28:06.494175 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['2648b8af-c0bf-4811-b353-779f2426f8b8'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:28:06.498223 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-a500576c-7fb9-4030-85e8-faeb54403dd1 None None] Calling delete_port for 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:06.502661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.515610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.518618 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] 10.222.0.57 "DELETE /v2.0/networks/1cc2d855-81bd-4d95-a565-455c7130be80 HTTP/1.1" status: 204 len: 168 time: 1.5710585 Dec 10 14:28:06.522507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.546466 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d538a92b-06e6-4971-97fa-f85d9af1c3e9 admin admin] Pushing event deleted for resources: {'Network': ['ID=1cc2d855-81bd-4d95-a565-455c7130be80,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:06.620638 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 2b25586f-b2f1-4855-9bd5-4260a27cafb4 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:06.626577 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.635161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.642992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:06.648369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.655687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 2b25586f-b2f1-4855-9bd5-4260a27cafb4 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:06.656038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 2b25586f-b2f1-4855-9bd5-4260a27cafb4 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:06.659791 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 37236f76-568d-45f5-8305-f465552d6622 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:06.692108 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] No DVR routers for this DVR port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:06.698596 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 37236f76-568d-45f5-8305-f465552d6622 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:06.698954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 37236f76-568d-45f5-8305-f465552d6622 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:06.699380 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:06.719186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event deleted for resources: {'Port': ['ID=5c343f63-64fe-47d9-bcf4-b97cb0eadea3,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:06.730945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.758701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:06.759060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:06.766281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.826399 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Network 07df8653-218f-4c6d-aa5b-3639ee6f5791 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:06.834983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Subnet': ['ID=51bcb3f8-31ce-4d4a-baf7-8671b48110e6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:06.837809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:06.846856 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a500576c-7fb9-4030-85e8-faeb54403dd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.850566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:06.867655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] vlan segment allocate from pool success with {'vlan_id': 360, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:06.874817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.879973 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Pushing event updated for resources: {'Port': ['ID=54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:06.883227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.899225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.899796 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Added segment ca55cd62-cb38-40e2-af56-731a0beddde9 of type vlan for network 77cafb0a-7176-47c2-8411-eb7f3bd67195 Dec 10 14:28:06.904405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a500576c-7fb9-4030-85e8-faeb54403dd1 None None] No DVR routers for this DVR port 5c343f63-64fe-47d9-bcf4-b97cb0eadea3 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:06.915795 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9264f64b-25b6-4652-b639-e1b55314100e']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:06.918105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.933262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6081c79d-9666-4657-8a41-970ffd023cf7') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:06.933605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6081c79d-9666-4657-8a41-970ffd023cf7') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:06.940959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07df8653-218f-4c6d-aa5b-3639ee6f5791']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:06.952977 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f083fa7f-10f4-47fb-a189-5b95398b801d') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:06.955713 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f083fa7f-10f4-47fb-a189-5b95398b801d') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:06.958589 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a500576c-7fb9-4030-85e8-faeb54403dd1 None None] Pushing event deleted for resources: {'Port': ['ID=5c343f63-64fe-47d9-bcf4-b97cb0eadea3,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:06.965590 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.966297 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.982081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:06.991637 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56646) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:06.994352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.003456 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.009980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Releasing vlan 352 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:07.010710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:07.014143 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:07.016149 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Releasing vlan 365 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:07.016149 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:07.020113 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:07.086064 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-549c5f28-43e8-434c-a8c4-d8db077ef5be admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=5f6602a0e1ae4bc9b52f0259e63b6e7a&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0964808 Dec 10 14:28:07.088786 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56650) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:07.159130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8964b770-3546-4aae-a2f9-687b7f97e997 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.169254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:28:07.169254 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:28:07.169254 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': '07df8653-218f-4c6d-aa5b-3639ee6f5791'}] Dec 10 14:28:07.169254 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:07.169889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:07.182947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.184146 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8964b770-3546-4aae-a2f9-687b7f97e997 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.184745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Attempting to bind port 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:07.185119 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Attempting to bind port 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'f083fa7f-10f4-47fb-a189-5b95398b801d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '07df8653-218f-4c6d-aa5b-3639ee6f5791'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:07.185514 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Attempting to bind port 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91 on network 07df8653-218f-4c6d-aa5b-3639ee6f5791 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:07.189358 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:07.189991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.206201 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 27, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:07.206607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Checking segment: {'id': 'f083fa7f-10f4-47fb-a189-5b95398b801d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '07df8653-218f-4c6d-aa5b-3639ee6f5791'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:07.207097 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.207524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Bound using segment: {'id': 'f083fa7f-10f4-47fb-a189-5b95398b801d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '07df8653-218f-4c6d-aa5b-3639ee6f5791'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:07.208008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Bound port: 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f083fa7f-10f4-47fb-a189-5b95398b801d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '07df8653-218f-4c6d-aa5b-3639ee6f5791'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:07.208401 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.261452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.265646 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.271649 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] 10.222.0.57 "DELETE /v2.0/networks/9264f64b-25b6-4652-b639-e1b55314100e HTTP/1.1" status: 204 len: 168 time: 1.6145327 Dec 10 14:28:07.295529 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c162d1b9-8a0b-4085-a903-8a86e4091084 req-70a84ad4-2154-473f-8de7-60065fb93d70 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:07.297154 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c162d1b9-8a0b-4085-a903-8a86e4091084 req-70a84ad4-2154-473f-8de7-60065fb93d70 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 944 time: 0.1965272 Dec 10 14:28:07.304428 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Network': ['ID=77cafb0a-7176-47c2-8411-eb7f3bd67195,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:07.308507 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8964b770-3546-4aae-a2f9-687b7f97e997 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.319047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8964b770-3546-4aae-a2f9-687b7f97e997 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.319047 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8964b770-3546-4aae-a2f9-687b7f97e997 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/a43dab61-8dc1-4dde-b5f4-df32084521ea HTTP/1.1" status: 204 len: 168 time: 0.2234542 Dec 10 14:28:07.346397 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96273f59-bc19-49ec-be92-a3833809a533 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913 tempest-ExtraDHCPOptionsIpV6TestJSON-178492913-project] Pushing event deleted for resources: {'Network': ['ID=9264f64b-25b6-4652-b639-e1b55314100e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:07.347841 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8964b770-3546-4aae-a2f9-687b7f97e997 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a43dab61-8dc1-4dde-b5f4-df32084521ea,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:07.351516 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 77cafb0a-7176-47c2-8411-eb7f3bd67195 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:07.364375 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-11ddb449-4e0c-4cc1-b4fe-269953cf130b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.9307277 Dec 10 14:28:07.365841 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56656) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:07.378484 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': '77cafb0a-7176-47c2-8411-eb7f3bd67195', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:07.412678 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c162d1b9-8a0b-4085-a903-8a86e4091084 req-8d38a7fc-8e19-4c8e-8c82-3cb71c595571 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0879724 Dec 10 14:28:07.557880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] For port 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:07.565287 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.605008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] For port 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91,segment=NetworkSegment(f083fa7f-10f4-47fb-a189-5b95398b801d),segment_id=f083fa7f-10f4-47fb-a189-5b95398b801d)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:07.609378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.668092 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:07.673077 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.674776 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.678424 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.680474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e77e02-49e7-4b8b-b40c-0e33974a089e req-55a134bd-1014-490a-8343-ede3f51df299 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:07.683258 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-29e77e02-49e7-4b8b-b40c-0e33974a089e req-55a134bd-1014-490a-8343-ede3f51df299 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 945 time: 0.1198602 Dec 10 14:28:07.733226 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.770059 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-29e77e02-49e7-4b8b-b40c-0e33974a089e req-c8f00391-82bb-4abe-a2f8-b2afd77b3cca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0809956 Dec 10 14:28:07.793467 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 172.26.2.85 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/5728904e-09e9-42c8-a249-a9748c03956f) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:07.801370 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e94c6bdc-1fca-45de-b542-071b0dd29b09 None None] Pushing event updated for resources: {'Port': ['ID=54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:07.844856 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcb20bb5-637b-4526-b50a-661a67f947ec None None] Network 07df8653-218f-4c6d-aa5b-3639ee6f5791 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:07.871127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Deleting port 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:07.871850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:07.983872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8d07b05-c52b-483a-9396-1502ffc74ace None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:28:07.985851 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] For port 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91,segment=NetworkSegment(f083fa7f-10f4-47fb-a189-5b95398b801d),segment_id=f083fa7f-10f4-47fb-a189-5b95398b801d)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:07.986300 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.005917 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Calling delete_port for 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:08.010209 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.034307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56666) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:08.088534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.120256 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8d07b05-c52b-483a-9396-1502ffc74ace None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:28:08.139737 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.166220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=53b74490-ce32-4c9b-aad3-0d2d044229bc,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:08.189219 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Checking segment: {'id': 'ca55cd62-cb38-40e2-af56-731a0beddde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '77cafb0a-7176-47c2-8411-eb7f3bd67195'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:08.189499 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network hostable DHCP agents. Network: 77cafb0a-7176-47c2-8411-eb7f3bd67195, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:08.196552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:08.201679 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:08.208754 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:08.253531 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=5728904e-09e9-42c8-a249-a9748c03956f,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:08.261332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.288952 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Port': ['ID=54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:08.292682 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No DVR routers for this DVR port 54ff9ab4-9c7e-4b3a-a58b-fd6372e29b91 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:08.330243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 77cafb0a-7176-47c2-8411-eb7f3bd67195 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:08.340623 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-10a47329-9067-46c3-8ea8-9f6e22130911 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=434937b7dbcf4235973f66596f613320&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3051305 Dec 10 14:28:08.357288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56676) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:08.397093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device a0f8cb62-50c9-49f8-bbab-6c182aabaf0e up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:08.427563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.442995 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f59e40b-aead-42da-882a-d0bdef3462f8 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:08.477017 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 77cafb0a-7176-47c2-8411-eb7f3bd67195) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:08.477017 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07df8653-218f-4c6d-aa5b-3639ee6f5791']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:08.480983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:08.481828 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.495848 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f083fa7f-10f4-47fb-a189-5b95398b801d') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:08.496160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f083fa7f-10f4-47fb-a189-5b95398b801d') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:08.497935 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb51a40f-66fd-4a29-801f-bba4b3396835 None None] Network 77cafb0a-7176-47c2-8411-eb7f3bd67195 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:08.520691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.523500 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e225627-b916-46af-8b2d-9bf016e38fde admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.576176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e225627-b916-46af-8b2d-9bf016e38fde admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.582138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.596473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-29910282-3c4b-4f50-b732-fc45b8f36689 None None] Provisioning complete for port 5728904e-09e9-42c8-a249-a9748c03956f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:08.596954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-29910282-3c4b-4f50-b732-fc45b8f36689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.600029 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Releasing vlan 365 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:08.601519 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:08.605172 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:08.633687 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e7f7189c-d4b0-4b04-a78e-d57378b1c951 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2651184 Dec 10 14:28:08.634334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56686) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:08.642960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:28:08.654606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:08.655149 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.681975 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-29910282-3c4b-4f50-b732-fc45b8f36689 None None] Port 5728904e-09e9-42c8-a249-a9748c03956f cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:08.701642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': '77cafb0a-7176-47c2-8411-eb7f3bd67195', 'name': 'tempest-PortsTestJSON-243918479'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:08.726809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-77cafb0a-7176-47c2-8411-eb7f3bd67195', 'network_id': '77cafb0a-7176-47c2-8411-eb7f3bd67195', 'project_id': '7a25938276dc428b9a5723e37d120269', 'fixed_ips': [{'subnet_id': '53b74490-ce32-4c9b-aad3-0d2d044229bc'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:08.727677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.827945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dac0b238-5f5e-4486-aee9-f3e9386540cb req-939faf7a-8226-4e5f-a977-5710f5078dfc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:08.831088 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-dac0b238-5f5e-4486-aee9-f3e9386540cb req-939faf7a-8226-4e5f-a977-5710f5078dfc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 944 time: 0.1423562 Dec 10 14:28:08.843286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.885933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.897669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.901109 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/07df8653-218f-4c6d-aa5b-3639ee6f5791 HTTP/1.1" status: 204 len: 168 time: 3.2510307 Dec 10 14:28:08.905705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56692) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:08.925222 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-dac0b238-5f5e-4486-aee9-f3e9386540cb req-19d46ad3-ff8c-4944-af01-4327c2117a7f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0841618 Dec 10 14:28:08.935831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.954716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691311e8-e332-4b60-9a1a-44c84d4e27aa tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Network': ['ID=07df8653-218f-4c6d-aa5b-3639ee6f5791,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:08.966841 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:28:08.969116 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e959b666-4d98-497e-ac48-2cdacd2a0f22" -d '{"events": [{"server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "name": "network-vif-plugged", "status": "completed", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:28:08.987500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Allocated IP 172.20.0.2 (77cafb0a-7176-47c2-8411-eb7f3bd67195/53b74490-ce32-4c9b-aad3-0d2d044229bc/e3c11349-41d2-4e18-b1a8-04a11832e4ad) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:08.989037 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e225627-b916-46af-8b2d-9bf016e38fde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.991505 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:08.992385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e225627-b916-46af-8b2d-9bf016e38fde admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:08.999931 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0e225627-b916-46af-8b2d-9bf016e38fde admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/beaacf1b-edd1-498a-bdf3-f87824b7c1b0 HTTP/1.1" status: 204 len: 168 time: 0.6412127 Dec 10 14:28:09.012796 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-143ea39b-eca7-43b1-bd96-00c57d133176 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:09.013268 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-143ea39b-eca7-43b1-bd96-00c57d133176 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:09.019056 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-143ea39b-eca7-43b1-bd96-00c57d133176 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/subnets/51bcb3f8-31ce-4d4a-baf7-8671b48110e6 HTTP/1.1" status: 404 len: 337 time: 0.0962842 Dec 10 14:28:09.019056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e225627-b916-46af-8b2d-9bf016e38fde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=beaacf1b-edd1-498a-bdf3-f87824b7c1b0,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:09.020650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56700) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:09.041264 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-d45ac419-1f84-41be-a5b8-d6b3f65f1b96 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:09.041816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d45ac419-1f84-41be-a5b8-d6b3f65f1b96 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:09.045458 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d45ac419-1f84-41be-a5b8-d6b3f65f1b96 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/07df8653-218f-4c6d-aa5b-3639ee6f5791 HTTP/1.1" status: 404 len: 339 time: 0.0229294 Dec 10 14:28:09.047485 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56702) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:09.060481 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:28:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9c8ed0b4-c97b-4fd7-b9ae-499566eeef02 x-openstack-request-id: req-9c8ed0b4-c97b-4fd7-b9ae-499566eeef02 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:28:09.061115 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "name": "network-vif-plugged", "status": "completed", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:28:09.061576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-9c8ed0b4-c97b-4fd7-b9ae-499566eeef02 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:28:09.062111 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'code': 200} Dec 10 14:28:09.062830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4690ae85-0cc6-4510-ae10-37ac2dd0790e req-de2ebc5e-7d15-4d6d-934e-bafc9352f340 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:09.064796 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4690ae85-0cc6-4510-ae10-37ac2dd0790e req-de2ebc5e-7d15-4d6d-934e-bafc9352f340 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 945 time: 0.1732578 Dec 10 14:28:09.088293 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-4ff15cfd-ffd8-47a8-a802-a7900fe89462 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:09.088861 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4ff15cfd-ffd8-47a8-a802-a7900fe89462 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:09.093767 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4ff15cfd-ffd8-47a8-a802-a7900fe89462 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/subnets/090cf417-3e34-4ec3-b647-f1470883aaa8 HTTP/1.1" status: 404 len: 337 time: 0.0451403 Dec 10 14:28:09.098342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56704) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:09.118074 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.119022 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 2648b8af-c0bf-4811-b353-779f2426f8b8 up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:09.132716 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-14169188-4b15-46f7-8f8f-b23a693c82be tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:09.133322 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-14169188-4b15-46f7-8f8f-b23a693c82be tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:09.138689 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-14169188-4b15-46f7-8f8f-b23a693c82be tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/71506bf4-82ba-4d44-821e-cfb5b7c7af48 HTTP/1.1" status: 404 len: 339 time: 0.0392385 Dec 10 14:28:09.140751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:09.145571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56706) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:09.146314 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.178749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port e5d19192-f158-4ee6-a948-0c1411ba76e8 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:09.221779 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-39a63bd0-41c8-44e9-84ad-fc045db82658 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:09.222267 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-39a63bd0-41c8-44e9-84ad-fc045db82658 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:09.226176 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-39a63bd0-41c8-44e9-84ad-fc045db82658 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/subnets/72f25b80-d812-4dab-8383-84723400ea81 HTTP/1.1" status: 404 len: 337 time: 0.0771132 Dec 10 14:28:09.233721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56708) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:09.247214 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:09.255431 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.313893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.320671 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-39646ea4-41b8-4751-8f42-227076ab0968 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:09.322210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-39646ea4-41b8-4751-8f42-227076ab0968 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:09.325462 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-39646ea4-41b8-4751-8f42-227076ab0968 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/c62b7db1-efd7-483a-896e-5dce85876171 HTTP/1.1" status: 404 len: 339 time: 0.0880008 Dec 10 14:28:09.328234 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56712) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:09.333952 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4690ae85-0cc6-4510-ae10-37ac2dd0790e req-658e88b3-6441-4c07-bdeb-c2a7937652b0 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2124853 Dec 10 14:28:09.372042 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port 2648b8af-c0bf-4811-b353-779f2426f8b8 completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:28:09.376633 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port 2648b8af-c0bf-4811-b353-779f2426f8b8 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:09.379911 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.448260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.492751 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.504565 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Network 77cafb0a-7176-47c2-8411-eb7f3bd67195 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:09.523584 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:09.527563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:09.533532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Pushing event updated for resources: {'Port': ['ID=e3c11349-41d2-4e18-b1a8-04a11832e4ad,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:09.543588 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.586168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:09.593641 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.8 (77cafb0a-7176-47c2-8411-eb7f3bd67195/53b74490-ce32-4c9b-aad3-0d2d044229bc/e5d19192-f158-4ee6-a948-0c1411ba76e8) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:09.602806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636dcb29-d3bc-4148-809e-91fd03a33a1a req-5ef0546e-75c3-4ce5-8270-b582deb2b59c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:09.604541 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-636dcb29-d3bc-4148-809e-91fd03a33a1a req-5ef0546e-75c3-4ce5-8270-b582deb2b59c service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 1098 time: 0.2594693 Dec 10 14:28:09.624281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Attempting to bind port e3c11349-41d2-4e18-b1a8-04a11832e4ad on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:09.626054 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Attempting to bind port e3c11349-41d2-4e18-b1a8-04a11832e4ad by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'ca55cd62-cb38-40e2-af56-731a0beddde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '77cafb0a-7176-47c2-8411-eb7f3bd67195'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:09.626480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Attempting to bind port e3c11349-41d2-4e18-b1a8-04a11832e4ad on network 77cafb0a-7176-47c2-8411-eb7f3bd67195 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:09.637789 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:09.638422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Checking segment: {'id': 'ca55cd62-cb38-40e2-af56-731a0beddde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '77cafb0a-7176-47c2-8411-eb7f3bd67195'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:09.638624 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.638999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Bound using segment: {'id': 'ca55cd62-cb38-40e2-af56-731a0beddde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '77cafb0a-7176-47c2-8411-eb7f3bd67195'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:09.639485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Bound port: e3c11349-41d2-4e18-b1a8-04a11832e4ad, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ca55cd62-cb38-40e2-af56-731a0beddde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '77cafb0a-7176-47c2-8411-eb7f3bd67195'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:09.643203 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.671847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.718968 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-1715159d-4b37-4cef-b715-e8d1cd09f27f tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Deleting port 05a98750-60ac-4416-ae03-0d4e11a81dde {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:09.718968 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1715159d-4b37-4cef-b715-e8d1cd09f27f tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.765209 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-636dcb29-d3bc-4148-809e-91fd03a33a1a req-7b48eb94-cca0-491d-a47a-441b127936ad service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1409853 Dec 10 14:28:09.781080 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=2648b8af-c0bf-4811-b353-779f2426f8b8,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:09.788844 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 0c82fa2b-580a-432c-ad5f-ab33414ea831 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:28:09.795590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] For port e3c11349-41d2-4e18-b1a8-04a11832e4ad, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:09.803521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] For port e3c11349-41d2-4e18-b1a8-04a11832e4ad, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e3c11349-41d2-4e18-b1a8-04a11832e4ad,segment=NetworkSegment(ca55cd62-cb38-40e2-af56-731a0beddde9),segment_id=ca55cd62-cb38-40e2-af56-731a0beddde9)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:09.820260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1715159d-4b37-4cef-b715-e8d1cd09f27f tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.866656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-1715159d-4b37-4cef-b715-e8d1cd09f27f tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Calling delete_port for 05a98750-60ac-4416-ae03-0d4e11a81dde owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:09.874575 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:09.944495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:09.973549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8eac8568-a1d2-44be-ab42-64ebbd3c73be None None] Sync routers for ids ['0c82fa2b-580a-432c-ad5f-ab33414ea831'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:09.995478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.000690 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8eac8568-a1d2-44be-ab42-64ebbd3c73be None None] Routers {'0c82fa2b-580a-432c-ad5f-ab33414ea831'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:10.002615 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-8eac8568-a1d2-44be-ab42-64ebbd3c73be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['0c82fa2b-580a-432c-ad5f-ab33414ea831'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:10.057541 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.057541 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-12f2dd6d-95b6-4553-a45d-79719927051d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 882 time: 3.8424160 Dec 10 14:28:10.063345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56738) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:10.067254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-8eac8568-a1d2-44be-ab42-64ebbd3c73be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:10.078805 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffdd3165-97ac-47c5-b83f-f233c49eea26 None None] Pushing event updated for resources: {'Port': ['ID=e3c11349-41d2-4e18-b1a8-04a11832e4ad,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:10.085543 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8eac8568-a1d2-44be-ab42-64ebbd3c73be None None] Routers {'0c82fa2b-580a-432c-ad5f-ab33414ea831'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:10.086155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-8eac8568-a1d2-44be-ab42-64ebbd3c73be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['0c82fa2b-580a-432c-ad5f-ab33414ea831'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:10.138432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-8eac8568-a1d2-44be-ab42-64ebbd3c73be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:10.139595 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8eac8568-a1d2-44be-ab42-64ebbd3c73be None None] The sync data for ids ['0c82fa2b-580a-432c-ad5f-ab33414ea831'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:10.144568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1715159d-4b37-4cef-b715-e8d1cd09f27f tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.147344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b31e1c6-136a-4f40-a6ec-f13ac9e8e36d req-40e49513-7d51-4f01-a82f-439b78d881aa tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:10.148958 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1b31e1c6-136a-4f40-a6ec-f13ac9e8e36d req-40e49513-7d51-4f01-a82f-439b78d881aa tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 945 time: 0.0889454 Dec 10 14:28:10.218312 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1b31e1c6-136a-4f40-a6ec-f13ac9e8e36d req-26d628ab-3c72-4c95-a629-f6ff6aa94a06 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0596802 Dec 10 14:28:10.264433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56742) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:10.573378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0ade028-30d1-4c55-9248-11778df9614e req-b4a78f4a-64f3-45c5-9d56-ef60343c5909 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:10.600508 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e0ade028-30d1-4c55-9248-11778df9614e req-b4a78f4a-64f3-45c5-9d56-ef60343c5909 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.1441164 Dec 10 14:28:10.618352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-1462019702'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:10.624311 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.683933 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e0ade028-30d1-4c55-9248-11778df9614e req-8bc0faeb-6dfb-47b3-8566-b879d39f88cb tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0824943 Dec 10 14:28:10.703893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1715159d-4b37-4cef-b715-e8d1cd09f27f tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Port': ['ID=05a98750-60ac-4416-ae03-0d4e11a81dde,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:10.715792 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e3c11349-41d2-4e18-b1a8-04a11832e4ad up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:10.732182 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56752) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:10.768170 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1715159d-4b37-4cef-b715-e8d1cd09f27f tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.774686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56756) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:10.774907 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1715159d-4b37-4cef-b715-e8d1cd09f27f tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/ports/05a98750-60ac-4416-ae03-0d4e11a81dde HTTP/1.1" status: 204 len: 168 time: 1.4454780 Dec 10 14:28:10.800183 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port e3c11349-41d2-4e18-b1a8-04a11832e4ad triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:10.800971 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.809245 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-2b8da0a1-d02f-4683-b64f-1a2c29ee64ad tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:10.815086 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2b8da0a1-d02f-4683-b64f-1a2c29ee64ad tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:10.815086 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2b8da0a1-d02f-4683-b64f-1a2c29ee64ad tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/subnets/3fa54dfa-b0f6-4e2f-93fc-e8e2d3f3cb62 HTTP/1.1" status: 404 len: 337 time: 0.0373917 Dec 10 14:28:10.815086 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Made reservation on behalf of 4e55714eff204b138587677e999b639b for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:10.817981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 77cafb0a-7176-47c2-8411-eb7f3bd67195 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:10.819008 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.820781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56758) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:10.835658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.840125 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-eedbbd3d-843c-44bc-966f-0873fc3a6264 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/routers/0c82fa2b-580a-432c-ad5f-ab33414ea831 HTTP/1.1" status: 200 len: 883 time: 0.7755306 Dec 10 14:28:10.841291 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:10.844545 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56760) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:10.855880 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:10.887164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=e5d19192-f158-4ee6-a948-0c1411ba76e8,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:10.934786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.944573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1947600079'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:10.967217 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.978721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:10.979362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:10.998566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port e3c11349-41d2-4e18-b1a8-04a11832e4ad, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e3c11349-41d2-4e18-b1a8-04a11832e4ad,segment=NetworkSegment(ca55cd62-cb38-40e2-af56-731a0beddde9),segment_id=ca55cd62-cb38-40e2-af56-731a0beddde9)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:11.064007 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:28:11.067394 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e224c41a-e625-4229-9b27-dbdfa20a14dc" -d '{"events": [{"server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "name": "network-vif-plugged", "status": "completed", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:28:11.073758 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.101766 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0b95be25-9999-4628-a5fb-a4544733468b']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:11.102270 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.118806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '81dfbe5f-b26f-4202-bc76-1321bca680f6') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:11.119440 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '81dfbe5f-b26f-4202-bc76-1321bca680f6') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:11.133375 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.135466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:11.138995 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.151913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.162013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Releasing vlan 388 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:11.162262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:11.166858 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:11.180099 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.182689 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.205154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:28:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2aa2f9c9-e72a-4ac2-a785-91fd0a929683 x-openstack-request-id: req-2aa2f9c9-e72a-4ac2-a785-91fd0a929683 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:28:11.205646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "name": "network-vif-plugged", "status": "completed", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:28:11.205905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-2aa2f9c9-e72a-4ac2-a785-91fd0a929683 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:28:11.206309 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'code': 200} Dec 10 14:28:11.206892 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=e3c11349-41d2-4e18-b1a8-04a11832e4ad,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:11.236287 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6c7360a7-9366-4209-aeb8-1260b1d640ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 2.5563114 Dec 10 14:28:11.241273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56764) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:11.246433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': '77cafb0a-7176-47c2-8411-eb7f3bd67195', 'name': 'tempest-PortsTestJSON-1568371638'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:11.331879 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.370737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.388399 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.388399 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/0b95be25-9999-4628-a5fb-a4544733468b HTTP/1.1" status: 204 len: 168 time: 0.5608203 Dec 10 14:28:11.388399 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56768) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:11.406574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] vlan segment allocate from pool success with {'vlan_id': 354, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:11.409211 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b85d6679-78bf-4c9d-9a14-529632557da8 None None] Network 77cafb0a-7176-47c2-8411-eb7f3bd67195 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:11.414667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a9fb4a4-9aba-4e65-b6a5-8adf526307b6 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Network': ['ID=0b95be25-9999-4628-a5fb-a4544733468b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:11.426316 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-adb9d056-7ada-4c48-a95d-9dd1a3459527 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 886 time: 0.5801239 Dec 10 14:28:11.430308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56770) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:11.444700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-19aa176d-8205-4a68-96e9-4eecbf3b7157 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'name': 'updatedtempest-RoutersIpV6Test-router-827420336'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:11.480989 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b135b8ef-eb0e-4069-ad9d-032d4a888d0b None None] Provisioning complete for port e3c11349-41d2-4e18-b1a8-04a11832e4ad triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:11.481483 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b135b8ef-eb0e-4069-ad9d-032d4a888d0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.520885 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event updated for resources: {'SecurityGroup': ['ID=70dec902-22b6-4a2e-bbba-45f30fec3509,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:11.525135 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.525581 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Added segment 91ce7121-bbf1-4bc7-96a3-34b592008626 of type vlan for network af595149-c7c0-48e7-ac79-e16508a39a66 Dec 10 14:28:11.537768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-82a39b7c-37c7-4f8f-9d2d-daf2104cc501 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Deleting port 7a0c871e-30f3-418b-9c86-613ceefe1a9a {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:11.537768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-82a39b7c-37c7-4f8f-9d2d-daf2104cc501 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.560670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb88f092-f913-4786-9eb4-52a7de75aac7 req-15bc7ddc-95d7-4034-8341-4bc8936bbf6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:11.562357 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-eb88f092-f913-4786-9eb4-52a7de75aac7 req-15bc7ddc-95d7-4034-8341-4bc8936bbf6e service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 1099 time: 0.0771763 Dec 10 14:28:11.603420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7550f32-9302-42b1-a836-ae47bc755347 req-66522d91-91e8-4316-8642-4b326f126740 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:11.604892 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f7550f32-9302-42b1-a836-ae47bc755347 req-66522d91-91e8-4316-8642-4b326f126740 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 945 time: 0.2878990 Dec 10 14:28:11.632656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-82a39b7c-37c7-4f8f-9d2d-daf2104cc501 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.657818 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-82a39b7c-37c7-4f8f-9d2d-daf2104cc501 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Calling delete_port for 7a0c871e-30f3-418b-9c86-613ceefe1a9a owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:11.665161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.670524 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-eb88f092-f913-4786-9eb4-52a7de75aac7 req-755b2812-02df-43d6-b224-f50f0f762016 service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821795 Dec 10 14:28:11.681760 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.834470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-82a39b7c-37c7-4f8f-9d2d-daf2104cc501 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.868094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82a39b7c-37c7-4f8f-9d2d-daf2104cc501 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Port': ['ID=7a0c871e-30f3-418b-9c86-613ceefe1a9a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:11.871832 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-82a39b7c-37c7-4f8f-9d2d-daf2104cc501 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.881283 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-82a39b7c-37c7-4f8f-9d2d-daf2104cc501 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/ports/7a0c871e-30f3-418b-9c86-613ceefe1a9a HTTP/1.1" status: 204 len: 168 time: 0.4948928 Dec 10 14:28:11.882135 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56774) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:11.914753 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-1ae408fe-cdf8-4849-90a3-ae181b704b89 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:11.915224 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1ae408fe-cdf8-4849-90a3-ae181b704b89 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:11.918501 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1ae408fe-cdf8-4849-90a3-ae181b704b89 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/subnets/83de442a-78b9-444e-b49e-0a83671e669f HTTP/1.1" status: 404 len: 337 time: 0.0352776 Dec 10 14:28:11.921319 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56776) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:11.976314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.994270 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0aa76da9-0ec6-4061-b1af-fa36449f960f None None] Provisioning complete for port e3c11349-41d2-4e18-b1a8-04a11832e4ad triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:11.994785 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0aa76da9-0ec6-4061-b1af-fa36449f960f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:11.999174 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.resource_extend [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] It took 0.31 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 10 14:28:12.010727 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.070180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 398, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:12.121266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:12.122246 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.124973 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.132797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0aa76da9-0ec6-4061-b1af-fa36449f960f None None] Provisioning complete for port e5d19192-f158-4ee6-a948-0c1411ba76e8 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:12.133916 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0aa76da9-0ec6-4061-b1af-fa36449f960f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.143417 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0bcf9766-8cb7-4c61-8f3b-2048d7ede622,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:12.149690 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:12.159303 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.159654 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment 0babddd5-7dfe-4053-aadc-afd6a9cd9116 of type vlan for network b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 Dec 10 14:28:12.159772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '08ecbe43-f39a-4738-bbee-012cc6c6772a') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:12.160217 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '08ecbe43-f39a-4738-bbee-012cc6c6772a') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:12.168929 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f7550f32-9302-42b1-a836-ae47bc755347 req-f6c6abfa-aff3-41dd-95a3-b51176eaaab2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5462089 Dec 10 14:28:12.172891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.180403 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.186184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:12.187197 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.187994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.196731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Releasing vlan 379 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:12.197185 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:12.204730 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:12.232599 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0aa76da9-0ec6-4061-b1af-fa36449f960f None None] Port e5d19192-f158-4ee6-a948-0c1411ba76e8 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:12.306953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d4eed43-406d-4e09-af47-e78179a5df8b req-c476bf03-a8d0-4811-91cd-3783a0163992 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:12.308428 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7d4eed43-406d-4e09-af47-e78179a5df8b req-c476bf03-a8d0-4811-91cd-3783a0163992 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.3419621 Dec 10 14:28:12.316437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port bdd155dd-9dba-43d8-81b4-83367346aaeb yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:12.348141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.352893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f3b034ef-83d5-4b98-9d30-e7a5e3755292 None None] Provisioning complete for port e5d19192-f158-4ee6-a948-0c1411ba76e8 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:12.358050 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f3b034ef-83d5-4b98-9d30-e7a5e3755292 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.359168 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 2.0936084 Dec 10 14:28:12.373458 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.374844 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56780) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:12.376753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.382788 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5 HTTP/1.1" status: 204 len: 168 time: 0.4576097 Dec 10 14:28:12.382788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a46777f6-d357-4c00-b199-c080ff68b32b tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Network': ['ID=f9d6fee7-6dee-4dc1-a9e5-c57d4e5099f5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:12.388181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Request body: {'subnet': {'network_id': 'af595149-c7c0-48e7-ac79-e16508a39a66', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:12.391486 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56782) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:12.394655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f3b034ef-83d5-4b98-9d30-e7a5e3755292 None None] Port e5d19192-f158-4ee6-a948-0c1411ba76e8 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:12.460359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9d1abb-06e5-4fd6-b0c5-bfc326545b4e tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event updated for resources: {'Network': ['ID=af595149-c7c0-48e7-ac79-e16508a39a66,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:12.472356 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network af595149-c7c0-48e7-ac79-e16508a39a66 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:12.498154 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-68fc2b13-5e0c-4a36-8f5d-c022a1a7567c tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Deleting subnet bb26c672-9a8a-4e30-9437-db1b88e06953 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:12.502568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68fc2b13-5e0c-4a36-8f5d-c022a1a7567c tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.554379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68fc2b13-5e0c-4a36-8f5d-c022a1a7567c tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.604014 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7d4eed43-406d-4e09-af47-e78179a5df8b req-abfa5345-54c8-4dfb-a6fe-ab86a96ec696 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2734106 Dec 10 14:28:12.617782 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f315e6-1811-4b52-958c-896e553eb6e1 req-86f6cfac-ca87-4d1e-8213-1a595a4aacd2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:12.620148 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-12f315e6-1811-4b52-958c-896e553eb6e1 req-86f6cfac-ca87-4d1e-8213-1a595a4aacd2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 945 time: 0.3108189 Dec 10 14:28:12.638066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Made reservation on behalf of 4e55714eff204b138587677e999b639b for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:12.639254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e3c11349-41d2-4e18-b1a8-04a11832e4ad up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:12.641551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.667134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.673826 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:12.674422 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.697020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port e3c11349-41d2-4e18-b1a8-04a11832e4ad triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:12.697504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.708793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68fc2b13-5e0c-4a36-8f5d-c022a1a7567c tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.745222 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.10 (77cafb0a-7176-47c2-8411-eb7f3bd67195/53b74490-ce32-4c9b-aad3-0d2d044229bc/bdd155dd-9dba-43d8-81b4-83367346aaeb) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:12.798897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-19aa176d-8205-4a68-96e9-4eecbf3b7157 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.839416 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=b27b6c39-0c3d-4675-89cd-9e6d2b6a2229,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:12.850297 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:12.885021 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-12f315e6-1811-4b52-958c-896e553eb6e1 req-1ac4dd03-8639-40a7-994a-72cdeca130de tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2173908 Dec 10 14:28:12.900642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56784) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:12.903118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68fc2b13-5e0c-4a36-8f5d-c022a1a7567c tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.941135 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68fc2b13-5e0c-4a36-8f5d-c022a1a7567c tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Subnet': ['ID=bb26c672-9a8a-4e30-9437-db1b88e06953,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:12.954192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68fc2b13-5e0c-4a36-8f5d-c022a1a7567c tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.957696 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-68fc2b13-5e0c-4a36-8f5d-c022a1a7567c tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/subnets/bb26c672-9a8a-4e30-9437-db1b88e06953 HTTP/1.1" status: 204 len: 168 time: 0.5655086 Dec 10 14:28:12.959919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5cdd686-b21e-49eb-8100-94202c25ebd4 None None] Network 39fe2720-3149-4d03-a6a8-4d005fde2d99 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:12.960629 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56786) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:12.971076 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-19aa176d-8205-4a68-96e9-4eecbf3b7157 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:12.976394 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d78ec57c-b27c-4c21-88e4-f922ab744224 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 2.2427983 Dec 10 14:28:13.079079 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.097770 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06cad70e-ef41-41b0-a4cc-224f71b8d27b tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:13.103075 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-06cad70e-ef41-41b0-a4cc-224f71b8d27b tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 1093 time: 0.1980917 Dec 10 14:28:13.108329 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56788) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:13.112809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address': '172.20.0.6'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:13.174617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.178233 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.190659 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Deleting port 76a9df83-322a-4e8f-b436-03d2c9bda760 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:13.195324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.223116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-19aa176d-8205-4a68-96e9-4eecbf3b7157 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 0c82fa2b-580a-432c-ad5f-ab33414ea831 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:28:13.234843 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad821908-5c03-4b0a-9fb5-178b60db561e None None] DHCP port deletion for 39fe2720-3149-4d03-a6a8-4d005fde2d99 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:13.281860 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.303203 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.333095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ad821908-5c03-4b0a-9fb5-178b60db561e None None] Deleting port 76a9df83-322a-4e8f-b436-03d2c9bda760 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:13.334317 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ad821908-5c03-4b0a-9fb5-178b60db561e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.343397 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] For port 76a9df83-322a-4e8f-b436-03d2c9bda760, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=76a9df83-322a-4e8f-b436-03d2c9bda760,segment=NetworkSegment(3750ad91-886c-452d-855d-30e37524fa87),segment_id=3750ad91-886c-452d-855d-30e37524fa87)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:13.344272 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.348570 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event updated for resources: {'Subnet': ['ID=c8971c17-4edc-4733-a849-2260a9a3f183,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:13.365286 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Checking segment: {'id': '91ce7121-bbf1-4bc7-96a3-34b592008626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'af595149-c7c0-48e7-ac79-e16508a39a66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:13.365478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Network hostable DHCP agents. Network: af595149-c7c0-48e7-ac79-e16508a39a66, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:13.371226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Calling delete_port for 76a9df83-322a-4e8f-b436-03d2c9bda760 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:13.439758 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 77cafb0a-7176-47c2-8411-eb7f3bd67195 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:13.444501 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:13.448304 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:13.451098 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=bdd155dd-9dba-43d8-81b4-83367346aaeb,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:13.473655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Network af595149-c7c0-48e7-ac79-e16508a39a66 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:13.492326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ad821908-5c03-4b0a-9fb5-178b60db561e None None] For port 76a9df83-322a-4e8f-b436-03d2c9bda760, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=76a9df83-322a-4e8f-b436-03d2c9bda760,segment=NetworkSegment(3750ad91-886c-452d-855d-30e37524fa87),segment_id=3750ad91-886c-452d-855d-30e37524fa87)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:13.493875 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ad821908-5c03-4b0a-9fb5-178b60db561e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.503206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19aa176d-8205-4a68-96e9-4eecbf3b7157 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:13.511963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ad821908-5c03-4b0a-9fb5-178b60db561e None None] Calling delete_port for 76a9df83-322a-4e8f-b436-03d2c9bda760 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:13.515583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-19aa176d-8205-4a68-96e9-4eecbf3b7157 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.515833 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-19aa176d-8205-4a68-96e9-4eecbf3b7157 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/0c82fa2b-580a-432c-ad5f-ab33414ea831 HTTP/1.1" status: 200 len: 890 time: 2.0760405 Dec 10 14:28:13.519552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56790) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:13.523349 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-760cdb24-526d-478f-80bf-5eb9c7061a97 None None] Sync routers for ids ['0c82fa2b-580a-432c-ad5f-ab33414ea831'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:13.554597 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-760cdb24-526d-478f-80bf-5eb9c7061a97 None None] Routers {'0c82fa2b-580a-432c-ad5f-ab33414ea831'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:13.555845 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-760cdb24-526d-478f-80bf-5eb9c7061a97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['0c82fa2b-580a-432c-ad5f-ab33414ea831'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:13.566730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.581663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:13.582258 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.610422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ad821908-5c03-4b0a-9fb5-178b60db561e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.629472 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-760cdb24-526d-478f-80bf-5eb9c7061a97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:13.642870 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-760cdb24-526d-478f-80bf-5eb9c7061a97 None None] Routers {'0c82fa2b-580a-432c-ad5f-ab33414ea831'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:13.644111 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-760cdb24-526d-478f-80bf-5eb9c7061a97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['0c82fa2b-580a-432c-ad5f-ab33414ea831'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:13.649574 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad821908-5c03-4b0a-9fb5-178b60db561e None None] No DVR routers for this DVR port 76a9df83-322a-4e8f-b436-03d2c9bda760 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:13.672374 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad821908-5c03-4b0a-9fb5-178b60db561e None None] Pushing event deleted for resources: {'Port': ['ID=76a9df83-322a-4e8f-b436-03d2c9bda760,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:13.702851 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Port': ['ID=76a9df83-322a-4e8f-b436-03d2c9bda760,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:13.703239 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-760cdb24-526d-478f-80bf-5eb9c7061a97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:13.704026 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-760cdb24-526d-478f-80bf-5eb9c7061a97 None None] The sync data for ids ['0c82fa2b-580a-432c-ad5f-ab33414ea831'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:13.714771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, af595149-c7c0-48e7-ac79-e16508a39a66) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:13.726829 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efe7c555-03f5-4b34-b23b-8309898307ff None None] Network af595149-c7c0-48e7-ac79-e16508a39a66 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:13.728914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:13.729146 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.734013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] No DVR routers for this DVR port 76a9df83-322a-4e8f-b436-03d2c9bda760 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:13.807635 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-002c3306-46e5-40eb-bb31-153f2655b4c4 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 2.5651014 Dec 10 14:28:13.817938 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56794) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:13.895327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-af595149-c7c0-48e7-ac79-e16508a39a66', 'network_id': 'af595149-c7c0-48e7-ac79-e16508a39a66', 'project_id': '4e55714eff204b138587677e999b639b', 'fixed_ips': [{'subnet_id': 'c8971c17-4edc-4733-a849-2260a9a3f183'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:13.898654 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.909688 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-863a0c6c-8e0f-4a84-b409-2bf5ff148510 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5259039 Dec 10 14:28:13.911126 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-55899aff-6c31-47af-9af6-32b43ddecad1 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/routers/0c82fa2b-580a-432c-ad5f-ab33414ea831 HTTP/1.1" status: 200 len: 890 time: 0.3904831 Dec 10 14:28:13.914794 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56796) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:13.919598 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56798) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:13.922765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Request body: {'port': {'network_id': 'af595149-c7c0-48e7-ac79-e16508a39a66', 'name': 'tempest-DHCPAgentSchedulersTestJSON-1649076496'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:13.925700 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:13.954846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['39fe2720-3149-4d03-a6a8-4d005fde2d99']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:13.971244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3750ad91-886c-452d-855d-30e37524fa87') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:13.971542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3750ad91-886c-452d-855d-30e37524fa87') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:13.985532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.003597 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.011169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Releasing vlan 397 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:14.011580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.067088 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d09539d0-41fe-414b-89ff-326a56a3467c None None] Provisioning complete for port bdd155dd-9dba-43d8-81b4-83367346aaeb triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:14.067678 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d09539d0-41fe-414b-89ff-326a56a3467c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:14.083195 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:14.125174 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Allocated IP 172.20.0.2 (af595149-c7c0-48e7-ac79-e16508a39a66/c8971c17-4edc-4733-a849-2260a9a3f183/c84b1d03-a3d6-4a71-8805-fa2ae386073f) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:14.127614 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d09539d0-41fe-414b-89ff-326a56a3467c None None] Port bdd155dd-9dba-43d8-81b4-83367346aaeb cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:14.165708 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.173163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.182662 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] 10.222.0.57 "DELETE /v2.0/networks/39fe2720-3149-4d03-a6a8-4d005fde2d99 HTTP/1.1" status: 204 len: 168 time: 1.2187905 Dec 10 14:28:14.211275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d73620d3-2007-4e1a-bd2e-e8a5ed63ff05 tempest-NetworksIpV6TestAttrs-1787165441 tempest-NetworksIpV6TestAttrs-1787165441-project] Pushing event deleted for resources: {'Network': ['ID=39fe2720-3149-4d03-a6a8-4d005fde2d99,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:14.256584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.304238 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9ef5e0b5-d70a-4a28-bf37-ef00b4e89b57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=0c82fa2b-580a-432c-ad5f-ab33414ea831 HTTP/1.1" status: 200 len: 205 time: 0.3868132 Dec 10 14:28:14.307720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56802) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:14.327100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.386794 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bce1c502-9cd7-4f52-8ef8-2c3a7fc54932 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:14.390915 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bce1c502-9cd7-4f52-8ef8-2c3a7fc54932 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports?fixed_ips=ip_address%3D172.20.0.8 HTTP/1.1" status: 200 len: 921 time: 0.5661583 Dec 10 14:28:14.393101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56804) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:14.410940 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.427318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8751a43e-ad1d-4d6d-b149-dd332f0b1d52 req-32d840ec-aea9-4e11-ad8b-70cfa94c1490 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:14.428883 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8751a43e-ad1d-4d6d-b149-dd332f0b1d52 req-32d840ec-aea9-4e11-ad8b-70cfa94c1490 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.6394353 Dec 10 14:28:14.440289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.471183 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Network af595149-c7c0-48e7-ac79-e16508a39a66 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:14.475665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:14.480580 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:14.486876 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Pushing event updated for resources: {'Port': ['ID=c84b1d03-a3d6-4a71-8805-fa2ae386073f,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:14.580908 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.593575 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8751a43e-ad1d-4d6d-b149-dd332f0b1d52 req-093a3e74-f18c-4c34-81c9-80f13b0ded4f tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1232097 Dec 10 14:28:14.662550 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 76a9df83-322a-4e8f-b436-03d2c9bda760 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:14.706142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 76a9df83-322a-4e8f-b436-03d2c9bda760 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:14.707875 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 76a9df83-322a-4e8f-b436-03d2c9bda760 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:14.735655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Attempting to bind port c84b1d03-a3d6-4a71-8805-fa2ae386073f on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:14.736220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Attempting to bind port c84b1d03-a3d6-4a71-8805-fa2ae386073f by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '91ce7121-bbf1-4bc7-96a3-34b592008626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'af595149-c7c0-48e7-ac79-e16508a39a66'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:14.736787 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Attempting to bind port c84b1d03-a3d6-4a71-8805-fa2ae386073f on network af595149-c7c0-48e7-ac79-e16508a39a66 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:14.752942 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 5728904e-09e9-42c8-a249-a9748c03956f {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:14.753785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.762410 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:14.762789 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Checking segment: {'id': '91ce7121-bbf1-4bc7-96a3-34b592008626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'af595149-c7c0-48e7-ac79-e16508a39a66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:14.763200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.765873 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Bound using segment: {'id': '91ce7121-bbf1-4bc7-96a3-34b592008626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'af595149-c7c0-48e7-ac79-e16508a39a66'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:14.766368 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Bound port: c84b1d03-a3d6-4a71-8805-fa2ae386073f, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '91ce7121-bbf1-4bc7-96a3-34b592008626', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'af595149-c7c0-48e7-ac79-e16508a39a66'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:14.766758 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.802172 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-474e5443-c1fd-4994-92f2-5d568545c7b8 req-24efc970-9bf9-4d21-96c7-6be20dc3eee7 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:14.803204 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-474e5443-c1fd-4994-92f2-5d568545c7b8 req-24efc970-9bf9-4d21-96c7-6be20dc3eee7 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.1071730 Dec 10 14:28:14.843268 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.26.2.24 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/59d5a417-7a75-46c3-bc8b-07e55522cde2) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:14.855391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-add18c17-b263-4bcc-8370-6425cb256934 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port bdd155dd-9dba-43d8-81b4-83367346aaeb {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:14.856041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-add18c17-b263-4bcc-8370-6425cb256934 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.858649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56810) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:14.911498 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] For port c84b1d03-a3d6-4a71-8805-fa2ae386073f, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:14.919712 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] For port c84b1d03-a3d6-4a71-8805-fa2ae386073f, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c84b1d03-a3d6-4a71-8805-fa2ae386073f,segment=NetworkSegment(91ce7121-bbf1-4bc7-96a3-34b592008626),segment_id=91ce7121-bbf1-4bc7-96a3-34b592008626)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:14.936700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Made reservation on behalf of 4e55714eff204b138587677e999b639b for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:14.938236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.940254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:14.959597 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 5728904e-09e9-42c8-a249-a9748c03956f owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:14.998761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.024198 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-474e5443-c1fd-4994-92f2-5d568545c7b8 req-caf2be4b-d90b-4454-aa61-e718c1409ffc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1938317 Dec 10 14:28:15.025369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] device_id is not set on port 3dae9810-29fe-4ac3-a13f-2799d989f1af yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:15.071744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56814) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:15.128742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf12147-cb7b-4091-b56e-e4ba723cdb7b None None] Pushing event updated for resources: {'Port': ['ID=c84b1d03-a3d6-4a71-8805-fa2ae386073f,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:15.141832 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-add18c17-b263-4bcc-8370-6425cb256934 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.168177 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-add18c17-b263-4bcc-8370-6425cb256934 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for bdd155dd-9dba-43d8-81b4-83367346aaeb owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:15.238661 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bd240026-4e20-4859-8e97-4591db0a738c admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=608b3110bcfe4055bf2af3eb17ae415d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3784952 Dec 10 14:28:15.242411 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56816) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:15.255347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ed35915-c449-4bf2-8a1c-6b6896a338bc tempest-TestNetworkAdvancedServerOps-1660048031 tempest-TestNetworkAdvancedServerOps-1660048031-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:15.257753 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2ed35915-c449-4bf2-8a1c-6b6896a338bc tempest-TestNetworkAdvancedServerOps-1660048031 tempest-TestNetworkAdvancedServerOps-1660048031-project-admin] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 1094 time: 0.1835728 Dec 10 14:28:15.265564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56818) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:15.276071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:15.319360 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Allocated IP 172.20.0.13 (af595149-c7c0-48e7-ac79-e16508a39a66/c8971c17-4edc-4733-a849-2260a9a3f183/3dae9810-29fe-4ac3-a13f-2799d989f1af) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:15.386479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccf66111-051f-46f8-bbc3-7d44adad3031 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.462446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.480471 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccf66111-051f-46f8-bbc3-7d44adad3031 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.500744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.522454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.563745 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-add18c17-b263-4bcc-8370-6425cb256934 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.602454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add18c17-b263-4bcc-8370-6425cb256934 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=bdd155dd-9dba-43d8-81b4-83367346aaeb,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:15.623428 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=5728904e-09e9-42c8-a249-a9748c03956f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:15.645068 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4451b09-c214-47b0-8f23-14045b6ea1e4 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:15.710397 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccf66111-051f-46f8-bbc3-7d44adad3031 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.712840 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ccf66111-051f-46f8-bbc3-7d44adad3031 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.716140 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ccf66111-051f-46f8-bbc3-7d44adad3031 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/202b38d9-8042-4348-bfff-f6423742cdbb HTTP/1.1" status: 204 len: 168 time: 0.4690104 Dec 10 14:28:15.716140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.763012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-add18c17-b263-4bcc-8370-6425cb256934 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.769000 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-add18c17-b263-4bcc-8370-6425cb256934 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/bdd155dd-9dba-43d8-81b4-83367346aaeb HTTP/1.1" status: 204 len: 168 time: 1.3367643 Dec 10 14:28:15.776727 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56822) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:15.826625 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-a11def02-be6e-4ca9-a31f-f01b089b6cf8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:28:15.830576 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a11def02-be6e-4ca9-a31f-f01b089b6cf8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/bdd155dd-9dba-43d8-81b4-83367346aaeb HTTP/1.1" status: 404 len: 333 time: 0.0505252 Dec 10 14:28:15.832000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.833890 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56824) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:15.834901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.841015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf66111-051f-46f8-bbc3-7d44adad3031 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=202b38d9-8042-4348-bfff-f6423742cdbb,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:15.920754 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.924509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:15.969237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:15.980584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:15.983266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:15.999373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.047336 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=59d5a417-7a75-46c3-bc8b-07e55522cde2,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:16.288083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56826) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:16.292229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.302129 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': 'b27b6c39-0c3d-4675-89cd-9e6d2b6a2229', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:16.356734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-48b818df-465c-4c4b-8287-70b29bc223ef tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port e5d19192-f158-4ee6-a948-0c1411ba76e8 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:16.357403 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-48b818df-465c-4c4b-8287-70b29bc223ef tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.394686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.395278 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Fanout notify agent at l3_agent the message router_deleted on router 0c82fa2b-580a-432c-ad5f-ab33414ea831 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:28:16.409979 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.417273 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bd0c74a8-d263-4c82-9d69-46c4736bca57 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/0c82fa2b-580a-432c-ad5f-ab33414ea831 HTTP/1.1" status: 204 len: 168 time: 2.1026390 Dec 10 14:28:16.419089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56832) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:16.431573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1293903806'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:16.476823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b14fcbab-8e2f-4baf-bc79-f7a68bd31776 None None] Network af595149-c7c0-48e7-ac79-e16508a39a66 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:16.494136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Network af595149-c7c0-48e7-ac79-e16508a39a66 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:16.512449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:16.524202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event updated for resources: {'Port': ['ID=3dae9810-29fe-4ac3-a13f-2799d989f1af,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:16.537862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Allocated IP 172.26.2.28 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/38e260e9-807c-4880-8a64-0f9cfc851c73) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:16.557521 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:16.573488 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Provisioning complete for port c84b1d03-a3d6-4a71-8805-fa2ae386073f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:16.574187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.695304 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.719859 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c84b1d03-a3d6-4a71-8805-fa2ae386073f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:16.734124 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.790064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-48b818df-465c-4c4b-8287-70b29bc223ef tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.800080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:16.803609 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.807832 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] For port c84b1d03-a3d6-4a71-8805-fa2ae386073f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c84b1d03-a3d6-4a71-8805-fa2ae386073f,segment=NetworkSegment(91ce7121-bbf1-4bc7-96a3-34b592008626),segment_id=91ce7121-bbf1-4bc7-96a3-34b592008626)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:16.816439 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c84b1d03-a3d6-4a71-8805-fa2ae386073f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:16.816642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.816834 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.840096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:16.841115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.844525 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-48b818df-465c-4c4b-8287-70b29bc223ef tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for e5d19192-f158-4ee6-a948-0c1411ba76e8 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:16.862283 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:16.866912 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:16.869793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:16.899103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'Port': ['ID=38e260e9-807c-4880-8a64-0f9cfc851c73,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:16.907607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:16.923806 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.006757 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] vlan segment allocate from pool success with {'vlan_id': 366, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:17.019521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:17.020116 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:17.020919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Pushing event updated for resources: {'Port': ['ID=c84b1d03-a3d6-4a71-8805-fa2ae386073f,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:17.028919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.029696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.030200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.030681 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.031172 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.031669 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.032168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.032653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.033165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.033717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.034193 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.036240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.036240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-198b864d-1bf9-4512-bcf0-87548856ffb7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:17.153902 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-06b9c96a-ffe8-4df9-961a-29ed274198f9 None None] Provisioning complete for port c84b1d03-a3d6-4a71-8805-fa2ae386073f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:17.153902 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-06b9c96a-ffe8-4df9-961a-29ed274198f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.267331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-06b9c96a-ffe8-4df9-961a-29ed274198f9 None None] Provisioning complete for port 3dae9810-29fe-4ac3-a13f-2799d989f1af triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:17.267714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-06b9c96a-ffe8-4df9-961a-29ed274198f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.317760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-06b9c96a-ffe8-4df9-961a-29ed274198f9 None None] Port 3dae9810-29fe-4ac3-a13f-2799d989f1af cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:17.343205 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56848) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:17.439737 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6e2d0cd0-603f-4ecd-9002-fbc640d5051c None None] Provisioning complete for port 3dae9810-29fe-4ac3-a13f-2799d989f1af triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:17.440271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6e2d0cd0-603f-4ecd-9002-fbc640d5051c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.449485 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:17.452936 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.478714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6e2d0cd0-603f-4ecd-9002-fbc640d5051c None None] Port 3dae9810-29fe-4ac3-a13f-2799d989f1af cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:17.481996 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.482289 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added segment 0710b915-b607-4acf-bd3a-be8f764ec316 of type vlan for network 12e9864f-f9dc-4f6f-b342-6729765c75de Dec 10 14:28:17.489314 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-test-network-1241520409'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:17.554948 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7f118cf1-a0a0-496f-b3bb-5c7c63f8eede tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 939 time: 3.6352971 Dec 10 14:28:17.555920 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56852) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:17.558462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.629542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.637470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:17.640848 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.644007 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.662366 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.763080 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c644c96c-494c-40f5-8041-d60013cd1f7c tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Deleting port 3dae9810-29fe-4ac3-a13f-2799d989f1af {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:17.763415 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c644c96c-494c-40f5-8041-d60013cd1f7c tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.836969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.842470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:17.847974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.864994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.872681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.932345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c644c96c-494c-40f5-8041-d60013cd1f7c tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.947152 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-48b818df-465c-4c4b-8287-70b29bc223ef tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:17.952386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-c644c96c-494c-40f5-8041-d60013cd1f7c tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Calling delete_port for 3dae9810-29fe-4ac3-a13f-2799d989f1af owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:17.969261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.023637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48b818df-465c-4c4b-8287-70b29bc223ef tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=e5d19192-f158-4ee6-a948-0c1411ba76e8,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:18.028249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Network': ['ID=12e9864f-f9dc-4f6f-b342-6729765c75de,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:18.039554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.043389 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 12e9864f-f9dc-4f6f-b342-6729765c75de details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:18.087786 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a8d09db7-e5fa-416c-bd61-90d023b9ca4e tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 1.6606436 Dec 10 14:28:18.094399 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56854) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:18.103037 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'subnet': {'network_id': '12e9864f-f9dc-4f6f-b342-6729765c75de', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:18.106050 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] vlan segment allocate from pool success with {'vlan_id': 388, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:18.109337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.121798 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b8c79e1d-d40a-49ea-b8c0-06f81e64417d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:18.139442 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.139789 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Added segment f87ad518-f300-4f42-a1a0-01a3d390e144 of type vlan for network 62f6936a-4052-4c55-a4da-5b8b8be326f4 Dec 10 14:28:18.246548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.253912 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.262284 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-48b818df-465c-4c4b-8287-70b29bc223ef tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.265478 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-48b818df-465c-4c4b-8287-70b29bc223ef tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/e5d19192-f158-4ee6-a948-0c1411ba76e8 HTTP/1.1" status: 204 len: 168 time: 2.4284430 Dec 10 14:28:18.269454 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56856) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:18.288384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=87d059f9-1c74-4752-a500-2102db4239b7,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:18.316087 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-1f89315f-cd05-4423-bd64-39d42eaa85a8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:28:18.320692 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1f89315f-cd05-4423-bd64-39d42eaa85a8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/e5d19192-f158-4ee6-a948-0c1411ba76e8 HTTP/1.1" status: 404 len: 333 time: 0.0472879 Dec 10 14:28:18.320692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.322111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56858) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:18.389715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c644c96c-494c-40f5-8041-d60013cd1f7c tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.400878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking segment: {'id': '0babddd5-7dfe-4053-aadc-afd6a9cd9116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'b27b6c39-0c3d-4675-89cd-9e6d2b6a2229'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:18.401243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network hostable DHCP agents. Network: b27b6c39-0c3d-4675-89cd-9e6d2b6a2229, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:18.408025 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.414249 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:18.415397 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.434675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event updated for resources: {'Port': ['ID=38e260e9-807c-4880-8a64-0f9cfc851c73,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:18.444249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-0db04041-6a0b-437a-9223-ba4c55ef875d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet 53b74490-ce32-4c9b-aad3-0d2d044229bc {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:18.445596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0db04041-6a0b-437a-9223-ba4c55ef875d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.478728 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.499193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0db04041-6a0b-437a-9223-ba4c55ef875d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.514036 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.527465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:18.531377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.531598 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c644c96c-494c-40f5-8041-d60013cd1f7c tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event deleted for resources: {'Port': ['ID=3dae9810-29fe-4ac3-a13f-2799d989f1af,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:18.597775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.610949 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:18.619782 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c84b1d03-a3d6-4a71-8805-fa2ae386073f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:18.623334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Network': ['ID=62f6936a-4052-4c55-a4da-5b8b8be326f4,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:18.689488 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-be98da18-520e-4137-9be6-cf464f59ee49 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.3448029 Dec 10 14:28:18.696812 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:18.700147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c644c96c-494c-40f5-8041-d60013cd1f7c tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.704985 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c644c96c-494c-40f5-8041-d60013cd1f7c tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] 10.222.0.57 "DELETE /v2.0/ports/3dae9810-29fe-4ac3-a13f-2799d989f1af HTTP/1.1" status: 204 len: 168 time: 1.1479163 Dec 10 14:28:18.705741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56860) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:18.710842 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56862) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:18.721189 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'name': 'tempest-PortsIpV6TestJSON-1538361722'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:18.774131 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, b27b6c39-0c3d-4675-89cd-9e6d2b6a2229) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:18.778519 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:18.779279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.791286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29602a92-2871-4844-b310-81a414779586 None None] Network b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:18.797378 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Floating IP c31794c0-9085-409e-a56d-0bcda9bb0856 associated. External IP: 172.26.2.28, port: 2648b8af-c0bf-4811-b353-779f2426f8b8. Dec 10 14:28:18.804900 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=59d5a417-7a75-46c3-bc8b-07e55522cde2,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:18.817323 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0db04041-6a0b-437a-9223-ba4c55ef875d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.854120 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:18.883052 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3eb7b69c-d77e-41f2-83c6-f07e5e6b8337 tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] 10.222.0.57 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4563 time: 0.1709464 Dec 10 14:28:18.885987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56866) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:18.891204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-1910557931'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:18.905649 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ede6025d-6159-498c-8e67-7628f63613f3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.6157672 Dec 10 14:28:18.917632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56868) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:18.929731 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1524262655'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:19.079470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0db04041-6a0b-437a-9223-ba4c55ef875d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.092270 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c84b1d03-a3d6-4a71-8805-fa2ae386073f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:19.092887 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.103929 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Floating IP 17a6f7a3-9b53-4a18-b1cf-56e4db4be95c associated. External IP: 172.26.2.24, port: a0f8cb62-50c9-49f8-bbab-6c182aabaf0e. Dec 10 14:28:19.127990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0db04041-6a0b-437a-9223-ba4c55ef875d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.133905 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0db04041-6a0b-437a-9223-ba4c55ef875d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/53b74490-ce32-4c9b-aad3-0d2d044229bc HTTP/1.1" status: 204 len: 168 time: 0.8088760 Dec 10 14:28:19.142241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ed87d67-c286-4bef-a815-e809e7a24760 None None] Network 77cafb0a-7176-47c2-8411-eb7f3bd67195 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:19.164219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-b27b6c39-0c3d-4675-89cd-9e6d2b6a2229', 'network_id': 'b27b6c39-0c3d-4675-89cd-9e6d2b6a2229', 'project_id': '243ec7ec23134148a44eb888e6040f25', 'fixed_ips': [{'subnet_id': '87d059f9-1c74-4752-a500-2102db4239b7'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:19.165096 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.172669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0db04041-6a0b-437a-9223-ba4c55ef875d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=53b74490-ce32-4c9b-aad3-0d2d044229bc,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:19.177175 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56870) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:19.286524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.323657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:19.327133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.335509 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.361784 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port c93cdb3c-f190-4d12-85d0-6fafb9086b92 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:19.398141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Subnet': ['ID=8adbea61-9b0b-429b-8140-84baa0565864,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:19.422381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Router bd5934f5-df99-4165-8014-b21160f71cfb has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:28:19.432650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Allocated IP 2001:db8:0:ffff::2 (b27b6c39-0c3d-4675-89cd-9e6d2b6a2229/87d059f9-1c74-4752-a500-2102db4239b7/4a2e3532-7894-4209-ad1e-5aca27394245) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:19.476685 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-569270a5-b15e-4475-b087-fd7f7b69d0e3 None None] DHCP port deletion for 77cafb0a-7176-47c2-8411-eb7f3bd67195 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:19.490156 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:19.493662 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.495657 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Checking segment: {'id': '0710b915-b607-4acf-bd3a-be8f764ec316', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '12e9864f-f9dc-4f6f-b342-6729765c75de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:19.496618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network hostable DHCP agents. Network: 12e9864f-f9dc-4f6f-b342-6729765c75de, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:19.589458 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 359, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:19.604465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9d7899bb-a9e2-467f-bfc6-02634a8598ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:28:19.606049 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port e3c11349-41d2-4e18-b1a8-04a11832e4ad {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:19.606379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.610689 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.611032 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa of type vlan for network 57850d2b-b9dc-4c49-8eb5-09a692a7a89c Dec 10 14:28:19.630322 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-569270a5-b15e-4475-b087-fd7f7b69d0e3 None None] Deleting port e3c11349-41d2-4e18-b1a8-04a11832e4ad {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:19.630790 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-569270a5-b15e-4475-b087-fd7f7b69d0e3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.637144 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.643446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Made reservation on behalf of 4e55714eff204b138587677e999b639b for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:19.647038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.652069 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.668839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:19.690039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] Sync routers for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:19.695174 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 12e9864f-f9dc-4f6f-b342-6729765c75de is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:19.703745 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] vlan segment allocate from pool success with {'vlan_id': 352, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:19.712769 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.715876 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-569270a5-b15e-4475-b087-fd7f7b69d0e3 None None] For port e3c11349-41d2-4e18-b1a8-04a11832e4ad, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e3c11349-41d2-4e18-b1a8-04a11832e4ad,segment=NetworkSegment(ca55cd62-cb38-40e2-af56-731a0beddde9),segment_id=ca55cd62-cb38-40e2-af56-731a0beddde9)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:19.716390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-569270a5-b15e-4475-b087-fd7f7b69d0e3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.717635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.717985 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Added segment 80defbcd-4d3e-432f-8605-08f5b533e311 of type vlan for network de7f9303-04aa-453d-a3ba-cbb919e1da78 Dec 10 14:28:19.726479 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:19.727235 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:19.734679 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.760089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.770099 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-569270a5-b15e-4475-b087-fd7f7b69d0e3 None None] Calling delete_port for e3c11349-41d2-4e18-b1a8-04a11832e4ad owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:19.777434 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] For port e3c11349-41d2-4e18-b1a8-04a11832e4ad, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e3c11349-41d2-4e18-b1a8-04a11832e4ad,segment=NetworkSegment(ca55cd62-cb38-40e2-af56-731a0beddde9),segment_id=ca55cd62-cb38-40e2-af56-731a0beddde9)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:19.777793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.787614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.802262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for e3c11349-41d2-4e18-b1a8-04a11832e4ad owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:19.820903 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a46b2c1d-c694-4f66-9aae-775f4b762787 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 4.5490022 Dec 10 14:28:19.820903 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:28:19.831930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ce386cb-3977-4091-a724-1e147e25891d" -d '{"events": [{"name": "network-changed", "server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:28:19.833182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.838301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Network b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:19.902232 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:19.902455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:28:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8ca6741-ded0-4844-b111-c3c72b6be7e7 x-openstack-request-id: req-b8ca6741-ded0-4844-b111-c3c72b6be7e7 {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:28:19.902750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:28:19.903014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-b8ca6741-ded0-4844-b111-c3c72b6be7e7 {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:28:19.903421 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'status': 'completed', 'code': 200} Dec 10 14:28:19.904309 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.908769 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:19.909988 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:19.910880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Pushing event updated for resources: {'Port': ['ID=4a2e3532-7894-4209-ad1e-5aca27394245,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:19.911237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.963042 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 12e9864f-f9dc-4f6f-b342-6729765c75de) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:19.968329 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:19.969074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.972140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:19.980757 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.987580 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] Sync routers for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:19.988098 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:19.988642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:19.990215 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:19.993708 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21d98ad0-80f1-43b4-b7b5-99535acf32a5 None None] Network 12e9864f-f9dc-4f6f-b342-6729765c75de requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:20.011532 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:20.016446 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:20.025602 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=c93cdb3c-f190-4d12-85d0-6fafb9086b92,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:20.045636 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event updated for resources: {'Network': ['ID=de7f9303-04aa-453d-a3ba-cbb919e1da78,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:20.062905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Checking segment: {'id': 'f87ad518-f300-4f42-a1a0-01a3d390e144', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:20.063565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network hostable DHCP agents. Network: 62f6936a-4052-4c55-a4da-5b8b8be326f4, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:20.068928 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce386cb-3977-4091-a724-1e147e25891d req-5948ff6a-1384-450b-9b7f-d3c060b897b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:20.070739 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4ce386cb-3977-4091-a724-1e147e25891d req-5948ff6a-1384-450b-9b7f-d3c060b897b5 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=37199cbe89a04c3096fd8e1d31a3df63&device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 1099 time: 0.1194229 Dec 10 14:28:20.072941 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:20.086524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network de7f9303-04aa-453d-a3ba-cbb919e1da78 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:20.092004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Attempting to bind port 4a2e3532-7894-4209-ad1e-5aca27394245 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:20.092004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Attempting to bind port 4a2e3532-7894-4209-ad1e-5aca27394245 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '0babddd5-7dfe-4053-aadc-afd6a9cd9116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'b27b6c39-0c3d-4675-89cd-9e6d2b6a2229'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:20.092004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Attempting to bind port 4a2e3532-7894-4209-ad1e-5aca27394245 on network b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:20.093497 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9e51198c-fa73-4615-a4cc-adaa5dabe96b tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 1.2063279 Dec 10 14:28:20.096659 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56876) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:20.125626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No DVR routers for this DVR port e3c11349-41d2-4e18-b1a8-04a11832e4ad on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:20.154630 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:20.155213 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Checking segment: {'id': '0babddd5-7dfe-4053-aadc-afd6a9cd9116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'b27b6c39-0c3d-4675-89cd-9e6d2b6a2229'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:20.155341 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:20.155685 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Bound using segment: {'id': '0babddd5-7dfe-4053-aadc-afd6a9cd9116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'b27b6c39-0c3d-4675-89cd-9e6d2b6a2229'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:20.156173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Bound port: 4a2e3532-7894-4209-ad1e-5aca27394245, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0babddd5-7dfe-4053-aadc-afd6a9cd9116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': 'b27b6c39-0c3d-4675-89cd-9e6d2b6a2229'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:20.156552 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:20.158827 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-569270a5-b15e-4475-b087-fd7f7b69d0e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:20.161517 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=e3c11349-41d2-4e18-b1a8-04a11832e4ad,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:20.194689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:20.230308 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:20.230812 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:20.249101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-569270a5-b15e-4475-b087-fd7f7b69d0e3 None None] Pushing event deleted for resources: {'Port': ['ID=e3c11349-41d2-4e18-b1a8-04a11832e4ad,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:20.271705 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-569270a5-b15e-4475-b087-fd7f7b69d0e3 None None] No DVR routers for this DVR port e3c11349-41d2-4e18-b1a8-04a11832e4ad on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:20.292249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5792460-1870-4478-ad6a-c869cdc9a50b req-78c2858d-6a8a-44da-a55a-d39ff861b3cb tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:20.294082 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c5792460-1870-4478-ad6a-c869cdc9a50b req-78c2858d-6a8a-44da-a55a-d39ff861b3cb tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.3143480 Dec 10 14:28:20.301642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:20.368454 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-12e9864f-f9dc-4f6f-b342-6729765c75de', 'network_id': '12e9864f-f9dc-4f6f-b342-6729765c75de', 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'fixed_ips': [{'subnet_id': '8adbea61-9b0b-429b-8140-84baa0565864'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:20.369294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:20.458093 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fc003bbd-edca-4951-bbae-91df9bbd8dba tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] 10.222.0.57 "GET /v2.0/agents/49f757ec-c878-47c2-8703-2255ce9b2f6c/dhcp-networks HTTP/1.1" status: 200 len: 7939 time: 0.3599513 Dec 10 14:28:20.461984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce386cb-3977-4091-a724-1e147e25891d req-c223ad04-dd08-4ddb-b340-3415020944ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:20.463851 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4ce386cb-3977-4091-a724-1e147e25891d req-c223ad04-dd08-4ddb-b340-3415020944ba service neutron] 10.222.0.39 "GET /v2.0/networks?id=6ba405b9-cdef-4b06-9661-6ad5871b3c6b HTTP/1.1" status: 200 len: 897 time: 0.3842745 Dec 10 14:28:20.465460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56878) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:20.470186 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] For port 4a2e3532-7894-4209-ad1e-5aca27394245, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:20.475111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] For port 4a2e3532-7894-4209-ad1e-5aca27394245, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=4a2e3532-7894-4209-ad1e-5aca27394245,segment=NetworkSegment(0babddd5-7dfe-4053-aadc-afd6a9cd9116),segment_id=0babddd5-7dfe-4053-aadc-afd6a9cd9116)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:20.547033 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:27:30Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '17a6f7a3-9b53-4a18-b1cf-56e4db4be95c', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.24', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 842, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:16Z', 'updated_at': '2021-12-10T14:28:16Z', 'revision_number': 0, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:20.587757 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] Checking router: 9d7899bb-a9e2-467f-bfc6-02634a8598ca for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:28:20.598358 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:20.600170 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:20.616320 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 62f6936a-4052-4c55-a4da-5b8b8be326f4) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:20.626399 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:20.636109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e686eb3e-d1e2-4f44-afc1-3ff3dde4e96f None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:20.638958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:20.646873 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:20.647562 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:20.686506 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4ce386cb-3977-4091-a724-1e147e25891d req-6c954f85-64c6-485f-9fc1-99be67c48ba4 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2648b8af-c0bf-4811-b353-779f2426f8b8 HTTP/1.1" status: 200 len: 999 time: 0.1933150 Dec 10 14:28:20.700205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e3c11349-41d2-4e18-b1a8-04a11832e4ad no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:20.702999 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.7822170 Dec 10 14:28:20.709939 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ebc6ca67-a748-4d46-a68c-3b0f1b07d5bb tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.6130505 Dec 10 14:28:20.710355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56880) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:20.710706 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56882) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:20.717969 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-003a816d-0bea-41fa-91b6-ec7c8d3b196a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1580652686', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:20.724873 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c1dee76f-c3ce-4a0e-8eb2-c7cf3a132e95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 7.6154709 Dec 10 14:28:20.728525 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': '57850d2b-b9dc-4c49-8eb5-09a692a7a89c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:20.734755 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:28:20.737359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5b653bb-1b85-4af2-93c6-2ba091715332" -d '{"events": [{"name": "network-changed", "server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:28:20.757452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56884) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:20.769004 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:20.780544 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4b03134-5736-4473-a7de-ec9a88a56825 tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] Network de7f9303-04aa-453d-a3ba-cbb919e1da78 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:20.806123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['77cafb0a-7176-47c2-8411-eb7f3bd67195']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:20.822202 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3679a87d-9065-40c8-bf71-a568aedbd070 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 2.1151497 Dec 10 14:28:20.824672 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c5792460-1870-4478-ad6a-c869cdc9a50b req-3d7a7970-6db4-453d-87e5-d58d5f857837 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1059563 Dec 10 14:28:20.837975 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56888) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:20.838977 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:28:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0b4c873-a4ca-4e91-aff7-8a685ddbfbfd x-openstack-request-id: req-e0b4c873-a4ca-4e91-aff7-8a685ddbfbfd {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:28:20.839210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:28:20.839484 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-e0b4c873-a4ca-4e91-aff7-8a685ddbfbfd {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:28:20.839891 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'status': 'completed', 'code': 200} Dec 10 14:28:20.846619 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-950123828'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:20.851305 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b3fb7f2-abbe-4979-b59a-9f548bf64831 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=57850d2b-b9dc-4c49-8eb5-09a692a7a89c,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:20.861015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ca55cd62-cb38-40e2-af56-731a0beddde9') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:20.861015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ca55cd62-cb38-40e2-af56-731a0beddde9') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:20.894620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56890) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:20.928033 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 57850d2b-b9dc-4c49-8eb5-09a692a7a89c details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:20.959641 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d4b03134-5736-4473-a7de-ec9a88a56825 tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] 10.222.0.57 "POST /v2.0/agents/49f757ec-c878-47c2-8703-2255ce9b2f6c/dhcp-networks HTTP/1.1" status: 201 len: 201 time: 0.4875128 Dec 10 14:28:20.961167 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce386cb-3977-4091-a724-1e147e25891d req-3ac149e9-3678-4ab9-8dee-9e37c69134d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:20.962323 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4ce386cb-3977-4091-a724-1e147e25891d req-3ac149e9-3678-4ab9-8dee-9e37c69134d0 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=0f3ba970-7746-4f0a-8fc3-e64be22456c1 HTTP/1.1" status: 200 len: 834 time: 0.2673104 Dec 10 14:28:20.962793 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: e3c11349-41d2-4e18-b1a8-04a11832e4ad {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:20.962940 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56892) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:20.963140 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e3c11349-41d2-4e18-b1a8-04a11832e4ad not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:20.980298 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e8e476d-6f57-490a-8f81-8e28d196a585 None None] Network de7f9303-04aa-453d-a3ba-cbb919e1da78 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:21.013292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.060726 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-800710c8-4401-4cd3-a173-6022f02856c6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/17a6f7a3-9b53-4a18-b1cf-56e4db4be95c HTTP/1.1" status: 200 len: 990 time: 0.3022876 Dec 10 14:28:21.069270 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-003a816d-0bea-41fa-91b6-ec7c8d3b196a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.070647 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Allocated IP 2001:db8::2 (12e9864f-f9dc-4f6f-b342-6729765c75de/8adbea61-9b0b-429b-8140-84baa0565864/5bf42dec-0f93-44f4-8bda-bd904ee3d407) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:21.070994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-003a816d-0bea-41fa-91b6-ec7c8d3b196a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.109216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.144061 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-28b853c9-75f0-43ff-b5e0-efe2247584e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:21.145670 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-28b853c9-75f0-43ff-b5e0-efe2247584e3 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 1098 time: 0.2912576 Dec 10 14:28:21.148682 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:21.152655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.178217 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:27:30Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '17a6f7a3-9b53-4a18-b1cf-56e4db4be95c', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.24', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 842, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:16Z', 'updated_at': '2021-12-10T14:28:16Z', 'revision_number': 0, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:21.187244 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70542981-d8fe-44c5-a882-b7a6b510b36b None None] Pushing event updated for resources: {'Port': ['ID=4a2e3532-7894-4209-ad1e-5aca27394245,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:21.212121 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66401b27-c82e-425f-90c6-59b16a917fdf None None] The sync data for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv is: [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:27:30Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '17a6f7a3-9b53-4a18-b1cf-56e4db4be95c', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.24', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 842, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:16Z', 'updated_at': '2021-12-10T14:28:16Z', 'revision_number': 0, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:21.254945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-003a816d-0bea-41fa-91b6-ec7c8d3b196a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.280244 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Releasing vlan 360 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:21.280661 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.290756 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8bb7e7ca-c538-408b-814a-22f582c7b88f tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/floatingips/c31794c0-9085-409e-a56d-0bcda9bb0856 HTTP/1.1" status: 200 len: 991 time: 0.3945045 Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:21.301725 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:21.307084 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:35Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': 'c31794c0-9085-409e-a56d-0bcda9bb0856', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'floating_ip_address': '172.26.2.28', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'port_id': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 845, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'mac_address': 'fa:16:3e:a5:15:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:17Z', 'updated_at': '2021-12-10T14:28:17Z', 'revision_number': 0, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1aa93550-1de5-47ad-9798-720589f428cb', 'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'mac_address': 'fa:16:3e:ad:c9:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 746, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:31Z', 'updated_at': '2021-12-10T14:27:42Z', 'revision_number': 5, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'subnets': [{'id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:21.342579 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] Checking router: bd5934f5-df99-4165-8014-b21160f71cfb for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:28:21.344188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-003a816d-0bea-41fa-91b6-ec7c8d3b196a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.365664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:21.366450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:21.380334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce386cb-3977-4091-a724-1e147e25891d req-7fe3e5bb-18d2-4580-a5a9-a98aa5a748f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:21.382140 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4ce386cb-3977-4091-a724-1e147e25891d req-7fe3e5bb-18d2-4580-a5a9-a98aa5a748f2 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=6ba405b9-cdef-4b06-9661-6ad5871b3c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.4007769 Dec 10 14:28:21.465996 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] vlan segment allocate from pool success with {'vlan_id': 376, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:21.478905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:21.482823 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.523783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-75c5f2fd-2cf8-40b8-85fe-c6bb84f5d0b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:21.526034 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-75c5f2fd-2cf8-40b8-85fe-c6bb84f5d0b9 service neutron] 10.222.0.39 "GET /v2.0/networks?id=041ac3a9-0ca7-4449-9782-639f1235b461 HTTP/1.1" status: 200 len: 898 time: 0.3703082 Dec 10 14:28:21.544808 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.555287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:21.593228 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-003a816d-0bea-41fa-91b6-ec7c8d3b196a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.594663 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-003a816d-0bea-41fa-91b6-ec7c8d3b196a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.8818736 Dec 10 14:28:21.606201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56894) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:21.616747 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.619222 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.619751 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Added segment 1111e08f-62a9-47a5-a551-03f7ed5fdac5 of type vlan for network a84074fe-bdc8-4cf5-ace5-747459c97f2b Dec 10 14:28:21.644473 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.650074 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/networks/77cafb0a-7176-47c2-8411-eb7f3bd67195 HTTP/1.1" status: 204 len: 168 time: 2.4697957 Dec 10 14:28:21.656693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56896) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:21.658151 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6591e24-421e-45ef-ae62-1974b2fb8e6f None None] New status for floating IP 17a6f7a3-9b53-4a18-b1cf-56e4db4be95c: ACTIVE {{(pid=103812) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:28:21.666136 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.698777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1407247267'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:21.701783 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4ce386cb-3977-4091-a724-1e147e25891d req-fb777062-a4ee-4b5c-bd43-896f6630702f service neutron] 10.222.0.39 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3091977 Dec 10 14:28:21.710684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730499e3-6bbe-4b93-9c43-a2d3b3c478c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Network': ['ID=77cafb0a-7176-47c2-8411-eb7f3bd67195,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:21.742640 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:21.749614 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-e7897e5d-1eeb-4745-85a7-f98efd936ad7 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e HTTP/1.1" status: 200 len: 998 time: 0.2158804 Dec 10 14:28:21.759249 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d19c6f88-1e5d-4d09-a2be-f3fd649cf1db tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] 10.222.0.57 "GET /v2.0/agents/49f757ec-c878-47c2-8703-2255ce9b2f6c/dhcp-networks HTTP/1.1" status: 200 len: 9469 time: 0.7864013 Dec 10 14:28:21.761210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56898) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:21.773972 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Network 12e9864f-f9dc-4f6f-b342-6729765c75de is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:21.783412 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:21.799905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:21.817645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-3fd8461b-96b6-4964-b243-66bed95ad407 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:21.817645 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-3fd8461b-96b6-4964-b243-66bed95ad407 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a HTTP/1.1" status: 200 len: 834 time: 0.0576112 Dec 10 14:28:21.874797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Pushing event updated for resources: {'Port': ['ID=5bf42dec-0f93-44f4-8bda-bd904ee3d407,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:21.882074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-0849b486-241c-40a7-ac12-5c997ea46566 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:21.885214 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-0849b486-241c-40a7-ac12-5c997ea46566 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=041ac3a9-0ca7-4449-9782-639f1235b461&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0614121 Dec 10 14:28:21.988948 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:21.995714 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.025029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Attempting to bind port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:22.025546 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Attempting to bind port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '0710b915-b607-4acf-bd3a-be8f764ec316', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '12e9864f-f9dc-4f6f-b342-6729765c75de'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:22.025992 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Attempting to bind port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 on network 12e9864f-f9dc-4f6f-b342-6729765c75de {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:22.040666 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-368fd947-38b1-4577-b31e-5f1187ec0a8d service neutron] 10.222.0.39 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1438975 Dec 10 14:28:22.063634 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:22.064351 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Checking segment: {'id': '0710b915-b607-4acf-bd3a-be8f764ec316', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '12e9864f-f9dc-4f6f-b342-6729765c75de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:22.069175 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.069175 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Bound using segment: {'id': '0710b915-b607-4acf-bd3a-be8f764ec316', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '12e9864f-f9dc-4f6f-b342-6729765c75de'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:22.069175 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Bound port: 5bf42dec-0f93-44f4-8bda-bd904ee3d407, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0710b915-b607-4acf-bd3a-be8f764ec316', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '12e9864f-f9dc-4f6f-b342-6729765c75de'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:22.069175 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.070842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56900) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:22.080625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.087330 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:22.088204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.155593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] For port 5bf42dec-0f93-44f4-8bda-bd904ee3d407, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:22.159563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] For port 5bf42dec-0f93-44f4-8bda-bd904ee3d407, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5bf42dec-0f93-44f4-8bda-bd904ee3d407,segment=NetworkSegment(0710b915-b607-4acf-bd3a-be8f764ec316),segment_id=0710b915-b607-4acf-bd3a-be8f764ec316)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:22.186904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:35Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': 'c31794c0-9085-409e-a56d-0bcda9bb0856', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'floating_ip_address': '172.26.2.28', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'port_id': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 845, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'mac_address': 'fa:16:3e:a5:15:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:17Z', 'updated_at': '2021-12-10T14:28:17Z', 'revision_number': 0, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1aa93550-1de5-47ad-9798-720589f428cb', 'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'mac_address': 'fa:16:3e:ad:c9:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 746, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:31Z', 'updated_at': '2021-12-10T14:27:42Z', 'revision_number': 5, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'subnets': [{'id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:22.219879 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d4e035-85fc-4094-a9ec-d642be47b245 None None] The sync data for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv is: [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:35Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': 'c31794c0-9085-409e-a56d-0bcda9bb0856', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'floating_ip_address': '172.26.2.28', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'port_id': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 845, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'mac_address': 'fa:16:3e:a5:15:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:17Z', 'updated_at': '2021-12-10T14:28:17Z', 'revision_number': 0, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1aa93550-1de5-47ad-9798-720589f428cb', 'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'mac_address': 'fa:16:3e:ad:c9:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 746, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:31Z', 'updated_at': '2021-12-10T14:27:42Z', 'revision_number': 5, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'subnets': [{'id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:22.237058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.314369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56902) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:22.328498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.api [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Retry wrapper got retriable exception: Unable to create the network. No available network found in maximum allowed attempts. {{(pid=103811) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:22.329405 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG oslo_db.api [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_network {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:22.344654 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eccf1567-2782-4e45-8452-8f54cfff3280 None None] Pushing event updated for resources: {'Port': ['ID=5bf42dec-0f93-44f4-8bda-bd904ee3d407,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:22.355640 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Network': ['ID=a84074fe-bdc8-4cf5-ace5-747459c97f2b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:22.364436 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c5b653bb-1b85-4af2-93c6-2ba091715332 req-925bdb08-2308-401b-9caa-344208f9afeb service neutron] 10.222.0.39 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3162329 Dec 10 14:28:22.382551 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network a84074fe-bdc8-4cf5-ace5-747459c97f2b details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:22.397716 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8276c783-0324-434e-94e9-0a2ba4531391 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/17a6f7a3-9b53-4a18-b1cf-56e4db4be95c HTTP/1.1" status: 200 len: 992 time: 0.3210068 Dec 10 14:28:22.435296 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-eef0349d-ad10-4e10-a222-dc5192366c3f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.5982096 Dec 10 14:28:22.435927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56904) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:22.448466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'ports': [{'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4'}, {'network_id': 'a84074fe-bdc8-4cf5-ace5-747459c97f2b'}]} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:22.448790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:22.455917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': 'a84074fe-bdc8-4cf5-ace5-747459c97f2b'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:22.525684 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da1f0cf1-8453-4db2-9c66-c3894a6968f2 None None] Network b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:22.548573 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4ce386cb-3977-4091-a724-1e147e25891d req-3682b94c-11a6-427b-8a2a-5a01e1a0e94c service neutron] 10.222.0.39 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7994194 Dec 10 14:28:22.644804 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e63e9e4-1cce-42e4-975f-2b6ff9d0a0c3 None None] New status for floating IP c31794c0-9085-409e-a56d-0bcda9bb0856: ACTIVE {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:28:22.703841 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-220083b4-4e35-4c92-a481-9a10c953fb35 tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] 10.222.0.57 "DELETE /v2.0/agents/49f757ec-c878-47c2-8703-2255ce9b2f6c/dhcp-networks/de7f9303-04aa-453d-a3ba-cbb919e1da78 HTTP/1.1" status: 204 len: 168 time: 0.9310822 Dec 10 14:28:22.704553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56906) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:22.711740 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-de44bcaa-5df3-4c72-8c38-800645aa9bb5 None None] Provisioning complete for port 4a2e3532-7894-4209-ad1e-5aca27394245 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:22.712816 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de44bcaa-5df3-4c72-8c38-800645aa9bb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.734644 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-50fa91bd-6185-4e12-a1db-3262796f36d0 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/floatingips/c31794c0-9085-409e-a56d-0bcda9bb0856 HTTP/1.1" status: 200 len: 991 time: 0.3858864 Dec 10 14:28:22.768796 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4a2e3532-7894-4209-ad1e-5aca27394245 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:22.830628 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.833372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.843749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.877353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 2} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:22.885589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.889029 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] vlan segment allocate from pool success with {'vlan_id': 378, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:22.928222 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de44bcaa-5df3-4c72-8c38-800645aa9bb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.931103 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.935990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 4a2e3532-7894-4209-ad1e-5aca27394245 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:22.936235 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.944001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:22.944633 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Added segment 385d39c8-e30e-44b5-b2c1-6b64297e3512 of type vlan for network 7f854959-c3ea-466e-9a61-6fc317909c20 Dec 10 14:28:23.034593 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=e592802c-738d-442f-af41-1c40305185cd,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:23.059106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.102821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port cf5dce4a-ef32-4a93-9a6c-6d136c996e6c yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:23.130802 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56908) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:23.133850 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-84b92123-e082-428b-9402-7495b2d89a7b tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] 10.222.0.57 "GET /v2.0/agents/49f757ec-c878-47c2-8703-2255ce9b2f6c/dhcp-networks HTTP/1.1" status: 200 len: 7957 time: 0.4159925 Dec 10 14:28:23.173648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking segment: {'id': 'ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 359, 'network_id': '57850d2b-b9dc-4c49-8eb5-09a692a7a89c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:23.174579 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network hostable DHCP agents. Network: 57850d2b-b9dc-4c49-8eb5-09a692a7a89c, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:23.198605 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-de44bcaa-5df3-4c72-8c38-800645aa9bb5 None None] For port 4a2e3532-7894-4209-ad1e-5aca27394245, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=4a2e3532-7894-4209-ad1e-5aca27394245,segment=NetworkSegment(0babddd5-7dfe-4053-aadc-afd6a9cd9116),segment_id=0babddd5-7dfe-4053-aadc-afd6a9cd9116)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:23.203066 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e52a45a1-87fa-4254-b57a-75a506b757ef tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] 10.222.0.57 "GET /v2.0/networks/af595149-c7c0-48e7-ac79-e16508a39a66/dhcp-agents HTTP/1.1" status: 200 len: 811 time: 0.0611503 Dec 10 14:28:23.206939 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56910) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:23.249788 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.259743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.268762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:23.271823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.279705 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9a196c63-2582-4fa8-abd5-6d793744d7a5 tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] 10.222.0.57 "GET /v2.0/networks/af595149-c7c0-48e7-ac79-e16508a39a66/dhcp-agents HTTP/1.1" status: 200 len: 811 time: 0.0647051 Dec 10 14:28:23.280328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56912) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:23.293343 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de44bcaa-5df3-4c72-8c38-800645aa9bb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.342376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network 57850d2b-b9dc-4c49-8eb5-09a692a7a89c is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:23.406773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:23.407927 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:23.419274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Network': ['ID=7f854959-c3ea-466e-9a61-6fc317909c20,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:23.423874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de44bcaa-5df3-4c72-8c38-800645aa9bb5 None None] Pushing event updated for resources: {'Port': ['ID=4a2e3532-7894-4209-ad1e-5aca27394245,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:23.433919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7c57324d-62ef-45cc-b953-19d7da243595 None None] Provisioning complete for port 4a2e3532-7894-4209-ad1e-5aca27394245 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:23.434641 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7c57324d-62ef-45cc-b953-19d7da243595 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.438263 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 7f854959-c3ea-466e-9a61-6fc317909c20 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:23.439605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 2001:db8::1 (12e9864f-f9dc-4f6f-b342-6729765c75de/8adbea61-9b0b-429b-8140-84baa0565864/1de96874-7238-4c53-811e-27d40eacad08) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:23.458234 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56914) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:23.459753 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-40665c37-944f-487b-9596-efec4c35da06 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.7898622 Dec 10 14:28:23.471717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': '7f854959-c3ea-466e-9a61-6fc317909c20', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:23.496421 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.572826 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 57850d2b-b9dc-4c49-8eb5-09a692a7a89c) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:23.600911 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 11e48f4e-d662-4dd1-a460-2eac72f70a75 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:23.604452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44816ed1-8ba8-4d02-a6bd-0fae8190f0b0 None None] Network 57850d2b-b9dc-4c49-8eb5-09a692a7a89c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:23.623920 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:23.624517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.637735 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-782ebef9-6561-4038-855e-3d1c9cd14d1c tempest-DHCPAgentSchedulersTestJSON-746613643 tempest-DHCPAgentSchedulersTestJSON-746613643-project-admin] 10.222.0.57 "GET /v2.0/agents/49f757ec-c878-47c2-8703-2255ce9b2f6c/dhcp-networks HTTP/1.1" status: 200 len: 7957 time: 0.3521228 Dec 10 14:28:23.638618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56916) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:23.742720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56918) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:23.744921 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-57850d2b-b9dc-4c49-8eb5-09a692a7a89c', 'network_id': '57850d2b-b9dc-4c49-8eb5-09a692a7a89c', 'project_id': '243ec7ec23134148a44eb888e6040f25', 'fixed_ips': [{'subnet_id': 'e592802c-738d-442f-af41-1c40305185cd'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:23.746197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.756197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.802955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:23.802955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.831557 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.838865 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.850953 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c02661a-287b-408e-abc4-3d5e49ae1132 None None] Network 12e9864f-f9dc-4f6f-b342-6729765c75de requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:23.903074 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e13f7a6c-f095-4733-8459-4c859ecdff6e tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/floatingips/c31794c0-9085-409e-a56d-0bcda9bb0856 HTTP/1.1" status: 200 len: 993 time: 0.1514144 Dec 10 14:28:23.915342 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e6f90137-7c4e-4904-8bc8-efaf255adb03 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 3.2010024 Dec 10 14:28:23.920908 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56920) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:23.965337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:23.992046 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['de7f9303-04aa-453d-a3ba-cbb919e1da78']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:24.003760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Allocated IP 2001:db8::1 (57850d2b-b9dc-4c49-8eb5-09a692a7a89c/e592802c-738d-442f-af41-1c40305185cd/22597c1a-39d8-48f9-96c0-36617e247eff) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:24.005189 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.007772 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '80defbcd-4d3e-432f-8605-08f5b533e311') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:24.010549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '80defbcd-4d3e-432f-8605-08f5b533e311') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:24.016148 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8118b2e6-0171-49e1-ba96-8403f03e81a9 None None] Provisioning complete for port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:24.016596 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8118b2e6-0171-49e1-ba96-8403f03e81a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.023331 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.032697 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.048924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.088762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Releasing vlan 352 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:24.089058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:24.094534 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:24.100395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:24.107382 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 12e9864f-f9dc-4f6f-b342-6729765c75de is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:24.112738 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:24.119451 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.127463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:24.133469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:24.133700 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.135835 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=1de96874-7238-4c53-811e-27d40eacad08,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:24.146754 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=cf5dce4a-ef32-4a93-9a6c-6d136c996e6c,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:24.175277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:24.175564 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.212927 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8118b2e6-0171-49e1-ba96-8403f03e81a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.260715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=11e48f4e-d662-4dd1-a460-2eac72f70a75,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:24.271007 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.281078 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8118b2e6-0171-49e1-ba96-8403f03e81a9 None None] For port 5bf42dec-0f93-44f4-8bda-bd904ee3d407, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5bf42dec-0f93-44f4-8bda-bd904ee3d407,segment=NetworkSegment(0710b915-b607-4acf-bd3a-be8f764ec316),segment_id=0710b915-b607-4acf-bd3a-be8f764ec316)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:24.281602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.288198 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] 10.222.0.57 "DELETE /v2.0/networks/de7f9303-04aa-453d-a3ba-cbb919e1da78 HTTP/1.1" status: 204 len: 168 time: 0.6482484 Dec 10 14:28:24.289479 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Checking segment: {'id': '1111e08f-62a9-47a5-a551-03f7ed5fdac5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 376, 'network_id': 'a84074fe-bdc8-4cf5-ace5-747459c97f2b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:24.291868 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network hostable DHCP agents. Network: a84074fe-bdc8-4cf5-ace5-747459c97f2b, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:24.293626 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.294943 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56922) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:24.311386 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7a5eef-30b2-4164-a813-255d08790784 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event deleted for resources: {'Network': ['ID=de7f9303-04aa-453d-a3ba-cbb919e1da78,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:24.347240 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.349969 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-b8c8d393-6155-426b-bede-65f73e526a0f tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:24.350536 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b8c8d393-6155-426b-bede-65f73e526a0f tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:24.353640 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b8c8d393-6155-426b-bede-65f73e526a0f tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] 10.222.0.57 "DELETE /v2.0/ports/3dae9810-29fe-4ac3-a13f-2799d989f1af HTTP/1.1" status: 404 len: 333 time: 0.0554588 Dec 10 14:28:24.356396 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56924) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:24.360099 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8118b2e6-0171-49e1-ba96-8403f03e81a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.394446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.423404 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-bf07256f-a1a5-4bd5-8778-cd8097777af9 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Deleting subnet c8971c17-4edc-4733-a849-2260a9a3f183 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:24.428348 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8118b2e6-0171-49e1-ba96-8403f03e81a9 None None] Pushing event updated for resources: {'Port': ['ID=5bf42dec-0f93-44f4-8bda-bd904ee3d407,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:24.428639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bf07256f-a1a5-4bd5-8778-cd8097777af9 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.445611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.463607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network a84074fe-bdc8-4cf5-ace5-747459c97f2b is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:24.464336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=df894c5e-6d1a-4ba8-97d1-6b1e1b299d43,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:24.500730 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Network 57850d2b-b9dc-4c49-8eb5-09a692a7a89c is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:24.511330 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:24.512199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bf07256f-a1a5-4bd5-8778-cd8097777af9 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.515542 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:24.522367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.524313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Checking segment: {'id': '385d39c8-e30e-44b5-b2c1-6b64297e3512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 378, 'network_id': '7f854959-c3ea-466e-9a61-6fc317909c20'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:24.524675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network hostable DHCP agents. Network: 7f854959-c3ea-466e-9a61-6fc317909c20, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:24.593293 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, a84074fe-bdc8-4cf5-ace5-747459c97f2b) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:24.604275 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:24.610696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:24.616015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:24.616782 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.626857 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Pushing event updated for resources: {'Port': ['ID=22597c1a-39d8-48f9-96c0-36617e247eff,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:24.641051 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2c19f1b-b5a3-4fc2-a69e-9ae35d37bb76 None None] Network a84074fe-bdc8-4cf5-ace5-747459c97f2b requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:24.653047 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Attempting to bind port 22597c1a-39d8-48f9-96c0-36617e247eff on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:24.657601 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Attempting to bind port 22597c1a-39d8-48f9-96c0-36617e247eff by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 359, 'network_id': '57850d2b-b9dc-4c49-8eb5-09a692a7a89c'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:24.657601 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Attempting to bind port 22597c1a-39d8-48f9-96c0-36617e247eff on network 57850d2b-b9dc-4c49-8eb5-09a692a7a89c {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:24.683837 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.703616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bf07256f-a1a5-4bd5-8778-cd8097777af9 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.705023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7affcbab-8aaf-4649-a606-501d4ce1eade None None] Provisioning complete for port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:24.705400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7affcbab-8aaf-4649-a606-501d4ce1eade None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.707535 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:24.707912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Checking segment: {'id': 'ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 359, 'network_id': '57850d2b-b9dc-4c49-8eb5-09a692a7a89c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:24.708316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.709281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Bound using segment: {'id': 'ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 359, 'network_id': '57850d2b-b9dc-4c49-8eb5-09a692a7a89c'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:24.709804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Bound port: 22597c1a-39d8-48f9-96c0-36617e247eff, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 359, 'network_id': '57850d2b-b9dc-4c49-8eb5-09a692a7a89c'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:24.710188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.728846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 7f854959-c3ea-466e-9a61-6fc317909c20 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:24.773727 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=e592802c-738d-442f-af41-1c40305185cd,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:24.800269 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-493d98bf-0b01-4acf-a1ab-78b69665e8d4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 2.3631728 Dec 10 14:28:24.802811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 7f854959-c3ea-466e-9a61-6fc317909c20) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:24.807754 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56926) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:24.833015 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5bf42dec-0f93-44f4-8bda-bd904ee3d407 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:24.836404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffeca76a-d85c-448f-a120-565e0cace5a9 None None] Network 7f854959-c3ea-466e-9a61-6fc317909c20 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:24.868330 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bf07256f-a1a5-4bd5-8778-cd8097777af9 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.873688 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:24.874529 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.924611 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf07256f-a1a5-4bd5-8778-cd8097777af9 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event deleted for resources: {'Subnet': ['ID=c8971c17-4edc-4733-a849-2260a9a3f183,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:24.926691 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bf07256f-a1a5-4bd5-8778-cd8097777af9 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.932963 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bf07256f-a1a5-4bd5-8778-cd8097777af9 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] 10.222.0.57 "DELETE /v2.0/subnets/c8971c17-4edc-4733-a849-2260a9a3f183 HTTP/1.1" status: 204 len: 168 time: 0.5719161 Dec 10 14:28:24.933314 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:24.933464 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56928) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:24.969139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8c33df4-ea38-4a95-a059-e0f3db8aa6ab None None] Network af595149-c7c0-48e7-ac79-e16508a39a66 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:24.998329 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] For port 22597c1a-39d8-48f9-96c0-36617e247eff, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:25.004585 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['57850d2b-b9dc-4c49-8eb5-09a692a7a89c']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:25.019324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:25.024640 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:25.025583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.035945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1c6fdfd8-bf40-4b04-9b3f-36a04373bb5d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 11e48f4e-d662-4dd1-a460-2eac72f70a75 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:25.036252 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c6fdfd8-bf40-4b04-9b3f-36a04373bb5d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.040155 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.057803 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ca6f0b56-970c-448a-a56a-15879673b294 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5948958 Dec 10 14:28:25.066735 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56930) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:25.074622 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': '7f854959-c3ea-466e-9a61-6fc317909c20', 'name': 'tempest-PortsTestJSON-898277544', 'fixed_ips': [{'subnet_id': 'df894c5e-6d1a-4ba8-97d1-6b1e1b299d43', 'ip_address': '172.20.0.10'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:25.091838 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] For port 22597c1a-39d8-48f9-96c0-36617e247eff, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=22597c1a-39d8-48f9-96c0-36617e247eff,segment=NetworkSegment(ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa),segment_id=ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:25.126961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c6fdfd8-bf40-4b04-9b3f-36a04373bb5d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.142690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1c6fdfd8-bf40-4b04-9b3f-36a04373bb5d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 11e48f4e-d662-4dd1-a460-2eac72f70a75 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:25.159141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.173617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.181775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:25.182145 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.187863 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 359 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:25.188412 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:25.191715 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:25.246790 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.247703 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.359306 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.388182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=1de96874-7238-4c53-811e-27d40eacad08,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:25.388182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:28:25.388182 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:28:25.388182 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': '57850d2b-b9dc-4c49-8eb5-09a692a7a89c'}] Dec 10 14:28:25.388182 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:25.388182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:25.407058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-7f854959-c3ea-466e-9a61-6fc317909c20', 'network_id': '7f854959-c3ea-466e-9a61-6fc317909c20', 'project_id': '7a25938276dc428b9a5723e37d120269', 'fixed_ips': [{'subnet_id': 'df894c5e-6d1a-4ba8-97d1-6b1e1b299d43'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:25.407953 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.433850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:25.447575 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7affcbab-8aaf-4649-a606-501d4ce1eade None None] Provisioning complete for port 1de96874-7238-4c53-811e-27d40eacad08 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:25.448095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7affcbab-8aaf-4649-a606-501d4ce1eade None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.475813 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 12e9864f-f9dc-4f6f-b342-6729765c75de is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:25.479151 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:25.495607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Deleting port c84b1d03-a3d6-4a71-8805-fa2ae386073f {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:25.495945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.530424 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537522a4-df61-4db9-a4a7-5df64e7a83cb None None] Pushing event updated for resources: {'Port': ['ID=22597c1a-39d8-48f9-96c0-36617e247eff,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:25.577820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] For port c84b1d03-a3d6-4a71-8805-fa2ae386073f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c84b1d03-a3d6-4a71-8805-fa2ae386073f,segment=NetworkSegment(91ce7121-bbf1-4bc7-96a3-34b592008626),segment_id=91ce7121-bbf1-4bc7-96a3-34b592008626)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:25.578195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.596438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] DHCP port deletion for af595149-c7c0-48e7-ac79-e16508a39a66 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:25.598952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Calling delete_port for c84b1d03-a3d6-4a71-8805-fa2ae386073f owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:25.618268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7affcbab-8aaf-4649-a606-501d4ce1eade None None] Port 1de96874-7238-4c53-811e-27d40eacad08 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:25.648147 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e88a30a2-de53-423b-ad35-63973f57bc00 None None] Network 57850d2b-b9dc-4c49-8eb5-09a692a7a89c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:25.726095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c6fdfd8-bf40-4b04-9b3f-36a04373bb5d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.770118 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c6fdfd8-bf40-4b04-9b3f-36a04373bb5d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=11e48f4e-d662-4dd1-a460-2eac72f70a75,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:25.776314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4a2e3532-7894-4209-ad1e-5aca27394245 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:25.781614 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c6fdfd8-bf40-4b04-9b3f-36a04373bb5d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.788336 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1c6fdfd8-bf40-4b04-9b3f-36a04373bb5d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/11e48f4e-d662-4dd1-a460-2eac72f70a75 HTTP/1.1" status: 204 len: 168 time: 0.9740136 Dec 10 14:28:25.789708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56932) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:25.825686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.869919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event deleted for resources: {'Port': ['ID=c84b1d03-a3d6-4a71-8805-fa2ae386073f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:25.875844 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] No DVR routers for this DVR port c84b1d03-a3d6-4a71-8805-fa2ae386073f on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:25.887606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Allocated IP 172.20.0.2 (7f854959-c3ea-466e-9a61-6fc317909c20/df894c5e-6d1a-4ba8-97d1-6b1e1b299d43/3aaee424-7c64-47bc-b5f3-3a90075330d6) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:25.890955 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d059ac66-8c2b-483f-a121-935a32ef6c3d None None] Provisioning complete for port 1de96874-7238-4c53-811e-27d40eacad08 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:25.891332 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d059ac66-8c2b-483f-a121-935a32ef6c3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.911054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2500e95e-ced5-437a-9e1f-3bf1450e648d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:25.917969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2500e95e-ced5-437a-9e1f-3bf1450e648d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:25.922350 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2500e95e-ced5-437a-9e1f-3bf1450e648d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1456 time: 0.1294763 Dec 10 14:28:25.923371 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56934) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:25.973460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] Deleting port c84b1d03-a3d6-4a71-8805-fa2ae386073f {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:25.973837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:25.976359 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.005160 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d059ac66-8c2b-483f-a121-935a32ef6c3d None None] Port 1de96874-7238-4c53-811e-27d40eacad08 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:26.017440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.061072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['af595149-c7c0-48e7-ac79-e16508a39a66']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:26.070332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.072994 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '91ce7121-bbf1-4bc7-96a3-34b592008626') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:26.073178 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '91ce7121-bbf1-4bc7-96a3-34b592008626') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:26.080842 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 4a2e3532-7894-4209-ad1e-5aca27394245 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:26.081016 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.085876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.103294 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.111495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Releasing vlan 354 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:26.111770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port 14609236-db16-43c0-8787-311f743672b1 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:26.111925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:26.114919 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:26.117493 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4d577cfc-238b-48b7-8678-f178fd4ca0b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port cf5dce4a-ef32-4a93-9a6c-6d136c996e6c {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:26.117689 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4d577cfc-238b-48b7-8678-f178fd4ca0b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.136700 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] For port c84b1d03-a3d6-4a71-8805-fa2ae386073f, host dv-neutron-821401-2-hyperv, got binding levels [] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:26.137101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.176882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] Calling delete_port for c84b1d03-a3d6-4a71-8805-fa2ae386073f owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:26.179874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting port 22597c1a-39d8-48f9-96c0-36617e247eff {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:26.180208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.182135 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.ipam_backend_mixin [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] Port c84b1d03-a3d6-4a71-8805-fa2ae386073f was not found and therefore no delete operation was performed {{(pid=103812) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 10 14:28:26.197490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.234210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4d577cfc-238b-48b7-8678-f178fd4ca0b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.246465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4d577cfc-238b-48b7-8678-f178fd4ca0b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for cf5dce4a-ef32-4a93-9a6c-6d136c996e6c owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:26.252589 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 18508f49-2944-40b4-a289-d08025865b04 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:28:26.264704 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ebcf2a73-cb7f-4202-9f41-7ef8b311e502 None None] Provisioning complete for port 1de96874-7238-4c53-811e-27d40eacad08 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:26.265343 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ebcf2a73-cb7f-4202-9f41-7ef8b311e502 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.269221 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] Pushing event deleted for resources: {'Port': ['ID=c84b1d03-a3d6-4a71-8805-fa2ae386073f,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:26.294798 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] For port 22597c1a-39d8-48f9-96c0-36617e247eff, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=22597c1a-39d8-48f9-96c0-36617e247eff,segment=NetworkSegment(ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa),segment_id=ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:26.295175 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.304664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d46a813-46cf-4bea-8477-37e576b69fb4 None None] No DVR routers for this DVR port c84b1d03-a3d6-4a71-8805-fa2ae386073f on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:26.305135 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.314200 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.317583 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] 10.222.0.57 "DELETE /v2.0/networks/af595149-c7c0-48e7-ac79-e16508a39a66 HTTP/1.1" status: 204 len: 168 time: 1.3834376 Dec 10 14:28:26.332073 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-266f828a-d657-4117-b727-bb738b4bf9e8 tempest-DHCPAgentSchedulersTestJSON-552502867 tempest-DHCPAgentSchedulersTestJSON-552502867-project] Pushing event deleted for resources: {'Network': ['ID=af595149-c7c0-48e7-ac79-e16508a39a66,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:26.362109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.369138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ebcf2a73-cb7f-4202-9f41-7ef8b311e502 None None] Port 1de96874-7238-4c53-811e-27d40eacad08 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:26.375089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Calling delete_port for 22597c1a-39d8-48f9-96c0-36617e247eff owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:26.439223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4d577cfc-238b-48b7-8678-f178fd4ca0b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.471983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:26.473112 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.482135 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7819a331-54a4-47fe-92a2-288b1059216c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/18508f49-2944-40b4-a289-d08025865b04/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8670335 Dec 10 14:28:26.482320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d577cfc-238b-48b7-8678-f178fd4ca0b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=cf5dce4a-ef32-4a93-9a6c-6d136c996e6c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:26.482320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56938) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:26.510382 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59e3d6ba-6112-4fda-a6ef-0e543140838f None None] Sync routers for ids ['18508f49-2944-40b4-a289-d08025865b04'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:26.517684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4d577cfc-238b-48b7-8678-f178fd4ca0b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.521615 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4d577cfc-238b-48b7-8678-f178fd4ca0b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/cf5dce4a-ef32-4a93-9a6c-6d136c996e6c HTTP/1.1" status: 204 len: 168 time: 0.5966034 Dec 10 14:28:26.524284 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56940) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:26.530398 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Network 7f854959-c3ea-466e-9a61-6fc317909c20 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:26.546454 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:26.551371 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.10 (7f854959-c3ea-466e-9a61-6fc317909c20/df894c5e-6d1a-4ba8-97d1-6b1e1b299d43/14609236-db16-43c0-8787-311f743672b1) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:26.555338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:26.561988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59e3d6ba-6112-4fda-a6ef-0e543140838f None None] Routers {'18508f49-2944-40b4-a289-d08025865b04'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:26.562652 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7a9ad38-9258-4717-b4c4-c8d1f97ef979 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:26.562791 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-59e3d6ba-6112-4fda-a6ef-0e543140838f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['18508f49-2944-40b4-a289-d08025865b04'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:26.564402 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c7a9ad38-9258-4717-b4c4-c8d1f97ef979 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports/1de96874-7238-4c53-811e-27d40eacad08 HTTP/1.1" status: 200 len: 911 time: 0.0818243 Dec 10 14:28:26.568547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56942) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:26.573636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0b905281-864a-4ef0-a4e6-7ce869186862 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '8adbea61-9b0b-429b-8140-84baa0565864'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:26.575509 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Pushing event updated for resources: {'Port': ['ID=3aaee424-7c64-47bc-b5f3-3a90075330d6,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:26.624194 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-59e3d6ba-6112-4fda-a6ef-0e543140838f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:26.638981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e98c24a-4296-4c17-8b48-b7b53c33c567 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:26.643483 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4e98c24a-4296-4c17-8b48-b7b53c33c567 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.1182976 Dec 10 14:28:26.644959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56944) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:26.654602 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c84b1d03-a3d6-4a71-8805-fa2ae386073f no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:26.672749 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-cdb31ead-8830-423d-be10-40433088b4de tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:28:26.674325 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cdb31ead-8830-423d-be10-40433088b4de tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/11e48f4e-d662-4dd1-a460-2eac72f70a75 HTTP/1.1" status: 404 len: 333 time: 0.0296631 Dec 10 14:28:26.677879 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56946) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:26.684179 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59e3d6ba-6112-4fda-a6ef-0e543140838f None None] Routers {'18508f49-2944-40b4-a289-d08025865b04'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:26.685024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-59e3d6ba-6112-4fda-a6ef-0e543140838f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['18508f49-2944-40b4-a289-d08025865b04'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:26.706240 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.719805 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: c84b1d03-a3d6-4a71-8805-fa2ae386073f {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:26.720236 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c84b1d03-a3d6-4a71-8805-fa2ae386073f not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:26.723024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Attempting to bind port 3aaee424-7c64-47bc-b5f3-3a90075330d6 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:26.723485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Attempting to bind port 3aaee424-7c64-47bc-b5f3-3a90075330d6 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '385d39c8-e30e-44b5-b2c1-6b64297e3512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 378, 'network_id': '7f854959-c3ea-466e-9a61-6fc317909c20'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:26.724372 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Attempting to bind port 3aaee424-7c64-47bc-b5f3-3a90075330d6 on network 7f854959-c3ea-466e-9a61-6fc317909c20 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:26.726418 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-59e3d6ba-6112-4fda-a6ef-0e543140838f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:26.727056 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59e3d6ba-6112-4fda-a6ef-0e543140838f None None] The sync data for ids ['18508f49-2944-40b4-a289-d08025865b04'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:26.729312 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-75d681e9-4fe7-4e47-af85-30436e8a0404 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:28:26.731967 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:26.732305 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Checking segment: {'id': '385d39c8-e30e-44b5-b2c1-6b64297e3512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 378, 'network_id': '7f854959-c3ea-466e-9a61-6fc317909c20'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:26.732719 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.733112 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Bound using segment: {'id': '385d39c8-e30e-44b5-b2c1-6b64297e3512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 378, 'network_id': '7f854959-c3ea-466e-9a61-6fc317909c20'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:26.733626 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Bound port: 3aaee424-7c64-47bc-b5f3-3a90075330d6, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '385d39c8-e30e-44b5-b2c1-6b64297e3512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 378, 'network_id': '7f854959-c3ea-466e-9a61-6fc317909c20'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:26.734019 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.737944 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-75d681e9-4fe7-4e47-af85-30436e8a0404 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/cf5dce4a-ef32-4a93-9a6c-6d136c996e6c HTTP/1.1" status: 404 len: 333 time: 0.0584660 Dec 10 14:28:26.746110 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56948) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:26.762918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b905281-864a-4ef0-a4e6-7ce869186862 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.803672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] For port 3aaee424-7c64-47bc-b5f3-3a90075330d6, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:26.806914 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] For port 3aaee424-7c64-47bc-b5f3-3a90075330d6, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3aaee424-7c64-47bc-b5f3-3a90075330d6,segment=NetworkSegment(385d39c8-e30e-44b5-b2c1-6b64297e3512),segment_id=385d39c8-e30e-44b5-b2c1-6b64297e3512)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:26.814018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No DVR routers for this DVR port 22597c1a-39d8-48f9-96c0-36617e247eff on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:26.847770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Port': ['ID=22597c1a-39d8-48f9-96c0-36617e247eff,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:26.886782 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.958399 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56952) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:26.995696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:26.997234 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5f5b6f-3c73-4a90-b9a0-e54bfbc1301b None None] Pushing event updated for resources: {'Port': ['ID=3aaee424-7c64-47bc-b5f3-3a90075330d6,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:27.050160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.064081 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['57850d2b-b9dc-4c49-8eb5-09a692a7a89c']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:27.069108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.100256 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:27.100555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ed4c1a7f-0caa-41d5-b1ab-df58c4e859aa') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:27.134241 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.227320 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.242502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b905281-864a-4ef0-a4e6-7ce869186862 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.245177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.257216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 359 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:27.257623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:27.260796 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:27.341726 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a84074fe-bdc8-4cf5-ace5-747459c97f2b']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:27.342414 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b905281-864a-4ef0-a4e6-7ce869186862 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.348332 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b905281-864a-4ef0-a4e6-7ce869186862 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:27.356663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b905281-864a-4ef0-a4e6-7ce869186862 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.356663 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0b905281-864a-4ef0-a4e6-7ce869186862 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/ports/1de96874-7238-4c53-811e-27d40eacad08 HTTP/1.1" status: 200 len: 911 time: 0.7816114 Dec 10 14:28:27.356911 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3523130f-204b-4749-9153-f3cf6870c1bd admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=4e55714eff204b138587677e999b639b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3916440 Dec 10 14:28:27.356911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56956) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:27.357104 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56958) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:27.357200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1111e08f-62a9-47a5-a551-03f7ed5fdac5') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:27.357326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1111e08f-62a9-47a5-a551-03f7ed5fdac5') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:27.381728 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.383702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.450833 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.455839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 7f854959-c3ea-466e-9a61-6fc317909c20 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:27.466759 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:27.470380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b905281-864a-4ef0-a4e6-7ce869186862 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=1de96874-7238-4c53-811e-27d40eacad08,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:27.471472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Releasing vlan 376 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:27.471876 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:27.476813 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:27.487746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:27.494159 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.495652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=14609236-db16-43c0-8787-311f743672b1,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:27.558133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.561317 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/57850d2b-b9dc-4c49-8eb5-09a692a7a89c HTTP/1.1" status: 204 len: 168 time: 3.6394277 Dec 10 14:28:27.565887 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56960) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:27.570726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2076294456'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:27.590201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8232cd54-4e78-46f3-b858-0647e4cbd032 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=57850d2b-b9dc-4c49-8eb5-09a692a7a89c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:27.592046 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8d3b45d2-32b6-4a06-95c8-ba92f6ba8cc1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.627464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:27.628114 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.638068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8d3b45d2-32b6-4a06-95c8-ba92f6ba8cc1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.702830 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.710670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.714471 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/networks/a84074fe-bdc8-4cf5-ace5-747459c97f2b HTTP/1.1" status: 204 len: 168 time: 0.9672058 Dec 10 14:28:27.727644 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56962) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:27.733274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1189857801'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:27.737304 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:27.739115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8b5017a-3488-4cbf-bd36-c63858a35709 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Network': ['ID=a84074fe-bdc8-4cf5-ace5-747459c97f2b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:27.740931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.772126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8d3b45d2-32b6-4a06-95c8-ba92f6ba8cc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.773246 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 380, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:27.775082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8d3b45d2-32b6-4a06-95c8-ba92f6ba8cc1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.779020 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8d3b45d2-32b6-4a06-95c8-ba92f6ba8cc1 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/70dec902-22b6-4a2e-bbba-45f30fec3509 HTTP/1.1" status: 204 len: 168 time: 0.4213297 Dec 10 14:28:27.786405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d3b45d2-32b6-4a06-95c8-ba92f6ba8cc1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70dec902-22b6-4a2e-bbba-45f30fec3509,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:27.788892 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.789250 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment 7e00621e-01fd-46ee-be25-5e6d777b3791 of type vlan for network f0a1d371-2ebf-4348-8c07-25cc745f67e4 Dec 10 14:28:27.792336 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.826620 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-98322827-d8bb-4125-80df-ae1b1b7d8ae2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.7586598 Dec 10 14:28:27.829267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56966) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:27.835478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': '7f854959-c3ea-466e-9a61-6fc317909c20', 'name': 'tempest-PortsTestJSON-1828705822', 'fixed_ips': [{'subnet_id': 'df894c5e-6d1a-4ba8-97d1-6b1e1b299d43', 'ip_address': '172.20.0.9'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:27.920964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:27.986005 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d558aa6-9101-4b43-8a34-30019034182e None None] Network 7f854959-c3ea-466e-9a61-6fc317909c20 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:28.016553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:28.022396 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.052188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-5f0e8813-c6f9-4412-8a8d-7f004fdb01ba None None] Provisioning complete for port 3aaee424-7c64-47bc-b5f3-3a90075330d6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:28.052660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5f0e8813-c6f9-4412-8a8d-7f004fdb01ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.060464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] vlan segment allocate from pool success with {'vlan_id': 363, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:28.069356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.075188 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:28.076469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.077153 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.077902 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Added segment 2b0bf27c-489b-4be5-a3c5-ce283892edc7 of type vlan for network 143fb8b7-2d52-4eee-965b-c521d13c3de9 Dec 10 14:28:28.122816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.148876 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:28.154032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.173338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port aa294859-4c08-43dc-80b9-8ee995f919b7 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:28.178106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5f0e8813-c6f9-4412-8a8d-7f004fdb01ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.205253 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=f0a1d371-2ebf-4348-8c07-25cc745f67e4,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:28.224687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network f0a1d371-2ebf-4348-8c07-25cc745f67e4 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:28.233949 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.240614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:28.241243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.264933 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6c4c53ea-e9c2-4f87-9ba0-b66d5f213197 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.6969385 Dec 10 14:28:28.267813 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56970) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:28.279161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': 'f0a1d371-2ebf-4348-8c07-25cc745f67e4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::2'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:28.292675 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 1de96874-7238-4c53-811e-27d40eacad08 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:28.293044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.301043 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5f0e8813-c6f9-4412-8a8d-7f004fdb01ba None None] For port 3aaee424-7c64-47bc-b5f3-3a90075330d6, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3aaee424-7c64-47bc-b5f3-3a90075330d6,segment=NetworkSegment(385d39c8-e30e-44b5-b2c1-6b64297e3512),segment_id=385d39c8-e30e-44b5-b2c1-6b64297e3512)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:28.370072 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Network': ['ID=143fb8b7-2d52-4eee-965b-c521d13c3de9,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:28.371835 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5f0e8813-c6f9-4412-8a8d-7f004fdb01ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.408358 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6465c69d-64c1-4986-9357-fc9980137b20 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6795061 Dec 10 14:28:28.416425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56972) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:28.433099 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '143fb8b7-2d52-4eee-965b-c521d13c3de9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:fffe'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:28.437388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 143fb8b7-2d52-4eee-965b-c521d13c3de9 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:28.514869 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.529206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 1de96874-7238-4c53-811e-27d40eacad08 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:28.531124 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f0e8813-c6f9-4412-8a8d-7f004fdb01ba None None] Pushing event updated for resources: {'Port': ['ID=3aaee424-7c64-47bc-b5f3-3a90075330d6,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:28.568185 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.9 (7f854959-c3ea-466e-9a61-6fc317909c20/df894c5e-6d1a-4ba8-97d1-6b1e1b299d43/aa294859-4c08-43dc-80b9-8ee995f919b7) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:28.605917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-a2a0e772-3b64-4648-b36a-e9004a90a59a None None] Provisioning complete for port 14609236-db16-43c0-8787-311f743672b1 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:28.606299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a2a0e772-3b64-4648-b36a-e9004a90a59a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.684748 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-a2a0e772-3b64-4648-b36a-e9004a90a59a None None] Port 14609236-db16-43c0-8787-311f743672b1 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:28.685062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:28.694502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.705531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-a2a0e772-3b64-4648-b36a-e9004a90a59a None None] Provisioning complete for port 3aaee424-7c64-47bc-b5f3-3a90075330d6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:28.705917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a2a0e772-3b64-4648-b36a-e9004a90a59a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.746024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3aaee424-7c64-47bc-b5f3-3a90075330d6 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:28.761141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:28.765213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.835183 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56974) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:28.836173 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Performing IP validity checks on allocation pools {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 10 14:28:28.839776 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 10 14:28:28.854831 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f1376392-5420-47b4-bd09-64665e83c7c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.857076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec794645-41d9-4765-8c4f-460685aa12bb None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:28:28.865223 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3aaee424-7c64-47bc-b5f3-3a90075330d6 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:28.865762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:28.953306 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.033918 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec794645-41d9-4765-8c4f-460685aa12bb None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:28:29.057763 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.097990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=1de96874-7238-4c53-811e-27d40eacad08,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:29.104881 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-4d749213-1ac2-4667-900a-a62075a6f725 None None] Provisioning complete for port 14609236-db16-43c0-8787-311f743672b1 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:29.105264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4d749213-1ac2-4667-900a-a62075a6f725 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.108386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.167289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=9a6b2a07-bd8a-489b-aaf2-4a32b7ab8b96,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:29.171744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.185200 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.198774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 7f854959-c3ea-466e-9a61-6fc317909c20 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:29.219760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:29.222417 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:29.274822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.281025 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:29.282458 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.301561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f1376392-5420-47b4-bd09-64665e83c7c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.307486 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-4d749213-1ac2-4667-900a-a62075a6f725 None None] Port 14609236-db16-43c0-8787-311f743672b1 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:29.312141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=64ef917a-0482-4ee3-81df-b5cfdd339e0a,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:29.327109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=aa294859-4c08-43dc-80b9-8ee995f919b7,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:29.334397 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Checking segment: {'id': '2b0bf27c-489b-4be5-a3c5-ce283892edc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '143fb8b7-2d52-4eee-965b-c521d13c3de9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:29.334763 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network hostable DHCP agents. Network: 143fb8b7-2d52-4eee-965b-c521d13c3de9, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:29.374669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f1376392-5420-47b4-bd09-64665e83c7c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.397594 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b4d055a6-a557-4fdd-b724-0eb1341d7b4c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.5671017 Dec 10 14:28:29.401746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56976) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:29.434490 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 143fb8b7-2d52-4eee-965b-c521d13c3de9 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:29.436113 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking segment: {'id': '7e00621e-01fd-46ee-be25-5e6d777b3791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'f0a1d371-2ebf-4348-8c07-25cc745f67e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:29.436472 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network hostable DHCP agents. Network: f0a1d371-2ebf-4348-8c07-25cc745f67e4, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:29.466060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1376392-5420-47b4-bd09-64665e83c7c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=def3ec7c-a222-4edd-85da-956477d8fc50,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:29.497742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba91af78-7e11-4694-a622-f49ab02595dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:29.501925 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ba91af78-7e11-4694-a622-f49ab02595dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.1 HTTP/1.1" status: 200 len: 922 time: 0.0967150 Dec 10 14:28:29.508601 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56978) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:29.509487 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f1376392-5420-47b4-bd09-64665e83c7c5 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=b65ca50009a44242a9fbc737cbf34f10&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6732128 Dec 10 14:28:29.512641 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56980) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:29.549860 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 143fb8b7-2d52-4eee-965b-c521d13c3de9) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:29.560090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:29.560381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.563826 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 18508f49-2944-40b4-a289-d08025865b04 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:28:29.564017 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2002e99-433a-4dbb-9871-b4b41d35f9e4 None None] Network 143fb8b7-2d52-4eee-965b-c521d13c3de9 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:29.633931 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9f87a88-7d70-4666-9ddd-50e0b02553bd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:29.640365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9f87a88-7d70-4666-9ddd-50e0b02553bd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:29.647236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9f87a88-7d70-4666-9ddd-50e0b02553bd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:29.651583 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e9f87a88-7d70-4666-9ddd-50e0b02553bd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0. HTTP/1.1" status: 200 len: 2379 time: 0.1456506 Dec 10 14:28:29.655065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56982) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:29.656268 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network f0a1d371-2ebf-4348-8c07-25cc745f67e4 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:29.670088 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:29.685993 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2cd1b19-f024-4518-8efb-0c79f8655fd6 None None] Sync routers for ids ['18508f49-2944-40b4-a289-d08025865b04'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:29.689536 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0e736091-d88d-42f2-908f-6bc2202d5a61 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/18508f49-2944-40b4-a289-d08025865b04/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3331809 Dec 10 14:28:29.690820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, f0a1d371-2ebf-4348-8c07-25cc745f67e4) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:29.694429 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56984) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:29.701035 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-262074eb-8904-4de4-8e52-a5e59757bddc None None] Network f0a1d371-2ebf-4348-8c07-25cc745f67e4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:29.706986 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2cd1b19-f024-4518-8efb-0c79f8655fd6 None None] Routers {'18508f49-2944-40b4-a289-d08025865b04'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:29.707631 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c2cd1b19-f024-4518-8efb-0c79f8655fd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['18508f49-2944-40b4-a289-d08025865b04'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:29.733654 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:29.734255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.742561 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-75c8ac68-d01f-4454-859f-305aeee33821 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=18508f49-2944-40b4-a289-d08025865b04 HTTP/1.1" status: 200 len: 205 time: 0.0433481 Dec 10 14:28:29.743205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56986) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:29.746549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-143fb8b7-2d52-4eee-965b-c521d13c3de9', 'network_id': '143fb8b7-2d52-4eee-965b-c521d13c3de9', 'project_id': 'cc793beea85f4cf887a3485aad20d8e7', 'fixed_ips': [{'subnet_id': '9a6b2a07-bd8a-489b-aaf2-4a32b7ab8b96'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:29.747717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.748415 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-00774398-a855-480e-a5ee-7c798c7fea33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.3175395 Dec 10 14:28:29.750887 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56988) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:29.777920 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '143fb8b7-2d52-4eee-965b-c521d13c3de9', 'name': 'tempest-PortsIpV6TestJSON-378820603'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:29.790753 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c2cd1b19-f024-4518-8efb-0c79f8655fd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:29.802697 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2cd1b19-f024-4518-8efb-0c79f8655fd6 None None] Routers {'18508f49-2944-40b4-a289-d08025865b04'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:29.809271 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c2cd1b19-f024-4518-8efb-0c79f8655fd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['18508f49-2944-40b4-a289-d08025865b04'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:29.813975 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efbb7e3c-7300-4623-89bf-41aa9f7972de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.837317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e725e45e-9f0e-4043-88ae-5ac1e771ea4b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.857063 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-c2cd1b19-f024-4518-8efb-0c79f8655fd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:29.857742 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2cd1b19-f024-4518-8efb-0c79f8655fd6 None None] The sync data for ids ['18508f49-2944-40b4-a289-d08025865b04'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:29.915770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efbb7e3c-7300-4623-89bf-41aa9f7972de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.962084 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0a8320bd-bb24-4e11-bdf8-d8449bf392ea None None] Provisioning complete for port aa294859-4c08-43dc-80b9-8ee995f919b7 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:29.962761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0a8320bd-bb24-4e11-bdf8-d8449bf392ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.969314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-f0a1d371-2ebf-4348-8c07-25cc745f67e4', 'network_id': 'f0a1d371-2ebf-4348-8c07-25cc745f67e4', 'project_id': '243ec7ec23134148a44eb888e6040f25', 'fixed_ips': [{'subnet_id': '64ef917a-0482-4ee3-81df-b5cfdd339e0a'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:29.970460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:29.990422 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-59e6113a-69d9-477f-8833-ac7cbd0a01c4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 1.7198019 Dec 10 14:28:29.994610 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56990) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:29.999767 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1813621013'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:29.999960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-3ebef082-791e-4195-ac3c-8fd0ede8df24 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port aa294859-4c08-43dc-80b9-8ee995f919b7 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:30.000213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3ebef082-791e-4195-ac3c-8fd0ede8df24 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.035699 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e725e45e-9f0e-4043-88ae-5ac1e771ea4b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.038451 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e725e45e-9f0e-4043-88ae-5ac1e771ea4b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.065534 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0a8320bd-bb24-4e11-bdf8-d8449bf392ea None None] Port aa294859-4c08-43dc-80b9-8ee995f919b7 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:30.098790 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:30.102385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.121279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3ebef082-791e-4195-ac3c-8fd0ede8df24 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.143321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-3ebef082-791e-4195-ac3c-8fd0ede8df24 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for aa294859-4c08-43dc-80b9-8ee995f919b7 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:30.145839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 023740f8-f27c-4d58-baec-69228b66cf3a yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:30.154615 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Allocated IP 2001:db8::2 (143fb8b7-2d52-4eee-965b-c521d13c3de9/9a6b2a07-bd8a-489b-aaf2-4a32b7ab8b96/21d4a152-f4d8-41d2-9217-940bbb3d9232) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:30.196933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efbb7e3c-7300-4623-89bf-41aa9f7972de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.199811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efbb7e3c-7300-4623-89bf-41aa9f7972de admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.204711 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-efbb7e3c-7300-4623-89bf-41aa9f7972de admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/def3ec7c-a222-4edd-85da-956477d8fc50 HTTP/1.1" status: 204 len: 168 time: 0.6873772 Dec 10 14:28:30.256680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Allocated IP 2001:db8::1 (f0a1d371-2ebf-4348-8c07-25cc745f67e4/64ef917a-0482-4ee3-81df-b5cfdd339e0a/2fc19a6e-6795-4b40-8d94-f7339f60807f) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:30.276805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efbb7e3c-7300-4623-89bf-41aa9f7972de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=def3ec7c-a222-4edd-85da-956477d8fc50,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:30.451273 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3ebef082-791e-4195-ac3c-8fd0ede8df24 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.462077 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.479145 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:30.483158 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebef082-791e-4195-ac3c-8fd0ede8df24 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=aa294859-4c08-43dc-80b9-8ee995f919b7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:30.487018 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.491494 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e725e45e-9f0e-4043-88ae-5ac1e771ea4b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.491494 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e725e45e-9f0e-4043-88ae-5ac1e771ea4b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Fanout notify agent at l3_agent the message router_deleted on router 18508f49-2944-40b4-a289-d08025865b04 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:28:30.499039 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e725e45e-9f0e-4043-88ae-5ac1e771ea4b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.500196 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e725e45e-9f0e-4043-88ae-5ac1e771ea4b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/18508f49-2944-40b4-a289-d08025865b04 HTTP/1.1" status: 204 len: 168 time: 0.7560122 Dec 10 14:28:30.510566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 56994) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:30.562903 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.562903 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.563072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 390, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:30.569783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.569783 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment 29f52ff4-0bb3-4e40-af7c-1bec92dd6822 of type vlan for network 1a0038ac-c697-478a-80dd-ac7bd00c9bc7 Dec 10 14:28:30.607712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3ebef082-791e-4195-ac3c-8fd0ede8df24 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.616239 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3ebef082-791e-4195-ac3c-8fd0ede8df24 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/aa294859-4c08-43dc-80b9-8ee995f919b7 HTTP/1.1" status: 204 len: 168 time: 0.9566054 Dec 10 14:28:30.620415 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 56996) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:30.641658 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3aaee424-7c64-47bc-b5f3-3a90075330d6 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:30.647401 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.661033 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-73818fbc-9343-4548-a345-2deef5865878 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:28:30.665015 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-73818fbc-9343-4548-a345-2deef5865878 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/aa294859-4c08-43dc-80b9-8ee995f919b7 HTTP/1.1" status: 404 len: 333 time: 0.0410244 Dec 10 14:28:30.665549 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57000) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:30.667278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Network f0a1d371-2ebf-4348-8c07-25cc745f67e4 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:30.695062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-7bbb20fe-1be8-4393-861b-749395ca9aa7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting subnet 8adbea61-9b0b-429b-8140-84baa0565864 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:30.702600 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bbb20fe-1be8-4393-861b-749395ca9aa7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.715748 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:30.718456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.720895 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:30.762122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Pushing event updated for resources: {'Port': ['ID=2fc19a6e-6795-4b40-8d94-f7339f60807f,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:30.792290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bbb20fe-1be8-4393-861b-749395ca9aa7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.794872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Network 143fb8b7-2d52-4eee-965b-c521d13c3de9 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:30.815827 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::1c1 (143fb8b7-2d52-4eee-965b-c521d13c3de9/9a6b2a07-bd8a-489b-aaf2-4a32b7ab8b96/023740f8-f27c-4d58-baec-69228b66cf3a) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:30.832606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:30.866780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:30.878380 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b113a0a9-2c7e-4418-aec2-0cfeb7c587c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 14609236-db16-43c0-8787-311f743672b1 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:30.878728 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b113a0a9-2c7e-4418-aec2-0cfeb7c587c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.899946 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.914960 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:30.917830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:30.983997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Pushing event updated for resources: {'Port': ['ID=21d4a152-f4d8-41d2-9217-940bbb3d9232,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:31.018446 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.0223856 Dec 10 14:28:31.022544 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bbb20fe-1be8-4393-861b-749395ca9aa7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.022791 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57008) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:31.030073 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Attempting to bind port 21d4a152-f4d8-41d2-9217-940bbb3d9232 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:31.030451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Attempting to bind port 21d4a152-f4d8-41d2-9217-940bbb3d9232 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '2b0bf27c-489b-4be5-a3c5-ce283892edc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '143fb8b7-2d52-4eee-965b-c521d13c3de9'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:31.030852 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Attempting to bind port 21d4a152-f4d8-41d2-9217-940bbb3d9232 on network 143fb8b7-2d52-4eee-965b-c521d13c3de9 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:31.041499 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Attempting to bind port 2fc19a6e-6795-4b40-8d94-f7339f60807f on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:31.041882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Attempting to bind port 2fc19a6e-6795-4b40-8d94-f7339f60807f by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '7e00621e-01fd-46ee-be25-5e6d777b3791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'f0a1d371-2ebf-4348-8c07-25cc745f67e4'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:31.042254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Attempting to bind port 2fc19a6e-6795-4b40-8d94-f7339f60807f on network f0a1d371-2ebf-4348-8c07-25cc745f67e4 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:31.044671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3aaee424-7c64-47bc-b5f3-3a90075330d6 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:31.045088 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.047748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b779dc-1468-42e7-be86-f9787292e7df tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=1a0038ac-c697-478a-80dd-ac7bd00c9bc7,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:31.072239 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:31.072931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Checking segment: {'id': '2b0bf27c-489b-4be5-a3c5-ce283892edc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '143fb8b7-2d52-4eee-965b-c521d13c3de9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:31.073041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.073945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Bound using segment: {'id': '2b0bf27c-489b-4be5-a3c5-ce283892edc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '143fb8b7-2d52-4eee-965b-c521d13c3de9'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:31.073945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Bound port: 21d4a152-f4d8-41d2-9217-940bbb3d9232, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2b0bf27c-489b-4be5-a3c5-ce283892edc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '143fb8b7-2d52-4eee-965b-c521d13c3de9'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:31.074310 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.076591 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 1a0038ac-c697-478a-80dd-ac7bd00c9bc7 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:31.118388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:31.118388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Checking segment: {'id': '7e00621e-01fd-46ee-be25-5e6d777b3791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'f0a1d371-2ebf-4348-8c07-25cc745f67e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:31.118388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.118388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Bound using segment: {'id': '7e00621e-01fd-46ee-be25-5e6d777b3791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'f0a1d371-2ebf-4348-8c07-25cc745f67e4'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:31.118388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Bound port: 2fc19a6e-6795-4b40-8d94-f7339f60807f, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e00621e-01fd-46ee-be25-5e6d777b3791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'f0a1d371-2ebf-4348-8c07-25cc745f67e4'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:31.118388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.168387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.199923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bbb20fe-1be8-4393-861b-749395ca9aa7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.244580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bbb20fe-1be8-4393-861b-749395ca9aa7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Subnet': ['ID=8adbea61-9b0b-429b-8140-84baa0565864,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:31.247715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bbb20fe-1be8-4393-861b-749395ca9aa7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.251575 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7bbb20fe-1be8-4393-861b-749395ca9aa7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/8adbea61-9b0b-429b-8140-84baa0565864 HTTP/1.1" status: 204 len: 168 time: 0.7398722 Dec 10 14:28:31.255838 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57012) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:31.271474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22893c35-f0b9-4fe3-a28a-aa0ff379e5a7 None None] Network 12e9864f-f9dc-4f6f-b342-6729765c75de requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:31.369626 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] For port 21d4a152-f4d8-41d2-9217-940bbb3d9232, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:31.378637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.382123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': '1a0038ac-c697-478a-80dd-ac7bd00c9bc7', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:31.408263 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] For port 2fc19a6e-6795-4b40-8d94-f7339f60807f, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:31.418792 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] For port 21d4a152-f4d8-41d2-9217-940bbb3d9232, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=21d4a152-f4d8-41d2-9217-940bbb3d9232,segment=NetworkSegment(2b0bf27c-489b-4be5-a3c5-ce283892edc7),segment_id=2b0bf27c-489b-4be5-a3c5-ce283892edc7)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:31.432965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] For port 2fc19a6e-6795-4b40-8d94-f7339f60807f, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=2fc19a6e-6795-4b40-8d94-f7339f60807f,segment=NetworkSegment(7e00621e-01fd-46ee-be25-5e6d777b3791),segment_id=7e00621e-01fd-46ee-be25-5e6d777b3791)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:31.452307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b113a0a9-2c7e-4418-aec2-0cfeb7c587c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.467615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:31.467960 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.489047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b113a0a9-2c7e-4418-aec2-0cfeb7c587c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 14609236-db16-43c0-8787-311f743672b1 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:31.500601 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.515056 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.548645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.555803 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port 5bf42dec-0f93-44f4-8bda-bd904ee3d407, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5bf42dec-0f93-44f4-8bda-bd904ee3d407,segment=NetworkSegment(0710b915-b607-4acf-bd3a-be8f764ec316),segment_id=0710b915-b607-4acf-bd3a-be8f764ec316)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:31.556855 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.579977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d758d64-b11b-4df1-954b-5417f8cc5322 None None] DHCP port deletion for 12e9864f-f9dc-4f6f-b342-6729765c75de request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:31.585310 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 5bf42dec-0f93-44f4-8bda-bd904ee3d407 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:31.625515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae564380-53a4-42fa-a76a-3968aac24e7c None None] Pushing event updated for resources: {'Port': ['ID=21d4a152-f4d8-41d2-9217-940bbb3d9232,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:31.660889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:31.666097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.707094 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eb608c7-1853-440c-a3a1-fa463a6ec90e None None] Pushing event updated for resources: {'Port': ['ID=2fc19a6e-6795-4b40-8d94-f7339f60807f,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:31.723108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.726698 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6d758d64-b11b-4df1-954b-5417f8cc5322 None None] Deleting port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:31.727063 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6d758d64-b11b-4df1-954b-5417f8cc5322 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.816886 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-6d758d64-b11b-4df1-954b-5417f8cc5322 None None] For port 5bf42dec-0f93-44f4-8bda-bd904ee3d407, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5bf42dec-0f93-44f4-8bda-bd904ee3d407,segment=NetworkSegment(0710b915-b607-4acf-bd3a-be8f764ec316),segment_id=0710b915-b607-4acf-bd3a-be8f764ec316)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:31.818458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6d758d64-b11b-4df1-954b-5417f8cc5322 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.834642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.836734 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6d758d64-b11b-4df1-954b-5417f8cc5322 None None] Calling delete_port for 5bf42dec-0f93-44f4-8bda-bd904ee3d407 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:31.867310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Performing IP validity checks on allocation pools {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 10 14:28:31.867827 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 10 14:28:31.913882 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 143fb8b7-2d52-4eee-965b-c521d13c3de9 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:31.922581 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=023740f8-f27c-4d58-baec-69228b66cf3a,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:31.928934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=5bf42dec-0f93-44f4-8bda-bd904ee3d407,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:31.948206 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:31.956532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:31.961212 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No DVR routers for this DVR port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:31.969404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6d758d64-b11b-4df1-954b-5417f8cc5322 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:31.972129 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:31.983524 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.040763 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b113a0a9-2c7e-4418-aec2-0cfeb7c587c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.042529 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d758d64-b11b-4df1-954b-5417f8cc5322 None None] No DVR routers for this DVR port 5bf42dec-0f93-44f4-8bda-bd904ee3d407 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:32.048184 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d758d64-b11b-4df1-954b-5417f8cc5322 None None] Pushing event deleted for resources: {'Port': ['ID=5bf42dec-0f93-44f4-8bda-bd904ee3d407,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:32.135718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.135971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b113a0a9-2c7e-4418-aec2-0cfeb7c587c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=14609236-db16-43c0-8787-311f743672b1,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:32.144533 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-70505fad-6bcc-4d9f-8990-3800d797106d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.3846762 Dec 10 14:28:32.151354 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57024) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:32.157025 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['12e9864f-f9dc-4f6f-b342-6729765c75de']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:32.179237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0710b915-b607-4acf-bd3a-be8f764ec316') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:32.179926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0710b915-b607-4acf-bd3a-be8f764ec316') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:32.199193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.242453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.252218 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Releasing vlan 366 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:32.256991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:32.261020 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:32.335178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.414136 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b113a0a9-2c7e-4418-aec2-0cfeb7c587c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.417526 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b113a0a9-2c7e-4418-aec2-0cfeb7c587c9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/14609236-db16-43c0-8787-311f743672b1 HTTP/1.1" status: 204 len: 168 time: 1.7510684 Dec 10 14:28:32.420814 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57028) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:32.426365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=cfbe956c-e8d1-443d-ac97-bc40998a8257,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:32.455707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-1e5e3287-86e1-4924-97e5-d49d40df169d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 023740f8-f27c-4d58-baec-69228b66cf3a {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:32.456156 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1e5e3287-86e1-4924-97e5-d49d40df169d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.467998 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-88600eb4-541f-4c9c-9836-dcfc19d2beab tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:28:32.467998 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-88600eb4-541f-4c9c-9836-dcfc19d2beab tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/14609236-db16-43c0-8787-311f743672b1 HTTP/1.1" status: 404 len: 333 time: 0.0386906 Dec 10 14:28:32.469696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57032) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:32.480447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking segment: {'id': '29f52ff4-0bb3-4e40-af7c-1bec92dd6822', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '1a0038ac-c697-478a-80dd-ac7bd00c9bc7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:32.480735 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network hostable DHCP agents. Network: 1a0038ac-c697-478a-80dd-ac7bd00c9bc7, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:32.504179 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.520562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.527483 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/networks/12e9864f-f9dc-4f6f-b342-6729765c75de HTTP/1.1" status: 204 len: 168 time: 1.2669632 Dec 10 14:28:32.529331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57036) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:32.534247 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f34edfd3-4114-4855-acd0-ce056d6a8ba6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-34013149', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:32.557594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c1ab49e-e745-4848-b111-3dfe53bd77cc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Network': ['ID=12e9864f-f9dc-4f6f-b342-6729765c75de,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:32.591661 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-c9178196-815a-4c78-8dc3-d15791697f07 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet df894c5e-6d1a-4ba8-97d1-6b1e1b299d43 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:32.597382 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9178196-815a-4c78-8dc3-d15791697f07 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.599538 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1e5e3287-86e1-4924-97e5-d49d40df169d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.618728 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-1e5e3287-86e1-4924-97e5-d49d40df169d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 023740f8-f27c-4d58-baec-69228b66cf3a owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:32.654841 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9178196-815a-4c78-8dc3-d15791697f07 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.685563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network 1a0038ac-c697-478a-80dd-ac7bd00c9bc7 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:32.697301 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f34edfd3-4114-4855-acd0-ce056d6a8ba6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.699374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f34edfd3-4114-4855-acd0-ce056d6a8ba6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.700260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 21d4a152-f4d8-41d2-9217-940bbb3d9232 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:32.771451 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9178196-815a-4c78-8dc3-d15791697f07 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.790370 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f34edfd3-4114-4855-acd0-ce056d6a8ba6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.793992 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 1a0038ac-c697-478a-80dd-ac7bd00c9bc7) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:32.801550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:32.802467 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.827562 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb3b8877-e28d-4871-9682-5979579e5a4f None None] Network 1a0038ac-c697-478a-80dd-ac7bd00c9bc7 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:32.885604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f34edfd3-4114-4855-acd0-ce056d6a8ba6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.921811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 21d4a152-f4d8-41d2-9217-940bbb3d9232 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:32.922308 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.953618 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e7212942-da1b-46b2-9ccc-31517ff0d87e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 803 time: 1.5758147 Dec 10 14:28:32.955853 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de0d2e82-4974-4b37-816e-f45dba4c3bd6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:32.956411 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57044) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:33.002442 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5355f274-7077-4a37-b22b-922fb1a6b3e7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-1a0038ac-c697-478a-80dd-ac7bd00c9bc7', 'network_id': '1a0038ac-c697-478a-80dd-ac7bd00c9bc7', 'project_id': '243ec7ec23134148a44eb888e6040f25', 'fixed_ips': [{'subnet_id': 'cfbe956c-e8d1-443d-ac97-bc40998a8257'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:33.003641 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5355f274-7077-4a37-b22b-922fb1a6b3e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.068993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9178196-815a-4c78-8dc3-d15791697f07 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.079237 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.089300 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57046) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:33.109931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9178196-815a-4c78-8dc3-d15791697f07 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=df894c5e-6d1a-4ba8-97d1-6b1e1b299d43,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:33.125069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9178196-815a-4c78-8dc3-d15791697f07 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.133459 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c9178196-815a-4c78-8dc3-d15791697f07 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/df894c5e-6d1a-4ba8-97d1-6b1e1b299d43 HTTP/1.1" status: 204 len: 168 time: 0.6625278 Dec 10 14:28:33.134107 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57050) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:33.138015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f34edfd3-4114-4855-acd0-ce056d6a8ba6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.141723 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f34edfd3-4114-4855-acd0-ce056d6a8ba6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 701 time: 0.6085627 Dec 10 14:28:33.142234 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57052) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:33.143214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1e5e3287-86e1-4924-97e5-d49d40df169d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.180967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1434700895'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:33.227531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e5e3287-86e1-4924-97e5-d49d40df169d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=023740f8-f27c-4d58-baec-69228b66cf3a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:33.257970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.297352 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1e5e3287-86e1-4924-97e5-d49d40df169d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.299881 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ae79b90-764c-4528-bc2e-12ff7638be78 None None] Network 7f854959-c3ea-466e-9a61-6fc317909c20 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:33.302579 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1e5e3287-86e1-4924-97e5-d49d40df169d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/023740f8-f27c-4d58-baec-69228b66cf3a HTTP/1.1" status: 204 len: 168 time: 1.1459901 Dec 10 14:28:33.305275 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57054) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:33.305816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2d6701e2-3d85-49b7-bff3-306209d7b7fe tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Request body: {'router': {'name': 'tempest-pretest-check-990388422'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:33.310690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.325962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38958288-5bb5-46a5-8976-61a1fe7ec229 None None] Network 143fb8b7-2d52-4eee-965b-c521d13c3de9 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:33.362780 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-30647f47-6221-48c8-989d-a9db2f8b73be tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:28:33.363334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-30647f47-6221-48c8-989d-a9db2f8b73be tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:33.366480 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-30647f47-6221-48c8-989d-a9db2f8b73be tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/023740f8-f27c-4d58-baec-69228b66cf3a HTTP/1.1" status: 404 len: 333 time: 0.0597146 Dec 10 14:28:33.369448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57056) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:33.387127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:33.390487 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.407544 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.417548 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-e4e25130-dcbf-47dd-8c46-283f94c6052c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:28:33.419188 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e4e25130-dcbf-47dd-8c46-283f94c6052c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/023740f8-f27c-4d58-baec-69228b66cf3a HTTP/1.1" status: 404 len: 333 time: 0.0447733 Dec 10 14:28:33.424010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57058) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:33.478138 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 3aaee424-7c64-47bc-b5f3-3a90075330d6 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:33.478375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.530861 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-77eac9cc-cf99-4257-857c-454224843688 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet 9a6b2a07-bd8a-489b-aaf2-4a32b7ab8b96 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:33.534744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-77eac9cc-cf99-4257-857c-454224843688 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.541351 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 21d4a152-f4d8-41d2-9217-940bbb3d9232, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=21d4a152-f4d8-41d2-9217-940bbb3d9232,segment=NetworkSegment(2b0bf27c-489b-4be5-a3c5-ce283892edc7),segment_id=2b0bf27c-489b-4be5-a3c5-ce283892edc7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:33.543086 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.576536 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] vlan segment allocate from pool success with {'vlan_id': 362, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:33.586299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d6701e2-3d85-49b7-bff3-306209d7b7fe tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.587548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d6701e2-3d85-49b7-bff3-306209d7b7fe tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.597803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-37d5ce07-0697-4779-9234-9fea640665f3 None None] Provisioning complete for port 21d4a152-f4d8-41d2-9217-940bbb3d9232 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:33.606216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.606581 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-37d5ce07-0697-4779-9234-9fea640665f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.606986 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added segment d736d6f7-8b9d-47f6-8b67-dc23f9e2f057 of type vlan for network 5fd1a66e-713e-4c71-b668-f7e44677057e Dec 10 14:28:33.607761 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] For port 3aaee424-7c64-47bc-b5f3-3a90075330d6, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3aaee424-7c64-47bc-b5f3-3a90075330d6,segment=NetworkSegment(385d39c8-e30e-44b5-b2c1-6b64297e3512),segment_id=385d39c8-e30e-44b5-b2c1-6b64297e3512)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:33.608677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.611967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=cfbe956c-e8d1-443d-ac97-bc40998a8257,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:33.614574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-77eac9cc-cf99-4257-857c-454224843688 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.642947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 3aaee424-7c64-47bc-b5f3-3a90075330d6 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:33.698076 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server [None req-5355f274-7077-4a37-b22b-922fb1a6b3e7 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet cfbe956c-e8d1-443d-ac97-bc40998a8257: This subnet is being modified by another concurrent operation. Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server raise self.value Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server raise self.value Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server raise self.value Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server raise self.value Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 10 14:28:33.742159 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server raise self.value Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server raise self.value Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server raise self.value Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server raise exception Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet cfbe956c-e8d1-443d-ac97-bc40998a8257: This subnet is being modified by another concurrent operation. Dec 10 14:28:33.746407 dv-neutron-821401-2-hyperv neutron-server[103812]: ERROR oslo_messaging.rpc.server Dec 10 14:28:33.749012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.749130 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 2fc19a6e-6795-4b40-8d94-f7339f60807f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:33.752160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.754975 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d6701e2-3d85-49b7-bff3-306209d7b7fe tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.758880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf75fa28-e17f-48dc-af32-0149a2cecfcc None None] Network f0a1d371-2ebf-4348-8c07-25cc745f67e4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:33.765982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1a0038ac-c697-478a-80dd-ac7bd00c9bc7']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:33.778745 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '29f52ff4-0bb3-4e40-af7c-1bec92dd6822') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:33.779197 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '29f52ff4-0bb3-4e40-af7c-1bec92dd6822') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:33.795474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.806245 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-77eac9cc-cf99-4257-857c-454224843688 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.815209 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.822776 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 390 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:33.823900 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.830513 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38a0be8b-c509-4139-a747-941f84e765e0 None None] Network 1a0038ac-c697-478a-80dd-ac7bd00c9bc7 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:33.838195 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:33.850123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d6701e2-3d85-49b7-bff3-306209d7b7fe tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.877762 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.884508 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:33.885334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.944744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2d6701e2-3d85-49b7-bff3-306209d7b7fe tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:33.945876 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2d6701e2-3d85-49b7-bff3-306209d7b7fe tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 728 time: 0.8555355 Dec 10 14:28:33.953926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57060) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:33.961858 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Network': ['ID=5fd1a66e-713e-4c71-b668-f7e44677057e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:33.977106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 5fd1a66e-713e-4c71-b668-f7e44677057e details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:33.990622 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=21d4a152-f4d8-41d2-9217-940bbb3d9232,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:34.045658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-77eac9cc-cf99-4257-857c-454224843688 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.080219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.088265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.109817 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6463faac-b251-4a03-8c6f-4ceda19b312a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.9455004 Dec 10 14:28:34.109817 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-77eac9cc-cf99-4257-857c-454224843688 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.110016 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/1a0038ac-c697-478a-80dd-ac7bd00c9bc7 HTTP/1.1" status: 204 len: 168 time: 1.1355362 Dec 10 14:28:34.110016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.110016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57062) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:34.110281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7350f17d-48be-44dc-ba2e-9cec493eb5d8 None None] DHCP port deletion for 7f854959-c3ea-466e-9a61-6fc317909c20 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:34.110384 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-77eac9cc-cf99-4257-857c-454224843688 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/9a6b2a07-bd8a-489b-aaf2-4a32b7ab8b96 HTTP/1.1" status: 204 len: 168 time: 0.6733325 Dec 10 14:28:34.110384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77eac9cc-cf99-4257-857c-454224843688 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=9a6b2a07-bd8a-489b-aaf2-4a32b7ab8b96,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:34.110384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57064) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:34.111953 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57066) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:34.120364 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1587997878'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:34.131413 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'subnet': {'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:34.144385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b0a557-58a0-42cb-9506-857f07b6a607 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.146932 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7222b8f-b361-43ee-ad9b-13f8cbfa9ae9 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=1a0038ac-c697-478a-80dd-ac7bd00c9bc7,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:34.165162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 2fc19a6e-6795-4b40-8d94-f7339f60807f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:34.165573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.253704 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.267676 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:34.274101 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.282525 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=3aaee424-7c64-47bc-b5f3-3a90075330d6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:34.295154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.330586 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-795e9181-fb76-464e-9379-b8578ac96fd3 None None] Network 143fb8b7-2d52-4eee-965b-c521d13c3de9 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:34.335328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 350, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:34.338216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No DVR routers for this DVR port 3aaee424-7c64-47bc-b5f3-3a90075330d6 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:34.351769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.353170 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment 6892e7fa-8de2-4c17-84bb-94ff3929a25f of type vlan for network 1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e Dec 10 14:28:34.398347 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ff1ce914-8e57-42ab-8105-99b4ad98ded4 None None] Provisioning complete for port 2fc19a6e-6795-4b40-8d94-f7339f60807f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:34.398723 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ff1ce914-8e57-42ab-8105-99b4ad98ded4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.448088 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.451894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 2fc19a6e-6795-4b40-8d94-f7339f60807f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=2fc19a6e-6795-4b40-8d94-f7339f60807f,segment=NetworkSegment(7e00621e-01fd-46ee-be25-5e6d777b3791),segment_id=7e00621e-01fd-46ee-be25-5e6d777b3791)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:34.484602 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 21d4a152-f4d8-41d2-9217-940bbb3d9232 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:34.484939 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.551209 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.568554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.570602 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.577985 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:34.578633 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.604657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] For port 21d4a152-f4d8-41d2-9217-940bbb3d9232, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=21d4a152-f4d8-41d2-9217-940bbb3d9232,segment=NetworkSegment(2b0bf27c-489b-4be5-a3c5-ce283892edc7),segment_id=2b0bf27c-489b-4be5-a3c5-ce283892edc7)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:34.605028 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.609461 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ff1ce914-8e57-42ab-8105-99b4ad98ded4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.612302 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b0a557-58a0-42cb-9506-857f07b6a607 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.615238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7f854959-c3ea-466e-9a61-6fc317909c20']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:34.630556 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b0a557-58a0-42cb-9506-857f07b6a607 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.639116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '385d39c8-e30e-44b5-b2c1-6b64297e3512') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:34.643494 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '385d39c8-e30e-44b5-b2c1-6b64297e3512') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:34.650249 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b21d62f-6887-4e63-b0f7-caba753c5cbd None None] DHCP port deletion for 143fb8b7-2d52-4eee-965b-c521d13c3de9 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:34.655535 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=2fc19a6e-6795-4b40-8d94-f7339f60807f,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:34.656308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.670170 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 21d4a152-f4d8-41d2-9217-940bbb3d9232 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:34.700097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:34.702927 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5bf42dec-0f93-44f4-8bda-bd904ee3d407 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:34.709206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.717539 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Releasing vlan 378 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:34.718085 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:34.721595 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:34.733575 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:34.750876 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 5bf42dec-0f93-44f4-8bda-bd904ee3d407 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:34.751655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5bf42dec-0f93-44f4-8bda-bd904ee3d407 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:34.764699 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:34.768717 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.797441 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-ff1ce914-8e57-42ab-8105-99b4ad98ded4 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:34.797441 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-ff1ce914-8e57-42ab-8105-99b4ad98ded4 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:34.826021 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6b21d62f-6887-4e63-b0f7-caba753c5cbd None None] Deleting port 21d4a152-f4d8-41d2-9217-940bbb3d9232 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:34.826021 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6b21d62f-6887-4e63-b0f7-caba753c5cbd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.833269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b0a557-58a0-42cb-9506-857f07b6a607 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.834421 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55b0a557-58a0-42cb-9506-857f07b6a607 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 53ae7a67-d735-41c7-b360-17666ee61e88 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:28:34.845206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-55b0a557-58a0-42cb-9506-857f07b6a607 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.845206 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-55b0a557-58a0-42cb-9506-857f07b6a607 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "DELETE /v2.0/routers/53ae7a67-d735-41c7-b360-17666ee61e88 HTTP/1.1" status: 204 len: 168 time: 0.8865778 Dec 10 14:28:34.854387 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57068) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:34.856454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-054a9b4c-5229-4a95-b514-436ec5fdd043 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Request body: {'router': {'name': 'tempest-router-602152608', 'distributed': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:34.861095 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3ef6f12f-81fd-4e72-891d-fd51ac22fab5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.7516496 Dec 10 14:28:34.861758 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57070) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:34.868409 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': '1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:34.889569 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.907082 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-6b21d62f-6887-4e63-b0f7-caba753c5cbd None None] For port 21d4a152-f4d8-41d2-9217-940bbb3d9232, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=21d4a152-f4d8-41d2-9217-940bbb3d9232,segment=NetworkSegment(2b0bf27c-489b-4be5-a3c5-ce283892edc7),segment_id=2b0bf27c-489b-4be5-a3c5-ce283892edc7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:34.907768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6b21d62f-6887-4e63-b0f7-caba753c5cbd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.921788 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6b21d62f-6887-4e63-b0f7-caba753c5cbd None None] Calling delete_port for 21d4a152-f4d8-41d2-9217-940bbb3d9232 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:34.938014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.948857 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.955469 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/networks/7f854959-c3ea-466e-9a61-6fc317909c20 HTTP/1.1" status: 204 len: 168 time: 1.8147373 Dec 10 14:28:34.957706 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57072) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:34.963205 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=21d4a152-f4d8-41d2-9217-940bbb3d9232,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:34.973978 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1067869476'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:34.974135 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No DVR routers for this DVR port 21d4a152-f4d8-41d2-9217-940bbb3d9232 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:34.977254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cd6e82f-2baa-4cfb-bed1-08cfe16609cf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Network': ['ID=7f854959-c3ea-466e-9a61-6fc317909c20,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:34.979242 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-054a9b4c-5229-4a95-b514-436ec5fdd043 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:34.980280 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-054a9b4c-5229-4a95-b514-436ec5fdd043 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.008960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6b21d62f-6887-4e63-b0f7-caba753c5cbd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.011354 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 2fc19a6e-6795-4b40-8d94-f7339f60807f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:35.075387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b21d62f-6887-4e63-b0f7-caba753c5cbd None None] Pushing event deleted for resources: {'Port': ['ID=21d4a152-f4d8-41d2-9217-940bbb3d9232,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:35.080594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b21d62f-6887-4e63-b0f7-caba753c5cbd None None] No DVR routers for this DVR port 21d4a152-f4d8-41d2-9217-940bbb3d9232 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:35.084949 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-054a9b4c-5229-4a95-b514-436ec5fdd043 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.110516 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 2fc19a6e-6795-4b40-8d94-f7339f60807f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:35.110960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.113906 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.132972 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1aa68f47-04e8-4f36-9899-90d49ffc366b None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:28:35.144703 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['143fb8b7-2d52-4eee-965b-c521d13c3de9']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:35.156564 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-a794878d-6924-4176-8d28-8953532a5552 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0918028 Dec 10 14:28:35.157876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-054a9b4c-5229-4a95-b514-436ec5fdd043 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.158192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2b0bf27c-489b-4be5-a3c5-ce283892edc7') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:35.158490 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2b0bf27c-489b-4be5-a3c5-ce283892edc7') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:35.169408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.185925 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.189261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:35.195297 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.197834 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.203376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Releasing vlan 363 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:35.203924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:35.207188 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:35.258179 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Subnet': ['ID=a6cd01ad-5324-4b95-8569-d765ef925d22,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:35.298653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] vlan segment allocate from pool success with {'vlan_id': 368, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:35.307611 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-054a9b4c-5229-4a95-b514-436ec5fdd043 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.311708 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-c686d6a0-0b78-43c3-957d-7b57c0dde001 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:35.311708 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-c686d6a0-0b78-43c3-957d-7b57c0dde001 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=37199cbe89a04c3096fd8e1d31a3df63&device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 1099 time: 0.0929174 Dec 10 14:28:35.312282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57074) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:35.312695 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-054a9b4c-5229-4a95-b514-436ec5fdd043 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.4592848 Dec 10 14:28:35.326773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1027beb2-9562-4da2-89a2-b0c327e2d31a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.350218 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.350828 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Added segment 4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf of type vlan for network 8649677f-212a-4a75-9dc5-33839d1249ee Dec 10 14:28:35.397237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Checking segment: {'id': 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 362, 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:35.398544 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network hostable DHCP agents. Network: 5fd1a66e-713e-4c71-b668-f7e44677057e, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:35.400385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1aac5525-1621-46f4-8594-f85216b3bc02 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.435990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.484694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1aa68f47-04e8-4f36-9899-90d49ffc366b None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:28:35.491079 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:35.494407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.497783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 5fd1a66e-713e-4c71-b668-f7e44677057e is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:35.512812 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.539224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3aaee424-7c64-47bc-b5f3-3a90075330d6 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:35.559291 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.576297 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:35.576945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.598651 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.605747 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/networks/143fb8b7-2d52-4eee-965b-c521d13c3de9 HTTP/1.1" status: 204 len: 168 time: 1.4783010 Dec 10 14:28:35.605933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3074fdaf-50b0-4055-b585-c4534147e2a2 None None] Provisioning complete for port 2fc19a6e-6795-4b40-8d94-f7339f60807f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:35.605933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3074fdaf-50b0-4055-b585-c4534147e2a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.605933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 3aaee424-7c64-47bc-b5f3-3a90075330d6 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:35.605933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3aaee424-7c64-47bc-b5f3-3a90075330d6 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:35.605933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 21d4a152-f4d8-41d2-9217-940bbb3d9232 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:35.636047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c3c282f-6e25-4747-b2a6-806c98ec2297 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Network': ['ID=143fb8b7-2d52-4eee-965b-c521d13c3de9,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:35.639641 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57076) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:35.656992 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 21d4a152-f4d8-41d2-9217-940bbb3d9232 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:35.657518 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 21d4a152-f4d8-41d2-9217-940bbb3d9232 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:35.683715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-879748117'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:35.716852 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Network': ['ID=8649677f-212a-4a75-9dc5-33839d1249ee,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:35.719101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 5fd1a66e-713e-4c71-b668-f7e44677057e) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:35.734752 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e43e57f3-9708-4ada-8054-4b3f09212a9f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.7679818 Dec 10 14:28:35.738818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 8649677f-212a-4a75-9dc5-33839d1249ee details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:35.738972 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57078) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:35.744050 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1aac5525-1621-46f4-8594-f85216b3bc02 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.749660 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1aac5525-1621-46f4-8594-f85216b3bc02 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.752368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': '8649677f-212a-4a75-9dc5-33839d1249ee', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:35.760937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:35.761572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.828992 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:35.832950 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.867938 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-1f171bb6-89f4-4da2-8919-1ff795c333ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:35.869685 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-1f171bb6-89f4-4da2-8919-1ff795c333ab service neutron] 10.222.0.39 "GET /v2.0/networks?id=6ba405b9-cdef-4b06-9661-6ad5871b3c6b HTTP/1.1" status: 200 len: 897 time: 0.3896441 Dec 10 14:28:35.890166 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] vlan segment allocate from pool success with {'vlan_id': 385, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:35.897095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3074fdaf-50b0-4055-b585-c4534147e2a2 None None] Could not find standard attr ID for object 21d4a152-f4d8-41d2-9217-940bbb3d9232. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:28:35.918426 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1d12f4bf-a6f5-40c0-b9d8-b1c81289e580 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.7922862 Dec 10 14:28:35.921804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57080) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:35.932052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1aac5525-1621-46f4-8594-f85216b3bc02 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.932592 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1aac5525-1621-46f4-8594-f85216b3bc02 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 03c12bba-7863-44db-b18b-13e69f2e9cfa {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:28:35.948470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1aac5525-1621-46f4-8594-f85216b3bc02 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.953108 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1aac5525-1621-46f4-8594-f85216b3bc02 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "DELETE /v2.0/routers/03c12bba-7863-44db-b18b-13e69f2e9cfa HTTP/1.1" status: 204 len: 168 time: 0.6363952 Dec 10 14:28:35.957962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57082) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:35.964195 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d386945a-9a16-4377-b016-30c83e163f46 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Request body: {'router': {'name': 'tempest-router-1718997032', 'distributed': False, 'admin_state_up': False, 'ha': False, 'project_id': 'a194d3494dc1412da0cf1c7d8d792281'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:35.967627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:35.971115 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Added segment e91a3da6-304e-4c5d-bd17-9cd473957876 of type vlan for network 483ef081-5fa5-4563-9fd7-d71a92f5556e Dec 10 14:28:35.985891 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42a54588-2de3-4f11-badd-21d1d1298273 None None] Network 5fd1a66e-713e-4c71-b668-f7e44677057e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:36.034107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.044138 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-0659fd7a-82f7-4d3f-8c78-5da1a171f9bf service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2648b8af-c0bf-4811-b353-779f2426f8b8 HTTP/1.1" status: 200 len: 1001 time: 0.1663861 Dec 10 14:28:36.079739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:36.083677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.127237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-8388f3f6-c751-41e2-b3cb-8ee9f03e5595 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:36.128732 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-8388f3f6-c751-41e2-b3cb-8ee9f03e5595 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=0f3ba970-7746-4f0a-8fc3-e64be22456c1 HTTP/1.1" status: 200 len: 834 time: 0.0584519 Dec 10 14:28:36.138293 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-5fd1a66e-713e-4c71-b668-f7e44677057e', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:36.139423 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.235357 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.241450 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:36.242801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.247468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-17549dda-860a-4d2c-907a-42560bf3e523 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:36.249394 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-17549dda-860a-4d2c-907a-42560bf3e523 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=6ba405b9-cdef-4b06-9661-6ad5871b3c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1071391 Dec 10 14:28:36.263889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d386945a-9a16-4377-b016-30c83e163f46 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.265592 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d386945a-9a16-4377-b016-30c83e163f46 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.304139 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.340997 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d386945a-9a16-4377-b016-30c83e163f46 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.351716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Allocated IP 2001:db8::2 (5fd1a66e-713e-4c71-b668-f7e44677057e/a6cd01ad-5324-4b95-8569-d765ef925d22/802469f5-fbdb-410b-a9f9-5fd999bc15ad) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:36.414254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d386945a-9a16-4377-b016-30c83e163f46 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.477182 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.8042836 Dec 10 14:28:36.480117 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57086) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:36.486845 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '483ef081-5fa5-4563-9fd7-d71a92f5556e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:36.492979 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9adc944-9aa8-46d9-95c4-8dd2a76191aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Network': ['ID=483ef081-5fa5-4563-9fd7-d71a92f5556e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:36.500684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.587295 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 483ef081-5fa5-4563-9fd7-d71a92f5556e details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:36.610925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.669598 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d386945a-9a16-4377-b016-30c83e163f46 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.673084 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d386945a-9a16-4377-b016-30c83e163f46 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.7111053 Dec 10 14:28:36.676502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57088) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:36.681552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Request body: {'router': {'distributed': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:36.684201 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.689282 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.733623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=435ba331-d384-442f-9256-56d56034dca6,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:36.737613 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-49a5e532-a995-44f5-9676-1420290607ab service neutron] 10.222.0.39 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3912039 Dec 10 14:28:36.752621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.804801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Network 5fd1a66e-713e-4c71-b668-f7e44677057e is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:36.807909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:36.808696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking segment: {'id': '6892e7fa-8de2-4c17-84bb-94ff3929a25f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:36.809617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network hostable DHCP agents. Network: 1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:36.813120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:36.820596 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Pushing event updated for resources: {'Port': ['ID=802469f5-fbdb-410b-a9f9-5fd999bc15ad,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:36.850082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:36.850082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.894672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Attempting to bind port 802469f5-fbdb-410b-a9f9-5fd999bc15ad on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:36.895196 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Attempting to bind port 802469f5-fbdb-410b-a9f9-5fd999bc15ad by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 362, 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:36.896230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Attempting to bind port 802469f5-fbdb-410b-a9f9-5fd999bc15ad on network 5fd1a66e-713e-4c71-b668-f7e44677057e {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:36.902989 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:36.903776 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Checking segment: {'id': 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 362, 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:36.904294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.904810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Bound using segment: {'id': 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 362, 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:36.905404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Bound port: 802469f5-fbdb-410b-a9f9-5fd999bc15ad, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 362, 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:36.905934 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:36.916652 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-8b8a8510-e662-41ee-9320-f4c9d1d8253c req-73393b7c-0470-48b3-b306-6a0205af1833 service neutron] 10.222.0.39 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1705539 Dec 10 14:28:36.927718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network 1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:37.008627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] For port 802469f5-fbdb-410b-a9f9-5fd999bc15ad, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:37.012227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] For port 802469f5-fbdb-410b-a9f9-5fd999bc15ad, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=802469f5-fbdb-410b-a9f9-5fd999bc15ad,segment=NetworkSegment(d736d6f7-8b9d-47f6-8b67-dc23f9e2f057),segment_id=d736d6f7-8b9d-47f6-8b67-dc23f9e2f057)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:37.040183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:37.041975 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=7e848c66-8659-43af-bdae-aaac760b6048,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:37.047540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:37.048149 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.056793 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19eac7a8-b937-4898-ab48-7ac78cbd3f28 None None] Network 1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:37.100971 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Checking segment: {'id': '4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '8649677f-212a-4a75-9dc5-33839d1249ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:37.101264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network hostable DHCP agents. Network: 8649677f-212a-4a75-9dc5-33839d1249ee, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:37.105794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.129000 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0d486c1b-6d32-45d8-a3e4-0bcd282f001f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 904 time: 2.2654440 Dec 10 14:28:37.131662 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57092) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:37.195385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb19e4dd-c8f7-4722-9614-b84e83c49d62 None None] Pushing event updated for resources: {'Port': ['ID=802469f5-fbdb-410b-a9f9-5fd999bc15ad,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:37.197076 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.203012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 2001:db8::1 (5fd1a66e-713e-4c71-b668-f7e44677057e/a6cd01ad-5324-4b95-8569-d765ef925d22/8c0ec7f3-de0e-4f34-a74d-075932c3f070) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:37.248078 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e', 'network_id': '1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e', 'project_id': '243ec7ec23134148a44eb888e6040f25', 'fixed_ips': [{'subnet_id': '435ba331-d384-442f-9256-56d56034dca6'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:37.248957 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.296555 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 8649677f-212a-4a75-9dc5-33839d1249ee is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:37.309989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=4f60e9bd-51f1-4469-8f5c-d41331250e0c,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:37.313635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Checking segment: {'id': 'e91a3da6-304e-4c5d-bd17-9cd473957876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '483ef081-5fa5-4563-9fd7-d71a92f5556e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:37.314003 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network hostable DHCP agents. Network: 483ef081-5fa5-4563-9fd7-d71a92f5556e, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:37.315017 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.315467 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.317058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 8649677f-212a-4a75-9dc5-33839d1249ee) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:37.321559 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.323074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:37.323791 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.358669 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf3cd605-25d7-4ff0-88e5-daca5dc129f9 None None] Network 8649677f-212a-4a75-9dc5-33839d1249ee requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:37.420280 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.486709 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Get a provider driver handle based on the ha flag: False and distributed flag: True {{(pid=103811) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:160}} Dec 10 14:28:37.487204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Router 1ad48536-9203-4ec4-8e17-92141229c993 migrating from provider to provider. {{(pid=103811) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:167}} Dec 10 14:28:37.487686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.505033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.519650 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a978d307-9e55-4271-b678-55c5bf015269 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7769382 Dec 10 14:28:37.521111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57094) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:37.527875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-67c440d3-c88d-42e3-812b-7830d43e1cd2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'router': {'name': 'tempest-PortsTestJSON-router-1321579317', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:37.555721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 483ef081-5fa5-4563-9fd7-d71a92f5556e is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:37.574983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.584778 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Allocated IP 2001:db8::1 (1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e/435ba331-d384-442f-9256-56d56034dca6/f2bfa2ef-356d-4a86-854a-1e6a53f6fccf) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:37.585177 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.593326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-8649677f-212a-4a75-9dc5-33839d1249ee', 'network_id': '8649677f-212a-4a75-9dc5-33839d1249ee', 'project_id': '7a25938276dc428b9a5723e37d120269', 'fixed_ips': [{'subnet_id': '7e848c66-8659-43af-bdae-aaac760b6048'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:37.594218 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.667815 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 483ef081-5fa5-4563-9fd7-d71a92f5556e) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:37.671873 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:37.672476 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.691925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-67c440d3-c88d-42e3-812b-7830d43e1cd2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.693004 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-67c440d3-c88d-42e3-812b-7830d43e1cd2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.712047 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.scheduler.l3_agent_scheduler [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] No L3 agents can host the router 1ad48536-9203-4ec4-8e17-92141229c993 Dec 10 14:28:37.750622 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fde5a9a0-25be-4ca7-8f4b-ee7d22026ee4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2694476 Dec 10 14:28:37.753237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57096) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:37.759373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '483ef081-5fa5-4563-9fd7-d71a92f5556e', 'security_groups': [], 'name': 'tempest-PortsIpV6TestJSON-2065125640'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:37.778494 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-67c440d3-c88d-42e3-812b-7830d43e1cd2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.819825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.835196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-67c440d3-c88d-42e3-812b-7830d43e1cd2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.858525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b8388dc-cf63-46dd-aa6b-7f6ca2bee6ae None None] Network 483ef081-5fa5-4563-9fd7-d71a92f5556e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:37.864722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.902562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 5fd1a66e-713e-4c71-b668-f7e44677057e is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:37.913844 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:37.918021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:37.918581 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:37.984381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:38.000339 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.032035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 61fdf749-3e11-46fd-adf7-d59fdab5fb9f yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:38.038735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Hosts for router 1ad48536-9203-4ec4-8e17-92141229c993: [] {{(pid=103811) _get_dvr_hosts_for_router /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:328}} Dec 10 14:28:38.040726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=8c0ec7f3-de0e-4f34-a74d-075932c3f070,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:38.108176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-67c440d3-c88d-42e3-812b-7830d43e1cd2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.109613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Allocated IP 172.20.0.2 (8649677f-212a-4a75-9dc5-33839d1249ee/7e848c66-8659-43af-bdae-aaac760b6048/043b68f6-ae4c-4e2a-9e27-48a3de36ff0b) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:38.112682 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-67c440d3-c88d-42e3-812b-7830d43e1cd2 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 702 time: 0.5911653 Dec 10 14:28:38.119811 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57102) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:38.125936 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'network_id': '8649677f-212a-4a75-9dc5-33839d1249ee', 'name': 'tempest-PortsTestJSON-830750482'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:38.129192 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-483ef081-5fa5-4563-9fd7-d71a92f5556e', 'network_id': '483ef081-5fa5-4563-9fd7-d71a92f5556e', 'project_id': 'cc793beea85f4cf887a3485aad20d8e7', 'fixed_ips': [{'subnet_id': '4f60e9bd-51f1-4469-8f5c-d41331250e0c'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:38.130664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.143956 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Hosts for other DVR routers connected to router 1ad48536-9203-4ec4-8e17-92141229c993: set() {{(pid=103811) _get_other_dvr_hosts /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:345}} Dec 10 14:28:38.147546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.148797 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8d6bd1eb-313e-49de-80f3-06df50f533f3 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "PUT /v2.0/routers/1ad48536-9203-4ec4-8e17-92141229c993 HTTP/1.1" status: 200 len: 717 time: 1.4712806 Dec 10 14:28:38.153677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57104) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:38.182157 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.294679 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.352873 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-70c0bff2-4fe7-48b2-be7a-43ba9f393253 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "GET /v2.0/routers/1ad48536-9203-4ec4-8e17-92141229c993 HTTP/1.1" status: 200 len: 717 time: 0.1665921 Dec 10 14:28:38.357057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57106) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:38.369136 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Network 1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:38.374890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Pushing event updated for resources: {'Port': ['ID=f2bfa2ef-356d-4a86-854a-1e6a53f6fccf,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:38.378043 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:38.383573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:38.437251 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.508533 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Attempting to bind port f2bfa2ef-356d-4a86-854a-1e6a53f6fccf on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:38.508902 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Attempting to bind port f2bfa2ef-356d-4a86-854a-1e6a53f6fccf by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6892e7fa-8de2-4c17-84bb-94ff3929a25f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:38.509283 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Attempting to bind port f2bfa2ef-356d-4a86-854a-1e6a53f6fccf on network 1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:38.532611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d4d5ed8-4e6e-47a8-8716-21c946fc5979 None None] Network 5fd1a66e-713e-4c71-b668-f7e44677057e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:38.577756 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:38.578164 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Checking segment: {'id': '6892e7fa-8de2-4c17-84bb-94ff3929a25f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:38.578539 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.578928 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Bound using segment: {'id': '6892e7fa-8de2-4c17-84bb-94ff3929a25f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:38.579418 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Bound port: f2bfa2ef-356d-4a86-854a-1e6a53f6fccf, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6892e7fa-8de2-4c17-84bb-94ff3929a25f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:38.579797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.586106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:38.589534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.620962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.624664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Allocated IP 2001:db8::2 (483ef081-5fa5-4563-9fd7-d71a92f5556e/4f60e9bd-51f1-4469-8f5c-d41331250e0c/f2f27663-2ca5-4f89-8291-987dd3c300d5) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:38.653334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=435ba331-d384-442f-9256-56d56034dca6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:38.681673 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7a5a2eea-3807-4304-9b12-f6df3fdfb051 tempest-RoutersTestDVR-1850710704 tempest-RoutersTestDVR-1850710704-project] 10.222.0.57 "GET /v2.0/routers/1ad48536-9203-4ec4-8e17-92141229c993 HTTP/1.1" status: 200 len: 683 time: 0.3233769 Dec 10 14:28:38.683064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port 3959e9c2-3e57-492f-8f22-4b5cc5145158 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:38.689265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57110) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:38.697722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.701920 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-82c593bb-46f7-4ebd-b2b4-44be8b02c809 None None] Provisioning complete for port 802469f5-fbdb-410b-a9f9-5fd999bc15ad triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:38.702342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-82c593bb-46f7-4ebd-b2b4-44be8b02c809 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.739967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.763367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:38.773717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6892e7fa-8de2-4c17-84bb-94ff3929a25f') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:38.774014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6892e7fa-8de2-4c17-84bb-94ff3929a25f') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:38.787328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.799449 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.801697 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.811577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 350 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:38.811994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:38.816308 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:38.861800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83e20cb8-35b6-4f8e-81b5-f68dbc155e0f tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.883536 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] For port f2bfa2ef-356d-4a86-854a-1e6a53f6fccf, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:38.893344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:38.914414 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Network 8649677f-212a-4a75-9dc5-33839d1249ee is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:38.928230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:38.936598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Pushing event updated for resources: {'Port': ['ID=043b68f6-ae4c-4e2a-9e27-48a3de36ff0b,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:38.938904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:39.032080 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 802469f5-fbdb-410b-a9f9-5fd999bc15ad up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:39.039310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:28:39.039310 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:28:39.039310 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': '1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e'}] Dec 10 14:28:39.039310 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:39.039784 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:39.083961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.11 (8649677f-212a-4a75-9dc5-33839d1249ee/7e848c66-8659-43af-bdae-aaac760b6048/3959e9c2-3e57-492f-8f22-4b5cc5145158) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:39.084680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] For port f2bfa2ef-356d-4a86-854a-1e6a53f6fccf, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f2bfa2ef-356d-4a86-854a-1e6a53f6fccf,segment=NetworkSegment(6892e7fa-8de2-4c17-84bb-94ff3929a25f),segment_id=6892e7fa-8de2-4c17-84bb-94ff3929a25f)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:39.123304 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Attempting to bind port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:39.124016 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Attempting to bind port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '8649677f-212a-4a75-9dc5-33839d1249ee'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:39.124016 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Attempting to bind port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b on network 8649677f-212a-4a75-9dc5-33839d1249ee {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:39.131538 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-82c593bb-46f7-4ebd-b2b4-44be8b02c809 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.136286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.148650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:39.151503 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Checking segment: {'id': '4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '8649677f-212a-4a75-9dc5-33839d1249ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:39.151503 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.151503 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Bound using segment: {'id': '4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '8649677f-212a-4a75-9dc5-33839d1249ee'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:39.151503 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Bound port: 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '8649677f-212a-4a75-9dc5-33839d1249ee'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:39.151503 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.157294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.228068 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.248537 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-82c593bb-46f7-4ebd-b2b4-44be8b02c809 None None] For port 802469f5-fbdb-410b-a9f9-5fd999bc15ad, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=802469f5-fbdb-410b-a9f9-5fd999bc15ad,segment=NetworkSegment(d736d6f7-8b9d-47f6-8b67-dc23f9e2f057),segment_id=d736d6f7-8b9d-47f6-8b67-dc23f9e2f057)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:39.311293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::1a4 (483ef081-5fa5-4563-9fd7-d71a92f5556e/4f60e9bd-51f1-4469-8f5c-d41331250e0c/61fdf749-3e11-46fd-adf7-d59fdab5fb9f) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:39.314047 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-82c593bb-46f7-4ebd-b2b4-44be8b02c809 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.344573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Network 483ef081-5fa5-4563-9fd7-d71a92f5556e is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:39.345364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e5d2832-4db6-4569-969a-3097fc08f72c None None] Pushing event updated for resources: {'Port': ['ID=f2bfa2ef-356d-4a86-854a-1e6a53f6fccf,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:39.360993 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:39.362963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 802469f5-fbdb-410b-a9f9-5fd999bc15ad triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:39.363410 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.365999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:39.429237 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e481aa29-ac8d-492e-82ef-10d088b9f1d3 None None] Network 1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:39.460335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] For port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:39.476017 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83e20cb8-35b6-4f8e-81b5-f68dbc155e0f tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.487097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83e20cb8-35b6-4f8e-81b5-f68dbc155e0f tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.519417 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.534945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] For port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=043b68f6-ae4c-4e2a-9e27-48a3de36ff0b,segment=NetworkSegment(4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf),segment_id=4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:39.542060 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.556207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Pushing event updated for resources: {'Port': ['ID=f2f27663-2ca5-4f89-8291-987dd3c300d5,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:39.586954 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.596242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-66df5101-3be1-4a7f-8626-a5a23fa82d9a None None] Provisioning complete for port 802469f5-fbdb-410b-a9f9-5fd999bc15ad triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:39.596242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-66df5101-3be1-4a7f-8626-a5a23fa82d9a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.625183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting port f2bfa2ef-356d-4a86-854a-1e6a53f6fccf {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:39.625183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.626963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.642595 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83e20cb8-35b6-4f8e-81b5-f68dbc155e0f tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.648141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83e20cb8-35b6-4f8e-81b5-f68dbc155e0f tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 1ad48536-9203-4ec4-8e17-92141229c993 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:28:39.650139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Attempting to bind port f2f27663-2ca5-4f89-8291-987dd3c300d5 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:39.650139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Attempting to bind port f2f27663-2ca5-4f89-8291-987dd3c300d5 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'e91a3da6-304e-4c5d-bd17-9cd473957876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '483ef081-5fa5-4563-9fd7-d71a92f5556e'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:39.650139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Attempting to bind port f2f27663-2ca5-4f89-8291-987dd3c300d5 on network 483ef081-5fa5-4563-9fd7-d71a92f5556e {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:39.650435 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-83e20cb8-35b6-4f8e-81b5-f68dbc155e0f tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.650708 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-83e20cb8-35b6-4f8e-81b5-f68dbc155e0f tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "DELETE /v2.0/routers/1ad48536-9203-4ec4-8e17-92141229c993 HTTP/1.1" status: 204 len: 168 time: 0.9594746 Dec 10 14:28:39.655827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57114) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:39.667051 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e54a716b-e730-4bc8-9273-af7a89413102 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Request body: {'router': {'name': 'tempest-router-1371501619', 'distributed': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:39.675933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.676839 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.681561 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.741299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 483ef081-5fa5-4563-9fd7-d71a92f5556e is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:39.751233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:39.754535 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] For port f2bfa2ef-356d-4a86-854a-1e6a53f6fccf, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f2bfa2ef-356d-4a86-854a-1e6a53f6fccf,segment=NetworkSegment(6892e7fa-8de2-4c17-84bb-94ff3929a25f),segment_id=6892e7fa-8de2-4c17-84bb-94ff3929a25f)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:39.754942 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.764563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:39.770383 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:39.772110 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.782704 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Calling delete_port for f2bfa2ef-356d-4a86-854a-1e6a53f6fccf owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:39.795631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=61fdf749-3e11-46fd-adf7-d59fdab5fb9f,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:39.817078 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e54a716b-e730-4bc8-9273-af7a89413102 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.818762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e54a716b-e730-4bc8-9273-af7a89413102 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.827935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=8c0ec7f3-de0e-4f34-a74d-075932c3f070,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:39.837068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.857052 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:39.857971 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Checking segment: {'id': 'e91a3da6-304e-4c5d-bd17-9cd473957876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '483ef081-5fa5-4563-9fd7-d71a92f5556e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:39.858521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.859063 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Bound using segment: {'id': 'e91a3da6-304e-4c5d-bd17-9cd473957876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '483ef081-5fa5-4563-9fd7-d71a92f5556e'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:39.859708 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Bound port: f2f27663-2ca5-4f89-8291-987dd3c300d5, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e91a3da6-304e-4c5d-bd17-9cd473957876', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '483ef081-5fa5-4563-9fd7-d71a92f5556e'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:39.860244 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.922070 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-026f71c1-7093-471c-afd0-4907657a1b3d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 893 time: 2.1675546 Dec 10 14:28:39.924128 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c593bb-46f7-4ebd-b2b4-44be8b02c809 None None] Pushing event updated for resources: {'Port': ['ID=802469f5-fbdb-410b-a9f9-5fd999bc15ad,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:39.924706 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57116) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:39.938669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e54a716b-e730-4bc8-9273-af7a89413102 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.950162 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:39.965981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 5fd1a66e-713e-4c71-b668-f7e44677057e is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:39.967629 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:40.025218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Port': ['ID=f2bfa2ef-356d-4a86-854a-1e6a53f6fccf,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:40.025609 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e54a716b-e730-4bc8-9273-af7a89413102 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.033325 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No DVR routers for this DVR port f2bfa2ef-356d-4a86-854a-1e6a53f6fccf on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:40.073947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edebcd7b-2e9d-4600-9b1d-b22c44e0954a None None] Pushing event updated for resources: {'Port': ['ID=043b68f6-ae4c-4e2a-9e27-48a3de36ff0b,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:40.078408 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.085000 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] For port f2f27663-2ca5-4f89-8291-987dd3c300d5, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:40.106466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] For port f2f27663-2ca5-4f89-8291-987dd3c300d5, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f2f27663-2ca5-4f89-8291-987dd3c300d5,segment=NetworkSegment(e91a3da6-304e-4c5d-bd17-9cd473957876),segment_id=e91a3da6-304e-4c5d-bd17-9cd473957876)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:40.119106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-66df5101-3be1-4a7f-8626-a5a23fa82d9a None None] Provisioning complete for port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:40.120462 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-66df5101-3be1-4a7f-8626-a5a23fa82d9a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.154314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 8649677f-212a-4a75-9dc5-33839d1249ee is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:40.157235 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-66df5101-3be1-4a7f-8626-a5a23fa82d9a None None] Port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:40.158734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.178318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e54a716b-e730-4bc8-9273-af7a89413102 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.182653 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e54a716b-e730-4bc8-9273-af7a89413102 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.5256824 Dec 10 14:28:40.183719 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.184352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:40.187816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57118) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:40.188005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:40.226876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=3959e9c2-3e57-492f-8f22-4b5cc5145158,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:40.232840 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:40.267162 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:40.268040 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.294380 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6892e7fa-8de2-4c17-84bb-94ff3929a25f') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:40.294672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6892e7fa-8de2-4c17-84bb-94ff3929a25f') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:40.323761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fec7ce2d-3771-431a-9bed-096b8ee3d2ae None None] Pushing event updated for resources: {'Port': ['ID=f2f27663-2ca5-4f89-8291-987dd3c300d5,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:40.355341 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-050d3115-2a9a-476b-920b-adae1bcfbde1 None None] Provisioning complete for port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:40.355700 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-050d3115-2a9a-476b-920b-adae1bcfbde1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.361119 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.378825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.388037 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:28:40.404133 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-050d3115-2a9a-476b-920b-adae1bcfbde1 None None] Port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:40.407493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 350 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:40.407922 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:40.413016 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:40.416785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20a5b252-9847-4961-b61c-4b2c6adb2985 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.440473 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b8ceb08e-9ce2-4724-9fa5-c5e389568726 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 61fdf749-3e11-46fd-adf7-d59fdab5fb9f {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:40.440823 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b8ceb08e-9ce2-4724-9fa5-c5e389568726 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.478336 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8af569eb-e347-4a0e-9559-abcd6678f345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.3548431 Dec 10 14:28:40.482093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57120) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:40.531196 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c9df8476-4d9c-4340-8825-505a1273a29c None None] Provisioning complete for port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:40.531196 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c9df8476-4d9c-4340-8825-505a1273a29c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.573312 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c9df8476-4d9c-4340-8825-505a1273a29c None None] Port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:40.672641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:40.691917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:40.711358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:40.714433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:40.719668 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b8ceb08e-9ce2-4724-9fa5-c5e389568726 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.720345 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-92dc62f4-e1a6-4eec-b86c-0f04f8d92fd6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7933741 Dec 10 14:28:40.720345 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57124) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:40.724511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1180386823'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:40.789287 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.795402 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-b8ceb08e-9ce2-4724-9fa5-c5e389568726 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 61fdf749-3e11-46fd-adf7-d59fdab5fb9f owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:40.832648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.834595 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:40.835949 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e HTTP/1.1" status: 204 len: 168 time: 3.7031498 Dec 10 14:28:40.841914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57126) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:40.844701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20a5b252-9847-4961-b61c-4b2c6adb2985 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.862799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20a5b252-9847-4961-b61c-4b2c6adb2985 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:40.874971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fdb98ca-8269-481a-ac9b-5d8f012a1e3d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:40.913471 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1212116316'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:41.019103 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:41.023258 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.065098 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.082793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20a5b252-9847-4961-b61c-4b2c6adb2985 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.084143 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20a5b252-9847-4961-b61c-4b2c6adb2985 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 9303feb6-e232-4476-a611-97206dcbc614 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:28:41.106823 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-20a5b252-9847-4961-b61c-4b2c6adb2985 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.108278 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-20a5b252-9847-4961-b61c-4b2c6adb2985 tempest-RoutersTestDVR-1349956743 tempest-RoutersTestDVR-1349956743-project-admin] 10.222.0.57 "DELETE /v2.0/routers/9303feb6-e232-4476-a611-97206dcbc614 HTTP/1.1" status: 204 len: 168 time: 0.9099946 Dec 10 14:28:41.156563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f2f27663-2ca5-4f89-8291-987dd3c300d5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:41.186675 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:41.195028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.234779 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b8ceb08e-9ce2-4724-9fa5-c5e389568726 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.248434 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port f2f27663-2ca5-4f89-8291-987dd3c300d5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:41.248434 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.250146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:28:38Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:38Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:41.269353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] vlan segment allocate from pool success with {'vlan_id': 371, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:41.306362 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 373, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:41.317200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:28:41.318390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Updating router 84410bb0-960a-4ef0-a5c1-72cde49aba0f port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:28:41.345331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8ceb08e-9ce2-4724-9fa5-c5e389568726 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=61fdf749-3e11-46fd-adf7-d59fdab5fb9f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:41.354995 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.359983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.360392 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added segment c6598b53-1d26-477e-bd07-4d2d83dec5b6 of type vlan for network c23cb4a7-305b-44c0-859c-d250baf023e6 Dec 10 14:28:41.393113 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b8ceb08e-9ce2-4724-9fa5-c5e389568726 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.401959 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b8ceb08e-9ce2-4724-9fa5-c5e389568726 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/61fdf749-3e11-46fd-adf7-d59fdab5fb9f HTTP/1.1" status: 204 len: 168 time: 1.4761283 Dec 10 14:28:41.402623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57130) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:41.404728 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.405075 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment 28a3d4d0-02b4-4e6f-b727-8ac0718b9918 of type vlan for network 60caf174-b8c2-4cad-a2ec-484ecd98e9cd Dec 10 14:28:41.469974 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-165493ff-dc40-435c-9343-0077fb3dd312 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:28:41.471833 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-165493ff-dc40-435c-9343-0077fb3dd312 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/61fdf749-3e11-46fd-adf7-d59fdab5fb9f HTTP/1.1" status: 404 len: 333 time: 0.0681875 Dec 10 14:28:41.475223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57132) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:41.479807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.491263 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.497800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.558586 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-986fc1f9-dbb2-4449-ac2a-b92c0d3da9fb None None] Network 8649677f-212a-4a75-9dc5-33839d1249ee requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:41.563022 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port f2f27663-2ca5-4f89-8291-987dd3c300d5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f2f27663-2ca5-4f89-8291-987dd3c300d5,segment=NetworkSegment(e91a3da6-304e-4c5d-bd17-9cd473957876),segment_id=e91a3da6-304e-4c5d-bd17-9cd473957876)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:41.567769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-314af30f-71c4-4c59-b4ce-1f8b25762f59 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet 4f60e9bd-51f1-4469-8f5c-d41331250e0c {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:41.575821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-314af30f-71c4-4c59-b4ce-1f8b25762f59 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.606308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.610139 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.617787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:41.618768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.644830 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.653056 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:41.653916 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.663407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-314af30f-71c4-4c59-b4ce-1f8b25762f59 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.701291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.702468 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:41.702606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.743025 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57136) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:41.769066 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 1.0470037 Dec 10 14:28:41.769775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57140) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:41.788239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e5e9a3-bcb7-4d65-a697-a5b1e37858c3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Network': ['ID=c23cb4a7-305b-44c0-859c-d250baf023e6,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:41.789867 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-314af30f-71c4-4c59-b4ce-1f8b25762f59 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.807665 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'subnet': {'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:41.839802 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=3959e9c2-3e57-492f-8f22-4b5cc5145158,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:41.840616 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network c23cb4a7-305b-44c0-859c-d250baf023e6 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:41.861687 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.0179319 Dec 10 14:28:41.864269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57142) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:41.870667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': '60caf174-b8c2-4cad-a2ec-484ecd98e9cd', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:41.942606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d4eee2e-08d5-44ec-a7ca-80bc3605cec1 None None] Network 483ef081-5fa5-4563-9fd7-d71a92f5556e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:41.945249 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d0bcdd2d-3a6f-4857-9a85-ecf5e1eb725a None None] Provisioning complete for port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:41.945732 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d0bcdd2d-3a6f-4857-9a85-ecf5e1eb725a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:41.966197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1fdaee80-6182-4adf-a7e9-7383dd9b45ca admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.053742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-314af30f-71c4-4c59-b4ce-1f8b25762f59 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.064513 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3479b8-5fd9-409c-b242-4b9120eafc10 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=60caf174-b8c2-4cad-a2ec-484ecd98e9cd,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:42.078864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=f2f27663-2ca5-4f89-8291-987dd3c300d5,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:42.095314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 60caf174-b8c2-4cad-a2ec-484ecd98e9cd details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:42.102465 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:42.107999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.115199 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314af30f-71c4-4c59-b4ce-1f8b25762f59 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=4f60e9bd-51f1-4469-8f5c-d41331250e0c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:42.117811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-314af30f-71c4-4c59-b4ce-1f8b25762f59 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.123265 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-314af30f-71c4-4c59-b4ce-1f8b25762f59 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/4f60e9bd-51f1-4469-8f5c-d41331250e0c HTTP/1.1" status: 204 len: 168 time: 0.6445022 Dec 10 14:28:42.124491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57144) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:42.251863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:42.257076 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.259940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.336522 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.359671 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1fdaee80-6182-4adf-a7e9-7383dd9b45ca admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.437991 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1fdaee80-6182-4adf-a7e9-7383dd9b45ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.439071 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:42.439610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.500692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.508935 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1fdaee80-6182-4adf-a7e9-7383dd9b45ca admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=a194d3494dc1412da0cf1c7d8d792281&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7645140 Dec 10 14:28:42.509675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdaee80-6182-4adf-a7e9-7383dd9b45ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d15ce9d-9a6c-46d7-addc-35f1cb0f1c35,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:42.514437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57146) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:42.566561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d0bcdd2d-3a6f-4857-9a85-ecf5e1eb725a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.603377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.634710 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port f2f27663-2ca5-4f89-8291-987dd3c300d5 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:42.635152 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.643795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.652785 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d0bcdd2d-3a6f-4857-9a85-ecf5e1eb725a None None] For port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=043b68f6-ae4c-4e2a-9e27-48a3de36ff0b,segment=NetworkSegment(4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf),segment_id=4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:42.684571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.696977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.725269 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d0bcdd2d-3a6f-4857-9a85-ecf5e1eb725a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.728770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.740809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034797b7-9d5c-4609-8901-0ef18a30f295 None None] Pushing event updated for resources: {'Port': ['ID=8c0ec7f3-de0e-4f34-a74d-075932c3f070,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:42.757175 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ef083994-bf8e-414e-9d5c-8cd9aa254dd5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.826300 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] For port f2f27663-2ca5-4f89-8291-987dd3c300d5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f2f27663-2ca5-4f89-8291-987dd3c300d5,segment=NetworkSegment(e91a3da6-304e-4c5d-bd17-9cd473957876),segment_id=e91a3da6-304e-4c5d-bd17-9cd473957876)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:42.826568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.874556 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:28:42.884174 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for f2f27663-2ca5-4f89-8291-987dd3c300d5 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:42.916461 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Attempting to bind port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:42.916869 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Attempting to bind port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 362, 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:42.917236 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Attempting to bind port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 on network 5fd1a66e-713e-4c71-b668-f7e44677057e {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:42.932556 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Subnet': ['ID=d0bc12cf-44cd-4620-98df-8ce2c544d13c,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:42.936781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0bcdd2d-3a6f-4857-9a85-ecf5e1eb725a None None] Pushing event updated for resources: {'Port': ['ID=043b68f6-ae4c-4e2a-9e27-48a3de36ff0b,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:42.939751 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:42.940300 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:42.943759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:42.949154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Checking segment: {'id': 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 362, 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:42.949640 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.950054 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Bound using segment: {'id': 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 362, 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:42.950566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Bound port: 8c0ec7f3-de0e-4f34-a74d-075932c3f070, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 362, 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:42.950960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.970558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2fb108bc-14c2-44f0-9276-6a70ad2e5459 None None] Provisioning complete for port f2f27663-2ca5-4f89-8291-987dd3c300d5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:42.974562 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2fb108bc-14c2-44f0-9276-6a70ad2e5459 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:42.976845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Checking segment: {'id': 'c6598b53-1d26-477e-bd07-4d2d83dec5b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:42.977290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network hostable DHCP agents. Network: c23cb4a7-305b-44c0-859c-d250baf023e6, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:43.093158 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network c23cb4a7-305b-44c0-859c-d250baf023e6 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:43.100912 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ef083994-bf8e-414e-9d5c-8cd9aa254dd5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.111790 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b18ead45-36e3-42da-a068-cb3f081e9945 None None] Network 483ef081-5fa5-4563-9fd7-d71a92f5556e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:43.116336 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] For port 8c0ec7f3-de0e-4f34-a74d-075932c3f070, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:43.120069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.134687 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking segment: {'id': '28a3d4d0-02b4-4e6f-b727-8ac0718b9918', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '60caf174-b8c2-4cad-a2ec-484ecd98e9cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:43.135057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network hostable DHCP agents. Network: 60caf174-b8c2-4cad-a2ec-484ecd98e9cd, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:43.137450 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=0608725b-fb13-4634-b952-c24d9cd07a16,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:43.169030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, c23cb4a7-305b-44c0-859c-d250baf023e6) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:43.169596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.173879 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:43.178839 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.184159 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] For port 8c0ec7f3-de0e-4f34-a74d-075932c3f070, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8c0ec7f3-de0e-4f34-a74d-075932c3f070,segment=NetworkSegment(d736d6f7-8b9d-47f6-8b67-dc23f9e2f057),segment_id=d736d6f7-8b9d-47f6-8b67-dc23f9e2f057)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:43.209926 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c75467f8-2fd2-4627-84e0-5ff0a404ad51 None None] Network c23cb4a7-305b-44c0-859c-d250baf023e6 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:43.214390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=f2f27663-2ca5-4f89-8291-987dd3c300d5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:43.216371 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No DVR routers for this DVR port f2f27663-2ca5-4f89-8291-987dd3c300d5 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:43.226505 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.228449 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2fb108bc-14c2-44f0-9276-6a70ad2e5459 None None] Port f2f27663-2ca5-4f89-8291-987dd3c300d5 update to ACTIVE by agent not found {{(pid=103812) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 10 14:28:43.283961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.300119 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ef47b34d-4523-40a3-9ce4-745c1ebb42bd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.5159914 Dec 10 14:28:43.317356 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57150) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:43.345115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.371918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=3959e9c2-3e57-492f-8f22-4b5cc5145158,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:43.418554 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034797b7-9d5c-4609-8901-0ef18a30f295 None None] Pushing event updated for resources: {'Port': ['ID=8c0ec7f3-de0e-4f34-a74d-075932c3f070,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:43.424168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:43.424988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:43.430609 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Provisioning complete for port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:43.431230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.431521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network 60caf174-b8c2-4cad-a2ec-484ecd98e9cd is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:43.466007 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.505813 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network 8649677f-212a-4a75-9dc5-33839d1249ee is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:43.508993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:43.532963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-984dade2-a936-4b2b-a4d1-0c281b432647 None None] DHCP port deletion for 483ef081-5fa5-4563-9fd7-d71a92f5556e request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:43.573774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 60caf174-b8c2-4cad-a2ec-484ecd98e9cd) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:43.580724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ef083994-bf8e-414e-9d5c-8cd9aa254dd5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.584199 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ef083994-bf8e-414e-9d5c-8cd9aa254dd5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.587821 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ef083994-bf8e-414e-9d5c-8cd9aa254dd5 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/4d15ce9d-9a6c-46d7-addc-35f1cb0f1c35 HTTP/1.1" status: 204 len: 168 time: 1.0698965 Dec 10 14:28:43.591339 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-c23cb4a7-305b-44c0-859c-d250baf023e6', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:43.591740 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.604690 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:43.605384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.612675 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-083a8fd0-8edc-43cd-ab56-e165f2ca9062 None None] Network 60caf174-b8c2-4cad-a2ec-484ecd98e9cd requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:43.644381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef083994-bf8e-414e-9d5c-8cd9aa254dd5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d15ce9d-9a6c-46d7-addc-35f1cb0f1c35,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:43.651872 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['483ef081-5fa5-4563-9fd7-d71a92f5556e']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:43.694462 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:43.729518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e91a3da6-304e-4c5d-bd17-9cd473957876') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:43.729748 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e91a3da6-304e-4c5d-bd17-9cd473957876') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:43.772149 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.781217 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b1049243-2d76-42e0-95c1-b58f06944052 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 1.9152782 Dec 10 14:28:43.785599 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57154) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:43.805132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.806892 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 802469f5-fbdb-410b-a9f9-5fd999bc15ad up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:43.831042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Releasing vlan 385 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:43.831470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:43.843796 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:43.890928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Router d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:28:44.026822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.045785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.064709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.073485 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/networks/483ef081-5fa5-4563-9fd7-d71a92f5556e HTTP/1.1" status: 204 len: 168 time: 1.9346728 Dec 10 14:28:44.132212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57158) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:44.143661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'name': 'tempest-PortsIpV6TestJSON-731798380'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:44.153068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc60e0f1-3193-4f77-b153-3247044617ce tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Network': ['ID=483ef081-5fa5-4563-9fd7-d71a92f5556e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:44.238102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-60caf174-b8c2-4cad-a2ec-484ecd98e9cd', 'network_id': '60caf174-b8c2-4cad-a2ec-484ecd98e9cd', 'project_id': '243ec7ec23134148a44eb888e6040f25', 'fixed_ips': [{'subnet_id': '0608725b-fb13-4634-b952-c24d9cd07a16'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:44.238990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.279428 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Could not find standard attr ID for object f2f27663-2ca5-4f89-8291-987dd3c300d5. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:28:44.321194 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 802469f5-fbdb-410b-a9f9-5fd999bc15ad triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:44.322038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.406659 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.414989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:44.424188 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-013c7665-db56-497f-885e-9a9fa7272e85 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "PUT /v2.0/routers/d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9409146 Dec 10 14:28:44.428274 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8760620b-9d85-4c30-a5ec-e4d47920308c None None] Sync routers for ids ['d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:44.430812 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57162) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:44.441625 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8760620b-9d85-4c30-a5ec-e4d47920308c None None] Routers {'d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:44.442910 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8760620b-9d85-4c30-a5ec-e4d47920308c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:44.467637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57164) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:44.484680 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8760620b-9d85-4c30-a5ec-e4d47920308c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:44.495125 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8760620b-9d85-4c30-a5ec-e4d47920308c None None] Routers {'d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:44.495880 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8760620b-9d85-4c30-a5ec-e4d47920308c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:44.497218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:44.501517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.508019 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-df76b02c-1a9a-4914-bff4-0553508bea1b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.534398 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8760620b-9d85-4c30-a5ec-e4d47920308c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:44.535482 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8760620b-9d85-4c30-a5ec-e4d47920308c None None] The sync data for ids ['d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:44.535631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port f2489ccb-06c5-498a-b16f-18b6de9d107d yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:44.550547 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Allocated IP 2001:db8:1::2 (c23cb4a7-305b-44c0-859c-d250baf023e6/d0bc12cf-44cd-4620-98df-8ce2c544d13c/131d1bed-da3a-4c72-b20d-dee3f741a0e2) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:44.575067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.609469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d671daa2-6512-45fc-b323-18138c0e221c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:44.614818 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d671daa2-6512-45fc-b323-18138c0e221c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports?device_id=d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1 HTTP/1.1" status: 200 len: 982 time: 0.1789749 Dec 10 14:28:44.619090 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57166) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:44.644858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Provisioning complete for port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:44.645095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.772046 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-df76b02c-1a9a-4914-bff4-0553508bea1b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.857060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-df76b02c-1a9a-4914-bff4-0553508bea1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:44.880368 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Allocated IP 2001:db8::1 (60caf174-b8c2-4cad-a2ec-484ecd98e9cd/0608725b-fb13-4634-b952-c24d9cd07a16/b22ebce2-32e0-4d05-8319-55a9f3f14398) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:44.906772 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-df76b02c-1a9a-4914-bff4-0553508bea1b admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=abb926466c354fa69f2228ebac603739&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4178069 Dec 10 14:28:44.907151 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57168) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:44.937120 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df76b02c-1a9a-4914-bff4-0553508bea1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9a5fa07-d767-4663-92cf-ceedd520f025,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:44.939186 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:28:38Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:43Z', 'revision_number': 4, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:45.023361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-80efd7c9-403c-4757-a756-a41770046742 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.050689 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-072345e1-5883-4a57-b9ba-05b722cc74a9 None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:28:38Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:43Z', 'revision_number': 4, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:45.057350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-80efd7c9-403c-4757-a756-a41770046742 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.094001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.110935 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:45.121454 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.171342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.176717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.239605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-80efd7c9-403c-4757-a756-a41770046742 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.244720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-80efd7c9-403c-4757-a756-a41770046742 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.246129 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-80efd7c9-403c-4757-a756-a41770046742 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/b9a5fa07-d767-4663-92cf-ceedd520f025 HTTP/1.1" status: 204 len: 168 time: 0.3380086 Dec 10 14:28:45.253847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] For port 8c0ec7f3-de0e-4f34-a74d-075932c3f070, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8c0ec7f3-de0e-4f34-a74d-075932c3f070,segment=NetworkSegment(d736d6f7-8b9d-47f6-8b67-dc23f9e2f057),segment_id=d736d6f7-8b9d-47f6-8b67-dc23f9e2f057)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:45.265096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80efd7c9-403c-4757-a756-a41770046742 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9a5fa07-d767-4663-92cf-ceedd520f025,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:45.273862 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.290500 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.383612 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:45.383612 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.390462 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.398960 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 3959e9c2-3e57-492f-8f22-4b5cc5145158 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:45.401063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.417946 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:45.444368 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:45.453749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:45.458245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Network c23cb4a7-305b-44c0-859c-d250baf023e6 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:45.460512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:45.461181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.495224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Pushing event updated for resources: {'Port': ['ID=131d1bed-da3a-4c72-b20d-dee3f741a0e2,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:45.501355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=f2489ccb-06c5-498a-b16f-18b6de9d107d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:45.501872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:45.518734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 2001:db8:1::1 (c23cb4a7-305b-44c0-859c-d250baf023e6/d0bc12cf-44cd-4620-98df-8ce2c544d13c/968ad944-9269-4599-a638-73d9c25aedbf) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:45.522981 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:45.529389 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Provisioning complete for port 3959e9c2-3e57-492f-8f22-4b5cc5145158 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:45.529389 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.577215 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.578339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.598988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 3959e9c2-3e57-492f-8f22-4b5cc5145158 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:45.603794 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e8d272c6-16d4-424f-8a78-8e73c9048b2b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 1.4699299 Dec 10 14:28:45.612019 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57172) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:45.714438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Attempting to bind port 131d1bed-da3a-4c72-b20d-dee3f741a0e2 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:45.715497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Attempting to bind port 131d1bed-da3a-4c72-b20d-dee3f741a0e2 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'c6598b53-1d26-477e-bd07-4d2d83dec5b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:45.715879 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Attempting to bind port 131d1bed-da3a-4c72-b20d-dee3f741a0e2 on network c23cb4a7-305b-44c0-859c-d250baf023e6 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:45.718441 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Port 3959e9c2-3e57-492f-8f22-4b5cc5145158 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:45.724302 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.730633 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4bf3aff-5a60-4547-8358-44ed984584e8 None None] Pushing event updated for resources: {'Port': ['ID=8c0ec7f3-de0e-4f34-a74d-075932c3f070,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:45.779674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.797722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:45.797722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Checking segment: {'id': 'c6598b53-1d26-477e-bd07-4d2d83dec5b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:45.797722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.798678 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Bound using segment: {'id': 'c6598b53-1d26-477e-bd07-4d2d83dec5b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:45.799185 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Bound port: 131d1bed-da3a-4c72-b20d-dee3f741a0e2, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c6598b53-1d26-477e-bd07-4d2d83dec5b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:45.799906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.841120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-dffe87d2-6551-411f-8e56-4326c3c88d40 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port f2489ccb-06c5-498a-b16f-18b6de9d107d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:45.841570 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dffe87d2-6551-411f-8e56-4326c3c88d40 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.865511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f2f27663-2ca5-4f89-8291-987dd3c300d5 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:45.912903 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Network 60caf174-b8c2-4cad-a2ec-484ecd98e9cd is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:45.918500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: f2f27663-2ca5-4f89-8291-987dd3c300d5 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:45.918862 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f2f27663-2ca5-4f89-8291-987dd3c300d5 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:45.937878 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Pushing event updated for resources: {'Port': ['ID=b22ebce2-32e0-4d05-8319-55a9f3f14398,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:45.942742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:45.945883 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:45.950666 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dffe87d2-6551-411f-8e56-4326c3c88d40 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.975384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-dffe87d2-6551-411f-8e56-4326c3c88d40 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for f2489ccb-06c5-498a-b16f-18b6de9d107d owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:45.997538 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-210af210-faca-41ff-960f-ef0dc567948d None None] Provisioning complete for port 3959e9c2-3e57-492f-8f22-4b5cc5145158 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:45.998839 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-210af210-faca-41ff-960f-ef0dc567948d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:45.999417 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.028635 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=3959e9c2-3e57-492f-8f22-4b5cc5145158,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:46.052319 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-210af210-faca-41ff-960f-ef0dc567948d None None] Port 3959e9c2-3e57-492f-8f22-4b5cc5145158 was deleted so its status cannot be updated. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Dec 10 14:28:46.058188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] For port 131d1bed-da3a-4c72-b20d-dee3f741a0e2, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:46.071335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.073176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Attempting to bind port b22ebce2-32e0-4d05-8319-55a9f3f14398 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:46.073176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Attempting to bind port b22ebce2-32e0-4d05-8319-55a9f3f14398 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '28a3d4d0-02b4-4e6f-b727-8ac0718b9918', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '60caf174-b8c2-4cad-a2ec-484ecd98e9cd'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:46.073586 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Attempting to bind port b22ebce2-32e0-4d05-8319-55a9f3f14398 on network 60caf174-b8c2-4cad-a2ec-484ecd98e9cd {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:46.080746 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] For port 131d1bed-da3a-4c72-b20d-dee3f741a0e2, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=131d1bed-da3a-4c72-b20d-dee3f741a0e2,segment=NetworkSegment(c6598b53-1d26-477e-bd07-4d2d83dec5b6),segment_id=c6598b53-1d26-477e-bd07-4d2d83dec5b6)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:46.088316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:46.088316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Checking segment: {'id': '28a3d4d0-02b4-4e6f-b727-8ac0718b9918', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '60caf174-b8c2-4cad-a2ec-484ecd98e9cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:46.088613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.088874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Bound using segment: {'id': '28a3d4d0-02b4-4e6f-b727-8ac0718b9918', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '60caf174-b8c2-4cad-a2ec-484ecd98e9cd'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:46.089364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Bound port: b22ebce2-32e0-4d05-8319-55a9f3f14398, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '28a3d4d0-02b4-4e6f-b727-8ac0718b9918', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': '60caf174-b8c2-4cad-a2ec-484ecd98e9cd'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:46.089813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.100886 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-210af210-faca-41ff-960f-ef0dc567948d None None] Provisioning complete for port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:46.101295 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-210af210-faca-41ff-960f-ef0dc567948d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.140491 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.152529 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network c23cb4a7-305b-44c0-859c-d250baf023e6 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:46.174386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:46.182870 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=968ad944-9269-4599-a638-73d9c25aedbf,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:46.184559 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:46.185672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.219360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.225937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=0608725b-fb13-4634-b952-c24d9cd07a16,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:46.236943 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] For port b22ebce2-32e0-4d05-8319-55a9f3f14398, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:46.290248 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] For port b22ebce2-32e0-4d05-8319-55a9f3f14398, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b22ebce2-32e0-4d05-8319-55a9f3f14398,segment=NetworkSegment(28a3d4d0-02b4-4e6f-b727-8ac0718b9918),segment_id=28a3d4d0-02b4-4e6f-b727-8ac0718b9918)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:46.298355 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.324966 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dffe87d2-6551-411f-8e56-4326c3c88d40 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.342490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-badae9e7-edff-49cc-9293-aae00b7effd9 None None] Pushing event updated for resources: {'Port': ['ID=131d1bed-da3a-4c72-b20d-dee3f741a0e2,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:46.375267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dffe87d2-6551-411f-8e56-4326c3c88d40 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=f2489ccb-06c5-498a-b16f-18b6de9d107d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:46.382831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.392461 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dffe87d2-6551-411f-8e56-4326c3c88d40 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.399299 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dffe87d2-6551-411f-8e56-4326c3c88d40 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/f2489ccb-06c5-498a-b16f-18b6de9d107d HTTP/1.1" status: 204 len: 168 time: 0.7863724 Dec 10 14:28:46.406287 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57184) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:46.418542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'mac_address': 'fa:16:3e:82:25:24', 'name': 'tempest-PortsIpV6TestJSON-1686122181'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:46.446127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.476908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c0b1af-2458-4cf1-bb9f-211ce4b7b564 None None] Pushing event updated for resources: {'Port': ['ID=b22ebce2-32e0-4d05-8319-55a9f3f14398,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:46.524921 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['60caf174-b8c2-4cad-a2ec-484ecd98e9cd']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:46.541030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '28a3d4d0-02b4-4e6f-b727-8ac0718b9918') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:46.541472 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '28a3d4d0-02b4-4e6f-b727-8ac0718b9918') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:46.547014 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2447eb9a-0258-486f-97eb-6db79a7adeba None None] Network 60caf174-b8c2-4cad-a2ec-484ecd98e9cd requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:46.578095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.596258 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.701072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.718476 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Router d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:28:46.732184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 373 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:46.732596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:46.737620 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:46.830087 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:46.886994 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.api [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:28:46.886994 dv-neutron-821401-2-hyperv neutron-server[103811]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:28:46.886994 dv-neutron-821401-2-hyperv neutron-server[103811]: [parameters: {'id': '60caf174-b8c2-4cad-a2ec-484ecd98e9cd'}] Dec 10 14:28:46.886994 dv-neutron-821401-2-hyperv neutron-server[103811]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103811) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:46.887416 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG oslo_db.api [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:46.888062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:46.897568 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f0d8bb46-fb75-42e2-aff1-407abe79133f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "PUT /v2.0/routers/d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2772794 Dec 10 14:28:46.898222 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57192) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:46.905281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b4016c4-3fdd-4333-b3d6-f9a1db40dfec None None] Sync routers for ids ['d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:46.925384 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-b126ba07-6f67-49d3-a56c-9e1ad3c11211 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:28:46.930176 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b126ba07-6f67-49d3-a56c-9e1ad3c11211 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/3959e9c2-3e57-492f-8f22-4b5cc5145158 HTTP/1.1" status: 404 len: 333 time: 0.0310555 Dec 10 14:28:46.930833 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57196) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:46.935398 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b4016c4-3fdd-4333-b3d6-f9a1db40dfec None None] Routers {'d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:46.939484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9b4016c4-3fdd-4333-b3d6-f9a1db40dfec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:46.945158 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:46.975148 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9b4016c4-3fdd-4333-b3d6-f9a1db40dfec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:46.985694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b4016c4-3fdd-4333-b3d6-f9a1db40dfec None None] Routers {'d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:46.986329 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9b4016c4-3fdd-4333-b3d6-f9a1db40dfec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:47.033296 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9b4016c4-3fdd-4333-b3d6-f9a1db40dfec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:47.034076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b4016c4-3fdd-4333-b3d6-f9a1db40dfec None None] The sync data for ids ['d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:47.053761 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57198) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:47.084703 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port f3b80c7e-6ab3-4257-bb6c-f0d386e8e8f1 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:47.093040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3bd5597f-43f5-4280-bc15-5a65e9ba43bc tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.169334 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 131d1bed-da3a-4c72-b20d-dee3f741a0e2 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:47.173254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'network': {'name': 'tempest-NetworksTestDHCPv6-test-network-1815015758'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:47.240991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:47.244889 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.255924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.366927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.388406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.414701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 131d1bed-da3a-4c72-b20d-dee3f741a0e2 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:47.416161 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.437136 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3bd5597f-43f5-4280-bc15-5a65e9ba43bc tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.451923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.455347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3bd5597f-43f5-4280-bc15-5a65e9ba43bc tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.465277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] vlan segment allocate from pool success with {'vlan_id': 354, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:47.468882 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.478687 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.478687 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Added segment 292f222e-ec8a-4b09-987f-5c8bd8bc0449 of type vlan for network cdc891b5-3e75-4d62-a51b-0f84be9af82d Dec 10 14:28:47.535767 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.555769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.556729 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.567158 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57204) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:47.572071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.591360 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'SecurityGroup': ['ID=08e219a3-2955-4301-983d-9b16b863604e,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:47.592094 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 131d1bed-da3a-4c72-b20d-dee3f741a0e2, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=131d1bed-da3a-4c72-b20d-dee3f741a0e2,segment=NetworkSegment(c6598b53-1d26-477e-bd07-4d2d83dec5b6),segment_id=c6598b53-1d26-477e-bd07-4d2d83dec5b6)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:47.616545 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting port b22ebce2-32e0-4d05-8319-55a9f3f14398 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:47.616880 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.656362 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.657483 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8c0ec7f3-de0e-4f34-a74d-075932c3f070 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:47.697720 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] For port b22ebce2-32e0-4d05-8319-55a9f3f14398, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b22ebce2-32e0-4d05-8319-55a9f3f14398,segment=NetworkSegment(28a3d4d0-02b4-4e6f-b727-8ac0718b9918),segment_id=28a3d4d0-02b4-4e6f-b727-8ac0718b9918)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:47.698074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.704336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3bd5597f-43f5-4280-bc15-5a65e9ba43bc tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.704817 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3bd5597f-43f5-4280-bc15-5a65e9ba43bc tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Fanout notify agent at l3_agent the message router_deleted on router d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:28:47.713711 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Calling delete_port for b22ebce2-32e0-4d05-8319-55a9f3f14398 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:47.727152 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a996ad79-346d-448a-9c61-847114bb70ca None None] Network c23cb4a7-305b-44c0-859c-d250baf023e6 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:47.727265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3bd5597f-43f5-4280-bc15-5a65e9ba43bc tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.730140 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3bd5597f-43f5-4280-bc15-5a65e9ba43bc tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/routers/d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1 HTTP/1.1" status: 204 len: 168 time: 0.7970300 Dec 10 14:28:47.736920 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57206) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:47.806029 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.808694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.810890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=968ad944-9269-4599-a638-73d9c25aedbf,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:47.815329 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:47.818499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.828554 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=131d1bed-da3a-4c72-b20d-dee3f741a0e2,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:47.847323 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-5ac3d35f-a0e2-40cc-a4cb-a563fad0b4d1 None None] Provisioning complete for port 131d1bed-da3a-4c72-b20d-dee3f741a0e2 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:47.847686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5ac3d35f-a0e2-40cc-a4cb-a563fad0b4d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.859453 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b71769e2-f126-4ad0-826b-08d533a0d36f tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:47.859933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b71769e2-f126-4ad0-826b-08d533a0d36f tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:47.860393 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b71769e2-f126-4ad0-826b-08d533a0d36f tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:47.869924 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b71769e2-f126-4ad0-826b-08d533a0d36f tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/ports?project_id=c0bfba20c10d46e1abb38c3a54bd852b&network_id=041ac3a9-0ca7-4449-9782-639f1235b461 HTTP/1.1" status: 200 len: 2999 time: 0.2846851 Dec 10 14:28:47.893857 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Network': ['ID=cdc891b5-3e75-4d62-a51b-0f84be9af82d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:47.900451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:47.900933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.903195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.908286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:47.910349 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network c23cb4a7-305b-44c0-859c-d250baf023e6 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:47.915093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-56926d04-11e5-4584-8912-7ccb7ad56c39 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet 7e848c66-8659-43af-bdae-aaac760b6048 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:47.921716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:47.926504 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-56926d04-11e5-4584-8912-7ccb7ad56c39 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:47.944185 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c21b7cf8-305b-4b5a-b395-fa64cb6f70fb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.8858652 Dec 10 14:28:47.944185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Port': ['ID=b22ebce2-32e0-4d05-8319-55a9f3f14398,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:47.945596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57210) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:47.950880 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:47.954658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No DVR routers for this DVR port b22ebce2-32e0-4d05-8319-55a9f3f14398 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:48.066726 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.074967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-56926d04-11e5-4584-8912-7ccb7ad56c39 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.103719 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.136251 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['60caf174-b8c2-4cad-a2ec-484ecd98e9cd']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:48.154071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '28a3d4d0-02b4-4e6f-b727-8ac0718b9918') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:48.154497 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '28a3d4d0-02b4-4e6f-b727-8ac0718b9918') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:48.164536 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.170073 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:48.180512 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.180944 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:48.187475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 373 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:48.189095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.191010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:48.193033 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:48.197096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:48.197746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.214927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=f3b80c7e-6ab3-4257-bb6c-f0d386e8e8f1,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:48.222719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:28:48.233345 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:48.237165 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.371882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.382600 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.392267 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/60caf174-b8c2-4cad-a2ec-484ecd98e9cd HTTP/1.1" status: 204 len: 168 time: 4.6039968 Dec 10 14:28:48.396869 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57214) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:48.404263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1963043821'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:48.423618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b65ad65a-f075-4d74-b79b-9ffb69d6fb9e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=60caf174-b8c2-4cad-a2ec-484ecd98e9cd,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:48.447225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-58a4664b-6c1f-418a-aa80-07df55947d8b None None] Provisioning complete for port 131d1bed-da3a-4c72-b20d-dee3f741a0e2 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:48.447598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-58a4664b-6c1f-418a-aa80-07df55947d8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.564664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-58a4664b-6c1f-418a-aa80-07df55947d8b None None] Provisioning complete for port 968ad944-9269-4599-a638-73d9c25aedbf triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:48.565036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-58a4664b-6c1f-418a-aa80-07df55947d8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.582298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:48.587584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.614141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-58a4664b-6c1f-418a-aa80-07df55947d8b None None] Port 968ad944-9269-4599-a638-73d9c25aedbf cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:48.623438 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 363, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:48.629374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-56926d04-11e5-4584-8912-7ccb7ad56c39 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.633156 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.633782 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment 0195cb1d-3621-4f78-bead-37566cfcb3c0 of type vlan for network 522c6690-944f-4247-91b9-f2e1df1754f5 Dec 10 14:28:48.635514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.637071 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5c387e4d-486c-4b20-8d35-42250db90a04 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 2.2294440 Dec 10 14:28:48.651017 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57218) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:48.732002 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:48.738722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-78a1e341-dc3b-4df2-bf9c-920a5fcf1fa8 None None] Provisioning complete for port 968ad944-9269-4599-a638-73d9c25aedbf triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:48.739160 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-78a1e341-dc3b-4df2-bf9c-920a5fcf1fa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.740697 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-760af767-d433-462f-9239-23c1500a8a73 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4238911 Dec 10 14:28:48.743537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57220) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:48.748403 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:48.748941 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1426865463'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:48.776134 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:48.777138 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:48.785389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=e6318643-befa-43c7-9fa6-96dd2c2e2e70,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:48.803646 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.817730 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e052d34c-9429-4a3f-b748-d6cdbeb3f8f7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:48.822177 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e052d34c-9429-4a3f-b748-d6cdbeb3f8f7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/f3b80c7e-6ab3-4257-bb6c-f0d386e8e8f1 HTTP/1.1" status: 200 len: 845 time: 0.1571219 Dec 10 14:28:48.822355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57222) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:48.836604 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-78a1e341-dc3b-4df2-bf9c-920a5fcf1fa8 None None] Port 968ad944-9269-4599-a638-73d9c25aedbf cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:48.837246 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:48.837710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network hostable DHCP agents. Network: cdc891b5-3e75-4d62-a51b-0f84be9af82d, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:48.857744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-56926d04-11e5-4584-8912-7ccb7ad56c39 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.872747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:48.876507 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.881152 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:48.907525 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56926d04-11e5-4584-8912-7ccb7ad56c39 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=7e848c66-8659-43af-bdae-aaac760b6048,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:48.932888 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-56926d04-11e5-4584-8912-7ccb7ad56c39 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.932888 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-56926d04-11e5-4584-8912-7ccb7ad56c39 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/7e848c66-8659-43af-bdae-aaac760b6048 HTTP/1.1" status: 204 len: 168 time: 1.1907923 Dec 10 14:28:48.933570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57226) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:48.933668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b8cf252-3173-40da-9d60-fc6794ea1c86 None None] Network 8649677f-212a-4a75-9dc5-33839d1249ee requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:48.963306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:48.975499 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] vlan segment allocate from pool success with {'vlan_id': 361, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:48.996609 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.996795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:48.997336 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added segment 877fce5e-0213-4db9-862b-58436fd1cb89 of type vlan for network 152411ab-4991-469e-bd27-c8d29a909a0f Dec 10 14:28:49.000738 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:49.002734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.060250 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.064984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-71439f1c-be5f-4f6f-80e8-3178911a40da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port f3b80c7e-6ab3-4257-bb6c-f0d386e8e8f1 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:49.065587 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-71439f1c-be5f-4f6f-80e8-3178911a40da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.100627 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:28:46Z', 'revision_number': 3, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:46Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:49.127401 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:28:49.128058 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Updating router 84410bb0-960a-4ef0-a5c1-72cde49aba0f port 968ad944-9269-4599-a638-73d9c25aedbf binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:28:49.132851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-22b19e25-ad75-4133-9146-43a000793135 None None] Provisioning complete for port 968ad944-9269-4599-a638-73d9c25aedbf triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:49.133224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-22b19e25-ad75-4133-9146-43a000793135 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.166099 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.168082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-71439f1c-be5f-4f6f-80e8-3178911a40da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.182117 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 131d1bed-da3a-4c72-b20d-dee3f741a0e2 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:49.184755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-71439f1c-be5f-4f6f-80e8-3178911a40da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for f3b80c7e-6ab3-4257-bb6c-f0d386e8e8f1 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:49.233180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-22b19e25-ad75-4133-9146-43a000793135 None None] Port 968ad944-9269-4599-a638-73d9c25aedbf cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:49.241235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.248283 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:49.249022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.256805 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 131d1bed-da3a-4c72-b20d-dee3f741a0e2 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:49.257179 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.280960 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=522c6690-944f-4247-91b9-f2e1df1754f5,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:49.304563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 522c6690-944f-4247-91b9-f2e1df1754f5 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:49.355939 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, cdc891b5-3e75-4d62-a51b-0f84be9af82d) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:49.370711 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca6e0ee6-4f4a-4180-8004-7b6b56cd6642 None None] DHCP port deletion for 8649677f-212a-4a75-9dc5-33839d1249ee request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:49.372821 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e48f783-0976-41b9-add4-c4ba96808a05 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:49.375406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:49.376047 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.378310 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.6332104 Dec 10 14:28:49.379120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57240) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:49.390455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'subnet': {'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'cidr': '2001:db8:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:2::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:49.420340 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a76979c-306d-44e2-ab9c-de55eb90e25d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Network': ['ID=152411ab-4991-469e-bd27-c8d29a909a0f,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:49.423337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.482571 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.486204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 152411ab-4991-469e-bd27-c8d29a909a0f details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:49.496006 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-011f3da5-1580-445c-ba1c-c477ad539e7d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.5492659 Dec 10 14:28:49.499005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57242) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:49.501253 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3b474520-d0e0-44b1-abb3-49f2f2fee145 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.1015139 Dec 10 14:28:49.504743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'name': 'tempest-NetworksTestDHCPv6-1705301988'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:49.505036 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57244) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:49.512585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:49.557583 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.569461 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-71439f1c-be5f-4f6f-80e8-3178911a40da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.617712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71439f1c-be5f-4f6f-80e8-3178911a40da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=f3b80c7e-6ab3-4257-bb6c-f0d386e8e8f1,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:49.622125 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-71439f1c-be5f-4f6f-80e8-3178911a40da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.623479 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Pushing event updated for resources: {'Port': ['ID=968ad944-9269-4599-a638-73d9c25aedbf,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:49.628318 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-71439f1c-be5f-4f6f-80e8-3178911a40da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/f3b80c7e-6ab3-4257-bb6c-f0d386e8e8f1 HTTP/1.1" status: 204 len: 168 time: 0.8026295 Dec 10 14:28:49.629097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57248) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:49.638856 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.639730 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.640276 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.640818 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.641308 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.641811 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.642314 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.642815 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.643450 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.643950 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.644445 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.644924 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.646023 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:28:49.658219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:49.658536 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.663772 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-ef6cc158-908e-47d8-8132-efcae194e7f5 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:28:49.668826 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ef6cc158-908e-47d8-8132-efcae194e7f5 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/f3b80c7e-6ab3-4257-bb6c-f0d386e8e8f1 HTTP/1.1" status: 404 len: 333 time: 0.0347760 Dec 10 14:28:49.673009 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:49.676970 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.682347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57250) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:49.690479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'name': 'tempest-PortsIpV6TestJSON-64416832'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:49.766320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57252) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:49.788362 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Attempting to bind port 968ad944-9269-4599-a638-73d9c25aedbf on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:49.789379 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Attempting to bind port 968ad944-9269-4599-a638-73d9c25aedbf by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'c6598b53-1d26-477e-bd07-4d2d83dec5b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:49.792636 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Attempting to bind port 968ad944-9269-4599-a638-73d9c25aedbf on network c23cb4a7-305b-44c0-859c-d250baf023e6 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:49.809630 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:49.810299 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Checking segment: {'id': 'c6598b53-1d26-477e-bd07-4d2d83dec5b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:49.813586 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.813586 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Bound using segment: {'id': 'c6598b53-1d26-477e-bd07-4d2d83dec5b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:49.813586 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Bound port: 968ad944-9269-4599-a638-73d9c25aedbf, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c6598b53-1d26-477e-bd07-4d2d83dec5b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 371, 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:49.813586 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.851239 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': 'e6318643-befa-43c7-9fa6-96dd2c2e2e70'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:49.855039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.899269 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ca6e0ee6-4f4a-4180-8004-7b6b56cd6642 None None] Deleting port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:49.900133 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ca6e0ee6-4f4a-4180-8004-7b6b56cd6642 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:49.952390 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] For port 968ad944-9269-4599-a638-73d9c25aedbf, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:49.963387 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] For port 968ad944-9269-4599-a638-73d9c25aedbf, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=968ad944-9269-4599-a638-73d9c25aedbf,segment=NetworkSegment(c6598b53-1d26-477e-bd07-4d2d83dec5b6),segment_id=c6598b53-1d26-477e-bd07-4d2d83dec5b6)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:50.037985 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 10 14:28:50.037985 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 10 14:28:50.037985 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'project_id_1': 'cc793beea85f4cf887a3485aad20d8e7', 'expiration_1': datetime.datetime(2021, 12, 10, 14, 28, 29, 905777)}] Dec 10 14:28:50.037985 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:50.038372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:50.066096 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.109841 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ca6e0ee6-4f4a-4180-8004-7b6b56cd6642 None None] For port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=043b68f6-ae4c-4e2a-9e27-48a3de36ff0b,segment=NetworkSegment(4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf),segment_id=4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:50.110465 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ca6e0ee6-4f4a-4180-8004-7b6b56cd6642 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.122871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0d842909-3bc3-47f8-86cd-c44cefc49596 None None] Provisioning complete for port 968ad944-9269-4599-a638-73d9c25aedbf triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:50.123278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0d842909-3bc3-47f8-86cd-c44cefc49596 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.124059 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:50.129316 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.162256 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port 263c0732-dcb6-4136-b1ce-24a8d9fc10ef yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:50.164128 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:50.167695 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:50.181630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.190257 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ca6e0ee6-4f4a-4180-8004-7b6b56cd6642 None None] Calling delete_port for 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:50.222362 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/e6318643-befa-43c7-9fa6-96dd2c2e2e70/be101111-dc57-4a49-9754-8ff78b3190e3) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:50.242096 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18fb69d-d8a5-4e96-a05d-8758eab47b6b None None] Pushing event updated for resources: {'Port': ['ID=968ad944-9269-4599-a638-73d9c25aedbf,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:50.346838 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:50.377071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Subnet': ['ID=26e3d43e-96a1-4cc9-a6a1-d9e609028ad8,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:50.386989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Checking segment: {'id': '877fce5e-0213-4db9-862b-58436fd1cb89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:50.388056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network hostable DHCP agents. Network: 152411ab-4991-469e-bd27-c8d29a909a0f, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:50.439268 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:50.443480 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.478127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0d842909-3bc3-47f8-86cd-c44cefc49596 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.496376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 152411ab-4991-469e-bd27-c8d29a909a0f is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:50.498252 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] For port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=043b68f6-ae4c-4e2a-9e27-48a3de36ff0b,segment=NetworkSegment(4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf),segment_id=4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:50.498632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.524805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf20fad6-d23a-4b94-879d-41f16ca5badd tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:50.529561 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bf20fad6-d23a-4b94-879d-41f16ca5badd tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 814 time: 0.7578747 Dec 10 14:28:50.557872 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:50.587786 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 152411ab-4991-469e-bd27-c8d29a909a0f) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:50.591320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21699a42-3ad5-4b9a-9cdd-24dcb6d4414d req-f04a6953-c9b7-4a67-be49-093929ee162e tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:50.591926 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:50.592518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.592889 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-21699a42-3ad5-4b9a-9cdd-24dcb6d4414d req-f04a6953-c9b7-4a67-be49-093929ee162e tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.8275676 Dec 10 14:28:50.651006 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:50.659168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.681514 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:28:46Z', 'revision_number': 3, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:49Z', 'revision_number': 4, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:50.690718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 9c5c4129-5e9b-45ea-a766-7353d2ee82a3 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:50.717740 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72664422-3702-4b2b-b8a2-a398a25c7e39 None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:28:46Z', 'revision_number': 3, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:49Z', 'revision_number': 4, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:28:50.748890 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-21699a42-3ad5-4b9a-9cdd-24dcb6d4414d req-4c2f31cc-870f-406f-8821-b47b4c40af74 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1162729 Dec 10 14:28:50.752908 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-167f84af-00fb-41df-aa98-057a5d5bb170 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.3648331 Dec 10 14:28:50.753696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57264) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:50.777260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.807267 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffb1429f-811a-4f0a-947f-276b4803619b None None] Network 152411ab-4991-469e-bd27-c8d29a909a0f requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:50.873777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.878292 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.919333 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=043b68f6-ae4c-4e2a-9e27-48a3de36ff0b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:50.926100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No DVR routers for this DVR port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:50.934894 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.935955 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0d842909-3bc3-47f8-86cd-c44cefc49596 None None] For port 968ad944-9269-4599-a638-73d9c25aedbf, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=968ad944-9269-4599-a638-73d9c25aedbf,segment=NetworkSegment(c6598b53-1d26-477e-bd07-4d2d83dec5b6),segment_id=c6598b53-1d26-477e-bd07-4d2d83dec5b6)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:50.956020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ca6e0ee6-4f4a-4180-8004-7b6b56cd6642 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:50.963739 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:50.977683 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:50.979351 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::182 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/e6318643-befa-43c7-9fa6-96dd2c2e2e70/263c0732-dcb6-4136-b1ce-24a8d9fc10ef) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:50.980288 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:50.994721 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Pushing event updated for resources: {'Port': ['ID=be101111-dc57-4a49-9754-8ff78b3190e3,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:51.007006 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca6e0ee6-4f4a-4180-8004-7b6b56cd6642 None None] No DVR routers for this DVR port 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:51.033863 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca6e0ee6-4f4a-4180-8004-7b6b56cd6642 None None] Pushing event deleted for resources: {'Port': ['ID=043b68f6-ae4c-4e2a-9e27-48a3de36ff0b,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:51.043569 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0d842909-3bc3-47f8-86cd-c44cefc49596 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.080976 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.121984 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-152411ab-4991-469e-bd27-c8d29a909a0f', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:51.122890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.136623 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8649677f-212a-4a75-9dc5-33839d1249ee']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:51.150722 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=2c8fca0e-c54d-4804-9947-80f97a9597e9,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:51.164431 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:51.164733 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4d8957b4-71bb-4dcc-9ec1-c8a4e7dd66bf') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:51.181730 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.190291 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking segment: {'id': '0195cb1d-3621-4f78-bead-37566cfcb3c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:51.194461 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network hostable DHCP agents. Network: 522c6690-944f-4247-91b9-f2e1df1754f5, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:51.206006 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 968ad944-9269-4599-a638-73d9c25aedbf up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:51.212106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.221377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Releasing vlan 368 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:28:51.225765 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:28:51.247958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Attempting to bind port be101111-dc57-4a49-9754-8ff78b3190e3 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:51.248585 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Attempting to bind port be101111-dc57-4a49-9754-8ff78b3190e3 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:51.249198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Attempting to bind port be101111-dc57-4a49-9754-8ff78b3190e3 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:51.270655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57266) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:51.276052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'network': {'name': 'tempest-network-smoke--422581656', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'port_security_enabled': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:51.294446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.296011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network 522c6690-944f-4247-91b9-f2e1df1754f5 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:51.317442 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d842909-3bc3-47f8-86cd-c44cefc49596 None None] Pushing event updated for resources: {'Port': ['ID=968ad944-9269-4599-a638-73d9c25aedbf,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:51.338549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:51.338939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:51.339344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.339745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:51.340284 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Bound port: be101111-dc57-4a49-9754-8ff78b3190e3, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:51.340673 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.347273 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-5c4388f0-0e3f-4ce1-8d72-4627f7ddd59c None None] Provisioning complete for port 968ad944-9269-4599-a638-73d9c25aedbf triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:51.347645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5c4388f0-0e3f-4ce1-8d72-4627f7ddd59c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.395216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.397711 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:51.410352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.412019 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 522c6690-944f-4247-91b9-f2e1df1754f5) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:51.422901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.432445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57268) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:51.433340 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/networks/8649677f-212a-4a75-9dc5-33839d1249ee HTTP/1.1" status: 204 len: 168 time: 2.5016551 Dec 10 14:28:51.448812 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:51.449520 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.466388 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f3a3c8-696c-447c-a4d8-5adf0ef60d63 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Network': ['ID=8649677f-212a-4a75-9dc5-33839d1249ee,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:51.471918 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f047b0ec-fe26-41d4-b78f-492d15074e4c None None] Network 522c6690-944f-4247-91b9-f2e1df1754f5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:51.489402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] vlan segment allocate from pool success with {'vlan_id': 356, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:51.500329 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.501932 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Added segment 3298319f-ed8b-45f9-8ce9-abfd3a6af445 of type vlan for network b44c5886-b77e-456d-b9b8-db5350758724 Dec 10 14:28:51.505513 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.576734 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cff41d69-9dad-43c7-b868-afe5cf556092 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.0680428 Dec 10 14:28:51.578366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.578489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-540aa731-14fe-4990-9e1d-04944615b388 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:51.579003 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-540aa731-14fe-4990-9e1d-04944615b388 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 HTTP/1.1" status: 200 len: 841 time: 0.1456013 Dec 10 14:28:51.585605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57270) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:51.585882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57272) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:51.592301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 968ad944-9269-4599-a638-73d9c25aedbf triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:51.592678 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.595864 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:51.597728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Allocated IP 2001:db8:2::2 (152411ab-4991-469e-bd27-c8d29a909a0f/26e3d43e-96a1-4cc9-a6a1-d9e609028ad8/0ab23af3-1805-4c63-a15b-b032f649ca20) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:51.623016 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] For port be101111-dc57-4a49-9754-8ff78b3190e3, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:51.651953 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9b48b4c4-040c-4df1-94e1-86738d6bfe36 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/d8a9f1e1-4205-4e96-9e7f-f18cabac63f6?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0651162 Dec 10 14:28:51.652581 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57274) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:51.658132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:51.667125 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] For port be101111-dc57-4a49-9754-8ff78b3190e3, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=be101111-dc57-4a49-9754-8ff78b3190e3,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:51.711223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.721180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:51.722018 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.768794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.843010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Network': ['ID=b44c5886-b77e-456d-b9b8-db5350758724,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:51.843638 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-522c6690-944f-4247-91b9-f2e1df1754f5', 'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5', 'project_id': '243ec7ec23134148a44eb888e6040f25', 'fixed_ips': [{'subnet_id': '2c8fca0e-c54d-4804-9947-80f97a9597e9'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:51.845218 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.848622 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:51.853509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.873103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=9c5c4129-5e9b-45ea-a766-7353d2ee82a3,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:51.884285 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:51.887747 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network b44c5886-b77e-456d-b9b8-db5350758724 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:51.892354 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:51.898584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:51.899494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:51.901327 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e182cf6c-0ddd-4093-b908-182dda813569 req-b07eb906-06c8-41b1-a397-a6a07fea99cc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:51.906080 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e182cf6c-0ddd-4093-b908-182dda813569 req-b07eb906-06c8-41b1-a397-a6a07fea99cc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.0610936 Dec 10 14:28:51.979514 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e182cf6c-0ddd-4093-b908-182dda813569 req-11988ade-d0d9-41f6-9f5d-707b348e07ef tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0700471 Dec 10 14:28:51.980858 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:51.984459 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.006205 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.053409 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc84b714-df50-4aff-8c31-e4a62cfbf24e None None] Pushing event updated for resources: {'Port': ['ID=be101111-dc57-4a49-9754-8ff78b3190e3,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:52.095795 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bbfeba55-1a54-4022-8e6d-7b4044d05c3c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 848 time: 2.4092474 Dec 10 14:28:52.100372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57278) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:52.103096 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3bfa609f-8814-43aa-9543-e1be46550015 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.8313653 Dec 10 14:28:52.103253 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.109847 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7cc613b8-f97f-4cbe-9251-d2dde582cc5c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:52.113840 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57280) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:52.207388 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:52.217514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.259283 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.290498 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:28:52.297058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2487a8b6-35e0-499d-b2fe-9a3599153f76 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:52.301144 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2487a8b6-35e0-499d-b2fe-9a3599153f76 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?project_id=c0bfba20c10d46e1abb38c3a54bd852b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 829 time: 0.1833889 Dec 10 14:28:52.301978 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57282) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:52.321518 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:28:52.321989 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 043b68f6-ae4c-4e2a-9e27-48a3de36ff0b not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:28:52.353712 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Allocated IP 2001:db8::2 (522c6690-944f-4247-91b9-f2e1df1754f5/2c8fca0e-c54d-4804-9947-80f97a9597e9/58db0125-8848-46c5-a0eb-a70079090a22) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:52.359405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.446484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Network 152411ab-4991-469e-bd27-c8d29a909a0f is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:52.481563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:52.483778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab7d5d38-1e7f-49d2-9462-d92ebe682bba tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:52.484551 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:52.485336 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ab7d5d38-1e7f-49d2-9462-d92ebe682bba tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1824148 Dec 10 14:28:52.488433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57284) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:52.492563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Pushing event updated for resources: {'Port': ['ID=0ab23af3-1805-4c63-a15b-b032f649ca20,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:52.532603 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e73cb4e1-6c89-41d9-8f25-07d3394dbef1 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0407803 Dec 10 14:28:52.532827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57286) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:52.573204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Attempting to bind port 0ab23af3-1805-4c63-a15b-b032f649ca20 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:52.573204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Attempting to bind port 0ab23af3-1805-4c63-a15b-b032f649ca20 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '877fce5e-0213-4db9-862b-58436fd1cb89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:52.573204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Attempting to bind port 0ab23af3-1805-4c63-a15b-b032f649ca20 on network 152411ab-4991-469e-bd27-c8d29a909a0f {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:52.573903 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2a855e0d-2ea6-4b6c-9af3-7b5389996f98 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?project_id=c0bfba20c10d46e1abb38c3a54bd852b&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0358040 Dec 10 14:28:52.581754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:52.582311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Checking segment: {'id': '877fce5e-0213-4db9-862b-58436fd1cb89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:52.583550 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.584475 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Bound using segment: {'id': '877fce5e-0213-4db9-862b-58436fd1cb89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:52.584866 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Bound port: 0ab23af3-1805-4c63-a15b-b032f649ca20, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '877fce5e-0213-4db9-862b-58436fd1cb89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:52.585618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.589777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57288) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:52.663808 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:52.687732 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:52.702467 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:52.709058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:52.709724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.711337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.713701 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40b8d7ac-2d85-403f-afcc-597d376d962f tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:52.718554 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-40b8d7ac-2d85-403f-afcc-597d376d962f tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1251357 Dec 10 14:28:52.718760 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57290) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:52.721842 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-de340624-a7d0-4d39-931d-141fee36111c None None] For port 0ab23af3-1805-4c63-a15b-b032f649ca20, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:52.725642 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-de340624-a7d0-4d39-931d-141fee36111c None None] For port 0ab23af3-1805-4c63-a15b-b032f649ca20, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0ab23af3-1805-4c63-a15b-b032f649ca20,segment=NetworkSegment(877fce5e-0213-4db9-862b-58436fd1cb89),segment_id=877fce5e-0213-4db9-862b-58436fd1cb89)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:52.747577 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9384b900-cf2f-487c-b15e-a2adfebb7c7d tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0275571 Dec 10 14:28:52.750140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57292) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:52.755528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-201778532', 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:52.781869 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=263c0732-dcb6-4136-b1ce-24a8d9fc10ef,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:52.821897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.837717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7cc613b8-f97f-4cbe-9251-d2dde582cc5c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.850451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.855058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.882517 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:52.897051 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-92bffee7-bbd5-4a1f-8ccb-a9d906dc7508 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 3.3968377 Dec 10 14:28:52.897552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:52.904015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:52.904625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:52.906699 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57294) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:52.913613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=9af374b7-feb5-4523-a05d-c9651ea05ab3,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:52.934392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62776373-b51b-4d73-92ec-1e083c6faf5e None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:52.946150 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Network 522c6690-944f-4247-91b9-f2e1df1754f5 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:52.969694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:52.969694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:52.990312 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:53.003140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.074625 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-48df6887-0d23-4193-ae49-26d89181dd82 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4209363 Dec 10 14:28:53.139628 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57298) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:53.148711 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1ea7521a-7df0-4174-8088-18a79f6289e7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'security_group': {'name': 'tempest-secgroup-1987578969'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:53.287121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Pushing event updated for resources: {'Port': ['ID=58db0125-8848-46c5-a0eb-a70079090a22,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:53.348899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7cc613b8-f97f-4cbe-9251-d2dde582cc5c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.376411 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e999daa5-e09e-49e3-ba16-bef71351f68f req-cbaaa6e6-b349-4dda-9b19-f34d6743f47d tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:53.379684 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e999daa5-e09e-49e3-ba16-bef71351f68f req-cbaaa6e6-b349-4dda-9b19-f34d6743f47d tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.2256362 Dec 10 14:28:53.408012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device be101111-dc57-4a49-9754-8ff78b3190e3 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:53.427460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7cc613b8-f97f-4cbe-9251-d2dde582cc5c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.455645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ea7521a-7df0-4174-8088-18a79f6289e7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.504488 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Attempting to bind port 58db0125-8848-46c5-a0eb-a70079090a22 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:53.505098 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Attempting to bind port 58db0125-8848-46c5-a0eb-a70079090a22 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '0195cb1d-3621-4f78-bead-37566cfcb3c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:53.505506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Attempting to bind port 58db0125-8848-46c5-a0eb-a70079090a22 on network 522c6690-944f-4247-91b9-f2e1df1754f5 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:53.526671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:53.527066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Checking segment: {'id': '0195cb1d-3621-4f78-bead-37566cfcb3c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:53.527481 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.527889 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Bound using segment: {'id': '0195cb1d-3621-4f78-bead-37566cfcb3c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:53.528372 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Bound port: 58db0125-8848-46c5-a0eb-a70079090a22, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0195cb1d-3621-4f78-bead-37566cfcb3c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:53.528774 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.532020 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-7cc613b8-f97f-4cbe-9251-d2dde582cc5c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] In _notify_port_updated(), no bound segment for port 9c5c4129-5e9b-45ea-a766-7353d2ee82a3 on network 62f6936a-4052-4c55-a4da-5b8b8be326f4 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:28:53.537618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de340624-a7d0-4d39-931d-141fee36111c None None] Pushing event updated for resources: {'Port': ['ID=0ab23af3-1805-4c63-a15b-b032f649ca20,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:53.542591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7cc613b8-f97f-4cbe-9251-d2dde582cc5c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:53.543267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7cc613b8-f97f-4cbe-9251-d2dde582cc5c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.544996 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7cc613b8-f97f-4cbe-9251-d2dde582cc5c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "PUT /v2.0/ports/9c5c4129-5e9b-45ea-a766-7353d2ee82a3 HTTP/1.1" status: 200 len: 818 time: 1.4394846 Dec 10 14:28:53.554059 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57300) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:53.562929 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ea7521a-7df0-4174-8088-18a79f6289e7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.569942 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-e9b085a0-e0b5-4630-9607-8d0706a5122c', 'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'project_id': '7a25938276dc428b9a5723e37d120269', 'fixed_ips': [{'subnet_id': '9af374b7-feb5-4523-a05d-c9651ea05ab3'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:53.569942 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.586335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52fb14d3-cbd8-46d5-bd78-0b2a0b1e3eff None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:53.593853 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b0166c5-8e7b-43e9-862b-02234422108a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:53.600786 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b0166c5-8e7b-43e9-862b-02234422108a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:53.602577 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1b0166c5-8e7b-43e9-862b-02234422108a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1669 time: 0.6917262 Dec 10 14:28:53.607044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 2001:db8:2::1 (152411ab-4991-469e-bd27-c8d29a909a0f/26e3d43e-96a1-4cc9-a6a1-d9e609028ad8/cbcc7a12-8783-47cd-9c2b-9efbf73dac97) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:53.609286 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57302) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:53.609881 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e999daa5-e09e-49e3-ba16-bef71351f68f req-50d48de1-9a18-4303-b663-75d990b49db7 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2238660 Dec 10 14:28:53.656317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ea7521a-7df0-4174-8088-18a79f6289e7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.675390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cc613b8-f97f-4cbe-9251-d2dde582cc5c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=9c5c4129-5e9b-45ea-a766-7353d2ee82a3,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:53.693888 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.703686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ea7521a-7df0-4174-8088-18a79f6289e7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3c3cb48c-536f-4b39-bee4-61d8ba6a28e0,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:53.716475 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port be101111-dc57-4a49-9754-8ff78b3190e3 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:53.716859 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.762101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ea7521a-7df0-4174-8088-18a79f6289e7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.764617 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1ea7521a-7df0-4174-8088-18a79f6289e7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.6199608 Dec 10 14:28:53.767274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57304) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:53.773487 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f0f0efb4-ede1-4047-a0a4-d5d3bd83751d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'security_group': {'name': 'tempest-secgroup-162736035'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:53.793126 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.817696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6a87f434-1f4e-42d1-8903-4e1935829e46 None None] Provisioning complete for port be101111-dc57-4a49-9754-8ff78b3190e3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:53.818022 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6a87f434-1f4e-42d1-8903-4e1935829e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.854543 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network 522c6690-944f-4247-91b9-f2e1df1754f5 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:53.870425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:53.870663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Subnet': ['ID=8bcb9694-fbbf-4a44-b94d-96729fcd88cb,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:53.877875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0f0efb4-ede1-4047-a0a4-d5d3bd83751d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.878952 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:53.879658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.884584 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] For port 58db0125-8848-46c5-a0eb-a70079090a22, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:53.889620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Checking segment: {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:53.889898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network hostable DHCP agents. Network: b44c5886-b77e-456d-b9b8-db5350758724, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:53.908216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=40c35da0-250b-4798-93cd-be113fc5d35a,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:53.956364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] For port 58db0125-8848-46c5-a0eb-a70079090a22, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=58db0125-8848-46c5-a0eb-a70079090a22,segment=NetworkSegment(0195cb1d-3621-4f78-bead-37566cfcb3c0),segment_id=0195cb1d-3621-4f78-bead-37566cfcb3c0)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:53.970785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0f0efb4-ede1-4047-a0a4-d5d3bd83751d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:53.998527 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Allocated IP 172.20.0.2 (e9b085a0-e0b5-4630-9607-8d0706a5122c/9af374b7-feb5-4523-a05d-c9651ea05ab3/c5a938d2-d8e5-424b-aeda-a7917721322a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:54.025994 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network b44c5886-b77e-456d-b9b8-db5350758724 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:54.026720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-6f7dc749-738a-42a3-9e27-d30ff48a900d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 263c0732-dcb6-4136-b1ce-24a8d9fc10ef {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:54.027085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6f7dc749-738a-42a3-9e27-d30ff48a900d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.069861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0f0efb4-ede1-4047-a0a4-d5d3bd83751d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.077071 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.103871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.116618 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.127542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f0efb4-ede1-4047-a0a4-d5d3bd83751d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'SecurityGroup': ['ID=90ff0443-2c15-427a-b443-4891d2756790,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:54.136064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, b44c5886-b77e-456d-b9b8-db5350758724) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:54.140422 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57306) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:54.150139 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d88c6da1-5116-4624-82ae-9906925dca8f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 2.5588970 Dec 10 14:28:54.154489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5d873b28-4564-4b26-83e1-03a5a552645d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 9c5c4129-5e9b-45ea-a766-7353d2ee82a3 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:54.154830 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5d873b28-4564-4b26-83e1-03a5a552645d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.179285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd356bbf-2256-4fa3-be4d-f5c0372b4039 None None] Network b44c5886-b77e-456d-b9b8-db5350758724 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:54.245841 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:54.246488 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.253300 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca301d0d-153a-4aa8-917e-d114b50e59c7 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:54.255469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca301d0d-153a-4aa8-917e-d114b50e59c7 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:54.257315 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca301d0d-153a-4aa8-917e-d114b50e59c7 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:54.259794 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca301d0d-153a-4aa8-917e-d114b50e59c7 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:54.261779 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca301d0d-153a-4aa8-917e-d114b50e59c7 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:54.263915 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ca301d0d-153a-4aa8-917e-d114b50e59c7 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.1217077 Dec 10 14:28:54.267716 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f0f0efb4-ede1-4047-a0a4-d5d3bd83751d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.269156 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f0f0efb4-ede1-4047-a0a4-d5d3bd83751d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.5007858 Dec 10 14:28:54.271217 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57308) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:54.271763 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57310) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:54.278818 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1155805624'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:54.288460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6f7dc749-738a-42a3-9e27-d30ff48a900d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.293363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-2086645783', 'security_groups': ['90ff0443-2c15-427a-b443-4891d2756790'], 'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '9af374b7-feb5-4523-a05d-c9651ea05ab3'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:54.320376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-6f7dc749-738a-42a3-9e27-d30ff48a900d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 263c0732-dcb6-4136-b1ce-24a8d9fc10ef owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:54.323255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a82da3-222e-4920-87e2-ae425453b630 None None] Pushing event updated for resources: {'Port': ['ID=58db0125-8848-46c5-a0eb-a70079090a22,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:54.332375 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5d873b28-4564-4b26-83e1-03a5a552645d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.353385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5d873b28-4564-4b26-83e1-03a5a552645d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 9c5c4129-5e9b-45ea-a766-7353d2ee82a3 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:54.362013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.415588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6a87f434-1f4e-42d1-8903-4e1935829e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.423405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-b44c5886-b77e-456d-b9b8-db5350758724', 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ips': [{'subnet_id': '8bcb9694-fbbf-4a44-b94d-96729fcd88cb'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:54.424882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.466001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=cbcc7a12-8783-47cd-9c2b-9efbf73dac97,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:54.482918 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 152411ab-4991-469e-bd27-c8d29a909a0f is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:54.509624 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port be101111-dc57-4a49-9754-8ff78b3190e3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=be101111-dc57-4a49-9754-8ff78b3190e3,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:54.521933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:54.528973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:54.531629 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:54.532186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.537335 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.571853 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 374, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:54.594124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.594840 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment be109a19-83c1-4b2e-9d79-a7e7c62fa19d of type vlan for network bf6294a7-4503-48e7-9758-15d28122dea9 Dec 10 14:28:54.617087 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebcd4160-eed9-4397-b90f-b0a616b1bd98 None None] Network 152411ab-4991-469e-bd27-c8d29a909a0f requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:54.660576 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.685617 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-13d56f6e-93dd-4d5e-b4fc-c1b3a01931dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.9316161 Dec 10 14:28:54.776531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.798036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 968ad944-9269-4599-a638-73d9c25aedbf up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:54.808546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc0af0a-fdb3-4f0c-8d92-b32982de3a23 req-15d1a027-94dd-4500-a6f6-46ece6a17a9b tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:54.810488 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9cc0af0a-fdb3-4f0c-8d92-b32982de3a23 req-15d1a027-94dd-4500-a6f6-46ece6a17a9b tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.0819998 Dec 10 14:28:54.812671 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.819866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:54.820757 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.824122 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:54.828097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5d873b28-4564-4b26-83e1-03a5a552645d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.855400 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5d873b28-4564-4b26-83e1-03a5a552645d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.865930 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5d873b28-4564-4b26-83e1-03a5a552645d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/9c5c4129-5e9b-45ea-a766-7353d2ee82a3 HTTP/1.1" status: 204 len: 168 time: 1.2900488 Dec 10 14:28:54.867902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57316) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:54.947900 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d873b28-4564-4b26-83e1-03a5a552645d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=9c5c4129-5e9b-45ea-a766-7353d2ee82a3,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:54.960739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:54.972790 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.022691 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port 136fe677-c56a-4da0-8652-0fe4f4d3056c yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:55.092190 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d12763e8-a397-48a9-89e1-835ac473ba86 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:55.099539 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d12763e8-a397-48a9-89e1-835ac473ba86 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.2158191 Dec 10 14:28:55.100405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57318) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:55.117866 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6f7dc749-738a-42a3-9e27-d30ff48a900d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.133482 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-6a87f434-1f4e-42d1-8903-4e1935829e46 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:55.133836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-6a87f434-1f4e-42d1-8903-4e1935829e46 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:55.143899 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9cc0af0a-fdb3-4f0c-8d92-b32982de3a23 req-d36a1e35-ee06-4d3f-a258-549094dca748 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1998997 Dec 10 14:28:55.150331 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.8774402 Dec 10 14:28:55.151046 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8df0839-c021-4704-aa23-3c5aa6862216 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=bf6294a7-4503-48e7-9758-15d28122dea9,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:55.153128 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57320) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:55.161759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=be101111-dc57-4a49-9754-8ff78b3190e3,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:55.170733 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.174006 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network bf6294a7-4503-48e7-9758-15d28122dea9 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:55.190048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6a9c8d99-50dd-4adf-8029-ac222cc52d4b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'New_network'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:55.195639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Allocated IP 172.20.0.18 (b44c5886-b77e-456d-b9b8-db5350758724/8bcb9694-fbbf-4a44-b94d-96729fcd88cb/ea1ccf81-23a5-41dd-8e9b-8ee0568b069e) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:55.265574 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.284284 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 968ad944-9269-4599-a638-73d9c25aedbf triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:55.285598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.298525 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-e70cbb73-6ec7-42c2-b722-f20e965a6ead tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:28:55.309763 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57322) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:55.314517 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e70cbb73-6ec7-42c2-b722-f20e965a6ead tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/9c5c4129-5e9b-45ea-a766-7353d2ee82a3 HTTP/1.1" status: 404 len: 333 time: 0.2085333 Dec 10 14:28:55.340507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1787553515'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:55.355215 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f7dc749-738a-42a3-9e27-d30ff48a900d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=263c0732-dcb6-4136-b1ce-24a8d9fc10ef,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:55.358642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57324) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:55.367241 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1143a7d4-e4c6-4c7c-b9f6-bae20faba952 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2078193994', 'description': 'tempest-secgroup-smoke-2078193994 description', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:55.386646 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6f7dc749-738a-42a3-9e27-d30ff48a900d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.394773 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6f7dc749-738a-42a3-9e27-d30ff48a900d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/263c0732-dcb6-4136-b1ce-24a8d9fc10ef HTTP/1.1" status: 204 len: 168 time: 1.7561846 Dec 10 14:28:55.398535 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57326) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:55.499789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c702edd1-1294-4a73-a8a3-0b4f8bc78d7a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:55.501522 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c702edd1-1294-4a73-a8a3-0b4f8bc78d7a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:55.507374 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c702edd1-1294-4a73-a8a3-0b4f8bc78d7a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1006205 Dec 10 14:28:55.507958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57328) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:55.629948 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:55.634776 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.637785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.3 (e9b085a0-e0b5-4630-9607-8d0706a5122c/9af374b7-feb5-4523-a05d-c9651ea05ab3/136fe677-c56a-4da0-8652-0fe4f4d3056c) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:55.660539 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Pushing event updated for resources: {'Port': ['ID=c5a938d2-d8e5-424b-aeda-a7917721322a,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:55.669865 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6a9c8d99-50dd-4adf-8029-ac222cc52d4b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.687197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-08478427-c541-4716-a464-27910681e80c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet e6318643-befa-43c7-9fa6-96dd2c2e2e70 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:28:55.691575 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-08478427-c541-4716-a464-27910681e80c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.735265 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:55.748617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:55.749035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-08478427-c541-4716-a464-27910681e80c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.752048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:55.756217 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] vlan segment allocate from pool success with {'vlan_id': 351, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:55.775355 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6a9c8d99-50dd-4adf-8029-ac222cc52d4b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.789577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.790063 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Added segment e5158ce0-9cf5-4f99-81b2-e66056474384 of type vlan for network 9bf91f32-9979-4b8d-97d8-65691082eab5 Dec 10 14:28:55.813157 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1143a7d4-e4c6-4c7c-b9f6-bae20faba952 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.880961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Could not find standard attr ID for object 263c0732-dcb6-4136-b1ce-24a8d9fc10ef. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:28:55.884313 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Attempting to bind port c5a938d2-d8e5-424b-aeda-a7917721322a on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:55.884696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Attempting to bind port c5a938d2-d8e5-424b-aeda-a7917721322a by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '8884a3d8-3d3b-4c8a-a374-8f994bb64e01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:55.885183 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Attempting to bind port c5a938d2-d8e5-424b-aeda-a7917721322a on network e9b085a0-e0b5-4630-9607-8d0706a5122c {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:55.897116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-6a9c8d99-50dd-4adf-8029-ac222cc52d4b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network bf6294a7-4503-48e7-9758-15d28122dea9 is not hosted by any dhcp agent {{(pid=103811) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 10 14:28:55.898163 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:55.898554 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Checking segment: {'id': '8884a3d8-3d3b-4c8a-a374-8f994bb64e01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:55.898962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.899360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Bound using segment: {'id': '8884a3d8-3d3b-4c8a-a374-8f994bb64e01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:55.899873 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Bound port: c5a938d2-d8e5-424b-aeda-a7917721322a, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8884a3d8-3d3b-4c8a-a374-8f994bb64e01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:55.900427 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.902922 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a9c8d99-50dd-4adf-8029-ac222cc52d4b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:55.903698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6a9c8d99-50dd-4adf-8029-ac222cc52d4b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:55.905262 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6a9c8d99-50dd-4adf-8029-ac222cc52d4b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "PUT /v2.0/networks/bf6294a7-4503-48e7-9758-15d28122dea9 HTTP/1.1" status: 200 len: 723 time: 0.7406023 Dec 10 14:28:55.929543 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57330) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:55.942853 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': 'bf6294a7-4503-48e7-9758-15d28122dea9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:55.955340 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Provisioning complete for port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:55.955723 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.064622 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.091789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-08478427-c541-4716-a464-27910681e80c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.092718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.115923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.115923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9c8d99-50dd-4adf-8029-ac222cc52d4b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=bf6294a7-4503-48e7-9758-15d28122dea9,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:56.122692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:56.124849 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network bf6294a7-4503-48e7-9758-15d28122dea9 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:56.189775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.289867 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Provisioning complete for port 0ab23af3-1805-4c63-a15b-b032f649ca20 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:56.295023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.295303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.295419 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.296211 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.305513 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] For port c5a938d2-d8e5-424b-aeda-a7917721322a, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:56.309077 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb463d71-1b36-4a0f-80e6-f60496c85753 None None] Network 522c6690-944f-4247-91b9-f2e1df1754f5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:56.311809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0ab23af3-1805-4c63-a15b-b032f649ca20 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:56.327755 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.334112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:56.335012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.364678 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.448966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91f23b3-678e-4e55-9f70-41194a1f9edd req-d28e3b94-0793-4515-9291-b84d869ad858 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:56.449674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] For port c5a938d2-d8e5-424b-aeda-a7917721322a, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a938d2-d8e5-424b-aeda-a7917721322a,segment=NetworkSegment(8884a3d8-3d3b-4c8a-a374-8f994bb64e01),segment_id=8884a3d8-3d3b-4c8a-a374-8f994bb64e01)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:56.450753 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b91f23b3-678e-4e55-9f70-41194a1f9edd req-d28e3b94-0793-4515-9291-b84d869ad858 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.1606481 Dec 10 14:28:56.460169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=cbcc7a12-8783-47cd-9c2b-9efbf73dac97,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:56.472297 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Network': ['ID=9bf91f32-9979-4b8d-97d8-65691082eab5,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:56.482875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:56.489952 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Network b44c5886-b77e-456d-b9b8-db5350758724 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:56.493565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1143a7d4-e4c6-4c7c-b9f6-bae20faba952 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.496222 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:56.499627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:56.502767 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=136fe677-c56a-4da0-8652-0fe4f4d3056c,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:56.508017 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:56.513172 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Pushing event updated for resources: {'Port': ['ID=ea1ccf81-23a5-41dd-8e9b-8ee0568b069e,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:56.513933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:56.518043 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:28:56.519442 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.522735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 9bf91f32-9979-4b8d-97d8-65691082eab5 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:56.573868 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-08478427-c541-4716-a464-27910681e80c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.574083 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b91f23b3-678e-4e55-9f70-41194a1f9edd req-1d315d0f-0d0e-415e-8f13-8053a35f5d20 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1132834 Dec 10 14:28:56.592440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:56.592440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.599664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.617697 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1143a7d4-e4c6-4c7c-b9f6-bae20faba952 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.620924 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-682d6e45-9367-4596-82c3-d9dd7a3477d2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.2909589 Dec 10 14:28:56.628498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network 152411ab-4991-469e-bd27-c8d29a909a0f is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:56.628641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57334) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:56.631560 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:56.636130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08478427-c541-4716-a464-27910681e80c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=e6318643-befa-43c7-9fa6-96dd2c2e2e70,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:56.641493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-08478427-c541-4716-a464-27910681e80c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.645636 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-08478427-c541-4716-a464-27910681e80c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/e6318643-befa-43c7-9fa6-96dd2c2e2e70 HTTP/1.1" status: 204 len: 168 time: 1.1334777 Dec 10 14:28:56.650292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57336) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:56.661644 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:56.679557 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f99284b-fc8a-4eed-9fa9-7cb53d1efe1f None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:56.690352 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a092477d-8936-455d-b6c9-9c177a12ba92 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.4161587 Dec 10 14:28:56.698744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57338) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:56.706356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d924663e-c0ce-4795-816d-b1e249e6e6d7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:56.745944 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e601feed-b22f-4b45-9b8f-5e98476e8041 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0897851 Dec 10 14:28:56.777594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57340) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:56.786298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:56.858243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1143a7d4-e4c6-4c7c-b9f6-bae20faba952 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.864769 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1143a7d4-e4c6-4c7c-b9f6-bae20faba952 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 1.4996216 Dec 10 14:28:56.864769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57342) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:56.868811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-eebbd663-37e3-45a2-8ce0-3125252fd3ad tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'a7754821-56c9-4342-8d14-0e36a6c62482', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:56.877050 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1143a7d4-e4c6-4c7c-b9f6-bae20faba952 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a7754821-56c9-4342-8d14-0e36a6c62482,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:56.904361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:56.911652 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.934477 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0ab23af3-1805-4c63-a15b-b032f649ca20 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:56.935375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:56.951901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Attempting to bind port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:28:56.952278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Attempting to bind port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:28:56.952645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Attempting to bind port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e on network b44c5886-b77e-456d-b9b8-db5350758724 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:28:56.959256 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dcab969-f41e-4ac5-848d-ea9e350e0c79 None None] Pushing event updated for resources: {'Port': ['ID=c5a938d2-d8e5-424b-aeda-a7917721322a,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:57.019701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.049335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:28:57.049767 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Checking segment: {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:57.050176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.050688 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Bound using segment: {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:28:57.051069 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Bound port: ea1ccf81-23a5-41dd-8e9b-8ee0568b069e, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:28:57.052023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.126343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:28:57.179092 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] For port 0ab23af3-1805-4c63-a15b-b032f649ca20, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0ab23af3-1805-4c63-a15b-b032f649ca20,segment=NetworkSegment(877fce5e-0213-4db9-862b-58436fd1cb89),segment_id=877fce5e-0213-4db9-862b-58436fd1cb89)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:57.206825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.259032 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.296384 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] For port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:28:57.313865 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.335037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.351739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d924663e-c0ce-4795-816d-b1e249e6e6d7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:57.356546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d924663e-c0ce-4795-816d-b1e249e6e6d7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.380176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=d2b69d21-837d-469a-bf15-17a45151604a,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:57.391168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] For port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ea1ccf81-23a5-41dd-8e9b-8ee0568b069e,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:28:57.393693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3b19f44-f7f2-4e2b-87fd-df7e7d89cfaf None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:28:57.452380 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de815fef-bba4-44cc-bcf0-0bbce6f103fb None None] Update dhcp port {'port': {'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5', 'fixed_ips': [{'subnet_id': '2c8fca0e-c54d-4804-9947-80f97a9597e9', 'ip_address': '2001:db8::2'}, {'subnet_id': '40c35da0-250b-4798-93cd-be113fc5d35a'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': '58db0125-8848-46c5-a0eb-a70079090a22'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:28:57.483182 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Provisioning complete for port be101111-dc57-4a49-9754-8ff78b3190e3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:57.483556 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.515797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.561859 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7d61f2-b316-4a99-860c-9ad6711f0ba7 None None] Pushing event updated for resources: {'Port': ['ID=0ab23af3-1805-4c63-a15b-b032f649ca20,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:57.569316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de815fef-bba4-44cc-bcf0-0bbce6f103fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.637990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:28:57.638360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:28:57.688202 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eebbd663-37e3-45a2-8ce0-3125252fd3ad tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.716195 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b3b19f44-f7f2-4e2b-87fd-df7e7d89cfaf None None] Deleting port be101111-dc57-4a49-9754-8ff78b3190e3 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:28:57.716803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b3b19f44-f7f2-4e2b-87fd-df7e7d89cfaf None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.722360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091032eb-6338-40b4-9a90-c8e229f814c0 None None] Pushing event updated for resources: {'Port': ['ID=ea1ccf81-23a5-41dd-8e9b-8ee0568b069e,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:57.747898 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=e4d6cc5b-98af-43cc-ad59-a1c1bffc23c0,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:57.750472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:28:57.762839 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5f343f69-c727-499e-b046-f31233d43365 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.0071445 Dec 10 14:28:57.763672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57346) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:57.771934 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-188590143'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:57.799300 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking segment: {'id': 'be109a19-83c1-4b2e-9d79-a7e7c62fa19d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'bf6294a7-4503-48e7-9758-15d28122dea9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:57.799692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network hostable DHCP agents. Network: bf6294a7-4503-48e7-9758-15d28122dea9, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:57.827241 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eebbd663-37e3-45a2-8ce0-3125252fd3ad tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.829804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:28:57.889039 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:57.893126 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.901820 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:57.906186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:57.988493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] vlan segment allocate from pool success with {'vlan_id': 395, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:28:57.991425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network bf6294a7-4503-48e7-9758-15d28122dea9 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:57.993337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eebbd663-37e3-45a2-8ce0-3125252fd3ad tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.027734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eebbd663-37e3-45a2-8ce0-3125252fd3ad tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=66993210-d6a5-4837-bdfb-44c11e20f6b3,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:58.030813 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.031163 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added segment f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a of type vlan for network e900a180-cce3-4df7-9e0d-298a290873ba Dec 10 14:28:58.046970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Checking segment: {'id': 'e5158ce0-9cf5-4f99-81b2-e66056474384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:28:58.047335 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network hostable DHCP agents. Network: 9bf91f32-9979-4b8d-97d8-65691082eab5, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:28:58.082264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cc5c870-34ee-433b-884b-1f38a62a786f req-bd3c7700-2719-43c9-95ff-612d2ea4aa5f tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:58.090468 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8cc5c870-34ee-433b-884b-1f38a62a786f req-bd3c7700-2719-43c9-95ff-612d2ea4aa5f tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.2070205 Dec 10 14:28:58.099672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.125298 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.ipam_backend_mixin [None req-d924663e-c0ce-4795-816d-b1e249e6e6d7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 9af374b7-feb5-4523-a05d-c9651ea05ab3 (CIDR: 172.20.0.0/28) Dec 10 14:28:58.136734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eebbd663-37e3-45a2-8ce0-3125252fd3ad tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.140377 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-eebbd663-37e3-45a2-8ce0-3125252fd3ad tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.2727814 Dec 10 14:28:58.140377 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, bf6294a7-4503-48e7-9758-15d28122dea9) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:58.145922 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57348) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:58.153735 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:58.156223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.172885 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-d924663e-c0ce-4795-816d-b1e249e6e6d7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:28:58.174735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d924663e-c0ce-4795-816d-b1e249e6e6d7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:58.196860 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 9bf91f32-9979-4b8d-97d8-65691082eab5 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:28:58.197065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4980ee83-c657-4953-8d23-dadf8ffd4fe6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'a7754821-56c9-4342-8d14-0e36a6c62482', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:58.207373 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35072b97-0a2a-47b2-a4e0-824df5418010 None None] Network bf6294a7-4503-48e7-9758-15d28122dea9 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:58.208823 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8cc5c870-34ee-433b-884b-1f38a62a786f req-202f7f67-d910-4778-b7af-c20295134e6a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1174676 Dec 10 14:28:58.211618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 9bf91f32-9979-4b8d-97d8-65691082eab5) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:58.216610 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:58.217229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.225229 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.233769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:58.236276 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.263183 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d924663e-c0ce-4795-816d-b1e249e6e6d7 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.5613365 Dec 10 14:28:58.264215 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57350) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:58.273180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:58.276516 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9082e0cd-2bdc-4725-aced-e5c2b14ea42e None None] Network 9bf91f32-9979-4b8d-97d8-65691082eab5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:58.283938 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-caa83014-ad06-4f31-aff5-07d14c76d956 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.3497899 Dec 10 14:28:58.301070 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57352) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:58.307653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-afb0a503-d98a-42d6-b759-7313ea5c4a2f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:58.353396 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:28:58.354062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:28:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:28:58.371899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Network': ['ID=e900a180-cce3-4df7-9e0d-298a290873ba,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:58.404828 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b3b19f44-f7f2-4e2b-87fd-df7e7d89cfaf None None] For port be101111-dc57-4a49-9754-8ff78b3190e3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=be101111-dc57-4a49-9754-8ff78b3190e3,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:58.405245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b3b19f44-f7f2-4e2b-87fd-df7e7d89cfaf None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.451998 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4980ee83-c657-4953-8d23-dadf8ffd4fe6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.458232 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network e900a180-cce3-4df7-9e0d-298a290873ba details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:28:58.530683 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c00cceba-b1bc-459a-b518-c1fed767869a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.7628002 Dec 10 14:28:58.530907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57354) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:58.532568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4980ee83-c657-4953-8d23-dadf8ffd4fe6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.536285 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'subnet': {'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'cidr': '2001:db8:3::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:3::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:58.547308 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b3b19f44-f7f2-4e2b-87fd-df7e7d89cfaf None None] Calling delete_port for be101111-dc57-4a49-9754-8ff78b3190e3 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:28:58.552237 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device be101111-dc57-4a49-9754-8ff78b3190e3 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:58.566204 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c633371c-65b2-4962-a8c3-d310484a4908 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.9393361 Dec 10 14:28:58.567318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.569144 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57356) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:58.574550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4319d4a8-ef65-4bef-8d0b-34b1c922cca5 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:58.607823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-afb0a503-d98a-42d6-b759-7313ea5c4a2f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-126683541'] for subnet, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.700686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4980ee83-c657-4953-8d23-dadf8ffd4fe6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.760427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4980ee83-c657-4953-8d23-dadf8ffd4fe6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4870f9e-7fdd-4d9f-843f-e7810e165d00,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:58.786207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:58.794741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9c9075b3-cc07-4aef-a04c-27d151f7a362 None None] Provisioning complete for port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:58.795302 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9c9075b3-cc07-4aef-a04c-27d151f7a362 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.798468 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-de815fef-bba4-44cc-bcf0-0bbce6f103fb None None] Allocated IP 172.20.0.1 (522c6690-944f-4247-91b9-f2e1df1754f5/40c35da0-250b-4798-93cd-be113fc5d35a/58db0125-8848-46c5-a0eb-a70079090a22) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:58.799538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:58.810781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:28:58.813618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:58.814220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.833537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:58.837112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.840089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=f32deff0-5335-4e4e-a47e-fd16649a6044,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:58.926011 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4980ee83-c657-4953-8d23-dadf8ffd4fe6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.928975 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4980ee83-c657-4953-8d23-dadf8ffd4fe6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.7381160 Dec 10 14:28:58.932542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57358) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:58.942307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5331be17-b640-4233-887b-4aae7bf9d7ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'a7754821-56c9-4342-8d14-0e36a6c62482', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:58.942744 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-38c2c404-ee6f-497b-90fe-347e0b911b81 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 2.1643479 Dec 10 14:28:58.949047 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57360) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:58.954077 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'name': 'tempest-NetworksTestDHCPv6-1577089563'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:58.962719 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-bf6294a7-4503-48e7-9758-15d28122dea9', 'network_id': 'bf6294a7-4503-48e7-9758-15d28122dea9', 'project_id': '243ec7ec23134148a44eb888e6040f25', 'fixed_ips': [{'subnet_id': 'e4d6cc5b-98af-43cc-ad59-a1c1bffc23c0'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:58.963772 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:58.995196 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-9bf91f32-9979-4b8d-97d8-65691082eab5', 'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5', 'project_id': 'cc793beea85f4cf887a3485aad20d8e7', 'fixed_ips': [{'subnet_id': 'd2b69d21-837d-469a-bf15-17a45151604a'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:28:58.996113 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.053255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-9c9075b3-cc07-4aef-a04c-27d151f7a362 None None] Port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:28:59.089650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4319d4a8-ef65-4bef-8d0b-34b1c922cca5 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:59.096276 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4319d4a8-ef65-4bef-8d0b-34b1c922cca5 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.210705 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.ipam_backend_mixin [None req-4319d4a8-ef65-4bef-8d0b-34b1c922cca5 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet d2b69d21-837d-469a-bf15-17a45151604a (CIDR: 2001:db8::/64) Dec 10 14:28:59.214583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-afb0a503-d98a-42d6-b759-7313ea5c4a2f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8745562688988', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-126567472'] for subnet, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.232274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port be101111-dc57-4a49-9754-8ff78b3190e3 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:59.232719 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.243681 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce9bd5b4-e5ca-41ad-a3f0-96bd7406d3a8 None None] Network b44c5886-b77e-456d-b9b8-db5350758724 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:59.247166 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9c9075b3-cc07-4aef-a04c-27d151f7a362 None None] Provisioning complete for port 58db0125-8848-46c5-a0eb-a70079090a22 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:28:59.247166 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9c9075b3-cc07-4aef-a04c-27d151f7a362 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.254959 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-4319d4a8-ef65-4bef-8d0b-34b1c922cca5 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:28:59.255416 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4319d4a8-ef65-4bef-8d0b-34b1c922cca5 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:28:59.313444 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afb0a503-d98a-42d6-b759-7313ea5c4a2f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:59.314066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-afb0a503-d98a-42d6-b759-7313ea5c4a2f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.315310 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-afb0a503-d98a-42d6-b759-7313ea5c4a2f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "PUT /v2.0/subnets/e4d6cc5b-98af-43cc-ad59-a1c1bffc23c0 HTTP/1.1" status: 200 len: 826 time: 1.0126543 Dec 10 14:28:59.316010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Made reservation on behalf of e0ad36cdee2c48fba74cb6486de7c888 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:59.319045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57364) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:59.321196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.395431 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5331be17-b640-4233-887b-4aae7bf9d7ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.417976 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b3b19f44-f7f2-4e2b-87fd-df7e7d89cfaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.439543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb0a503-d98a-42d6-b759-7313ea5c4a2f tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=e4d6cc5b-98af-43cc-ad59-a1c1bffc23c0,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:59.475096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2145af8b-3202-4ad0-a5a0-43f46e9dd8ab req-2ed96890-3681-4bb2-8db0-98ca5673a1a0 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:59.478183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.483461 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2145af8b-3202-4ad0-a5a0-43f46e9dd8ab req-2ed96890-3681-4bb2-8db0-98ca5673a1a0 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.1702006 Dec 10 14:28:59.490381 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-de815fef-bba4-44cc-bcf0-0bbce6f103fb None None] For port 58db0125-8848-46c5-a0eb-a70079090a22, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=58db0125-8848-46c5-a0eb-a70079090a22,segment=NetworkSegment(0195cb1d-3621-4f78-bead-37566cfcb3c0),segment_id=0195cb1d-3621-4f78-bead-37566cfcb3c0)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:28:59.494985 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.497236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5331be17-b640-4233-887b-4aae7bf9d7ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.507941 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3b19f44-f7f2-4e2b-87fd-df7e7d89cfaf None None] No DVR routers for this DVR port be101111-dc57-4a49-9754-8ff78b3190e3 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:28:59.549076 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.577210 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4319d4a8-ef65-4bef-8d0b-34b1c922cca5 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.0068870 Dec 10 14:28:59.582566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57368) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:59.583063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:28:59.585815 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51ce7422-7651-4f0b-8fb1-6b7e95d6e0e9 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:59.589210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:59.597227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Could not find standard attr ID for object be101111-dc57-4a49-9754-8ff78b3190e3. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:28:59.601518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:28:59.619845 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5331be17-b640-4233-887b-4aae7bf9d7ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.632957 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b19f44-f7f2-4e2b-87fd-df7e7d89cfaf None None] Pushing event deleted for resources: {'Port': ['ID=be101111-dc57-4a49-9754-8ff78b3190e3,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:59.633191 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:28:59.633191 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.656173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea5dcd0f-5ba9-40c0-b455-ef17b2a99f1d None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:28:59.678774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5331be17-b640-4233-887b-4aae7bf9d7ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=40c2ab67-0cf0-47c4-85e2-664e0a5a75b2,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:59.680994 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No ports have port_id starting with be101111-dc57-4a49-9754-8ff78b3190e3 Dec 10 14:28:59.693010 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2145af8b-3202-4ad0-a5a0-43f46e9dd8ab req-ac6fd016-0b37-4606-a2a9-19c5fbaf2133 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2066493 Dec 10 14:28:59.702129 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=0ae340f0-e5b5-4d36-a2da-9c7736d1150e,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:28:59.769459 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:28:59.773639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.795254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port f9f8f466-5aa0-40a8-9f77-cfb52db44021 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:28:59.850917 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5331be17-b640-4233-887b-4aae7bf9d7ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.852487 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5331be17-b640-4233-887b-4aae7bf9d7ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9174602 Dec 10 14:28:59.855695 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57370) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:59.860733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1b9c7ce5-a1b2-4c95-8b60-798914cca83a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'a7754821-56c9-4342-8d14-0e36a6c62482', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:59.888962 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4034a90e-c81f-4eb8-b226-642d6716331f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.6240613 Dec 10 14:28:59.890005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.891859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57372) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:28:59.899181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1931710643', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '0ae340f0-e5b5-4d36-a2da-9c7736d1150e'}], 'security_groups': ['3c3cb48c-536f-4b39-bee4-61d8ba6a28e0']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:28:59.923775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 58db0125-8848-46c5-a0eb-a70079090a22 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:28:59.953301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de815fef-bba4-44cc-bcf0-0bbce6f103fb None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:28:59.974705 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::3c7 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/f32deff0-5335-4e4e-a47e-fd16649a6044/f9f8f466-5aa0-40a8-9f77-cfb52db44021) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:28:59.992963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Subnet': ['ID=c0a6adbb-fcb5-45e3-859f-c62d695f545d,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:00.015054 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Checking segment: {'id': 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:00.015424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network hostable DHCP agents. Network: e900a180-cce3-4df7-9e0d-298a290873ba, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:29:00.030312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:00.030312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.037656 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Allocated IP 2001:db8::2 (bf6294a7-4503-48e7-9758-15d28122dea9/e4d6cc5b-98af-43cc-ad59-a1c1bffc23c0/fc65a73b-6f65-48cf-a023-6893470513e5) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:00.091321 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Allocated IP 2001:db8::2 (9bf91f32-9979-4b8d-97d8-65691082eab5/d2b69d21-837d-469a-bf15-17a45151604a/ce9ed0f4-a437-4778-b175-56dfce2ecd93) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:00.111348 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-de815fef-bba4-44cc-bcf0-0bbce6f103fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.147963 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b9c7ce5-a1b2-4c95-8b60-798914cca83a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.153524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network e900a180-cce3-4df7-9e0d-298a290873ba is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:29:00.194669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.234100 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.244260 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, e900a180-cce3-4df7-9e0d-298a290873ba) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:00.253593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:00.253593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.290479 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9c9075b3-cc07-4aef-a04c-27d151f7a362 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.302408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b9c7ce5-a1b2-4c95-8b60-798914cca83a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.305723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.315092 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5cd0c13d-4647-4c44-8ba5-7f24f76eaeba None None] Network e900a180-cce3-4df7-9e0d-298a290873ba requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:00.374702 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cddcc13e-4d53-4996-a15e-ac55adcdf5d9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.8428788 Dec 10 14:29:00.378186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57376) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:00.400624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b9c7ce5-a1b2-4c95-8b60-798914cca83a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.414739 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': 'f32deff0-5335-4e4e-a47e-fd16649a6044'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:00.415679 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.448134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:00.449331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b9c7ce5-a1b2-4c95-8b60-798914cca83a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ffcb2288-2e02-4832-9655-e858d9263153,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:00.462517 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:00.504015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:00.511113 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:00.512897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.532622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=f9f8f466-5aa0-40a8-9f77-cfb52db44021,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:00.560638 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b9c7ce5-a1b2-4c95-8b60-798914cca83a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.565331 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1b9c7ce5-a1b2-4c95-8b60-798914cca83a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.7055020 Dec 10 14:29:00.565666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:28:54Z', 'revision_number': 4, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:28:55Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:00.570683 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57378) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:00.581650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a926bb5c-cc93-40fb-ba83-489db1d4cc0d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'a7754821-56c9-4342-8d14-0e36a6c62482', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:00.585457 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 58db0125-8848-46c5-a0eb-a70079090a22 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:00.586013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.629934 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de815fef-bba4-44cc-bcf0-0bbce6f103fb None None] Pushing event updated for resources: {'Port': ['ID=58db0125-8848-46c5-a0eb-a70079090a22,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:00.648355 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9c9075b3-cc07-4aef-a04c-27d151f7a362 None None] For port 58db0125-8848-46c5-a0eb-a70079090a22, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=58db0125-8848-46c5-a0eb-a70079090a22,segment=NetworkSegment(0195cb1d-3621-4f78-bead-37566cfcb3c0),segment_id=0195cb1d-3621-4f78-bead-37566cfcb3c0)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:00.674427 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:00.674866 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Updating router 84410bb0-960a-4ef0-a5c1-72cde49aba0f port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:29:00.681047 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-23e1c535-4a2e-45b2-9537-2a15c5a76eeb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 1.7309194 Dec 10 14:29:00.683816 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57380) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:00.799069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.810279 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9c9075b3-cc07-4aef-a04c-27d151f7a362 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.900023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 9bf91f32-9979-4b8d-97d8-65691082eab5 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:00.908369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:00.917411 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:00.918288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.936139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:00.948698 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=d49f8028-c2be-45ef-af9f-c0f8f1e82091,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:00.979981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Delete allocated IP 172.20.0.3 (e9b085a0-e0b5-4630-9607-8d0706a5122c/9af374b7-feb5-4523-a05d-c9651ea05ab3) {{(pid=103810) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 10 14:29:00.985718 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.securitygroups_db [None req-a926bb5c-cc93-40fb-ba83-489db1d4cc0d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:29:00.990583 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.27 (e9b085a0-e0b5-4630-9607-8d0706a5122c/0ae340f0-e5b5-4d36-a2da-9c7736d1150e/136fe677-c56a-4da0-8652-0fe4f4d3056c) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:01.018890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-e900a180-cce3-4df7-9e0d-298a290873ba', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:01.019658 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.068660 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4910b5a3-2879-4646-9219-1f52cce154a6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.4856079 Dec 10 14:29:01.070435 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a926bb5c-cc93-40fb-ba83-489db1d4cc0d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.073217 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57384) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:01.078594 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5', 'fixed_ips': [{'subnet_id': 'd2b69d21-837d-469a-bf15-17a45151604a'}, {'subnet_id': 'd49f8028-c2be-45ef-af9f-c0f8f1e82091'}], 'name': 'tempest-PortsIpV6TestJSON-1109605859'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:01.125684 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.158488 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-635f48e5-ab16-44b6-8088-2dcb72a47be9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:01.161458 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-635f48e5-ab16-44b6-8088-2dcb72a47be9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 930 time: 0.4748340 Dec 10 14:29:01.165264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57386) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:01.192798 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f4dcf82-7741-441d-9e03-990ac65aa7c4 None None] Update dhcp port {'port': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'fixed_ips': [{'subnet_id': '9af374b7-feb5-4523-a05d-c9651ea05ab3', 'ip_address': '172.20.0.2'}, {'subnet_id': '0ae340f0-e5b5-4d36-a2da-9c7736d1150e'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'c5a938d2-d8e5-424b-aeda-a7917721322a'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:29:01.195784 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.208109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9075b3-cc07-4aef-a04c-27d151f7a362 None None] Pushing event updated for resources: {'Port': ['ID=58db0125-8848-46c5-a0eb-a70079090a22,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:01.220244 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:01.220630 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.222256 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.279264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a926bb5c-cc93-40fb-ba83-489db1d4cc0d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.282007 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.287904 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.331659 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6d03a8-647c-45d4-b3c3-c58262773086 req-71790a9a-6724-44b8-b279-a489289dfbc1 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:01.333884 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2b6d03a8-647c-45d4-b3c3-c58262773086 req-71790a9a-6724-44b8-b279-a489289dfbc1 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.3531988 Dec 10 14:29:01.345953 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.350530 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/f32deff0-5335-4e4e-a47e-fd16649a6044/ca498c99-21ce-4498-b4f1-a08eaa4cef74) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:01.364308 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.366171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67675900-d9be-4894-9116-58abba6887e5 None None] Network 522c6690-944f-4247-91b9-f2e1df1754f5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:01.412465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a926bb5c-cc93-40fb-ba83-489db1d4cc0d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.440321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.443539 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.484197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=e4d6cc5b-98af-43cc-ad59-a1c1bffc23c0,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:01.484462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a926bb5c-cc93-40fb-ba83-489db1d4cc0d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=95c76c50-6473-4709-8f32-741d4cd95ac1,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:01.486150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:01.501093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f4dcf82-7741-441d-9e03-990ac65aa7c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.567709 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a926bb5c-cc93-40fb-ba83-489db1d4cc0d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.568815 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a926bb5c-cc93-40fb-ba83-489db1d4cc0d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.9955359 Dec 10 14:29:01.574771 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57388) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:01.583955 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2b6d03a8-647c-45d4-b3c3-c58262773086 req-e29ab348-e8b2-4d95-a7ed-e91065585b94 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2378955 Dec 10 14:29:01.589385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-00b8afe5-c0ce-4868-8c11-8d1c28982139 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'a7754821-56c9-4342-8d14-0e36a6c62482', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:01.611433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Network bf6294a7-4503-48e7-9758-15d28122dea9 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:01.612780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Network 9bf91f32-9979-4b8d-97d8-65691082eab5 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:01.656676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-2c64bbb5-4e15-47c9-a2d7-1e3fb92bde16 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port f9f8f466-5aa0-40a8-9f77-cfb52db44021 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:01.656676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c64bbb5-4e15-47c9-a2d7-1e3fb92bde16 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.671650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.751305 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:01.782625 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.securitygroups_db [None req-00b8afe5-c0ce-4868-8c11-8d1c28982139 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:29:01.789779 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c64bbb5-4e15-47c9-a2d7-1e3fb92bde16 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.798254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00b8afe5-c0ce-4868-8c11-8d1c28982139 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.814257 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-2c64bbb5-4e15-47c9-a2d7-1e3fb92bde16 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for f9f8f466-5aa0-40a8-9f77-cfb52db44021 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:01.884677 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=136fe677-c56a-4da0-8652-0fe4f4d3056c,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:01.890588 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:01.942524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:01.945274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:01.948009 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:01.950465 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:01.965240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0ab23af3-1805-4c63-a15b-b032f649ca20 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:01.996475 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bf6294a7-4503-48e7-9758-15d28122dea9']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:02.018524 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'be109a19-83c1-4b2e-9d79-a7e7c62fa19d') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:02.018756 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Pushing event updated for resources: {'Port': ['ID=fc65a73b-6f65-48cf-a023-6893470513e5,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:02.018873 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'be109a19-83c1-4b2e-9d79-a7e7c62fa19d') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:02.024092 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] In _notify_port_updated(), no bound segment for port 136fe677-c56a-4da0-8652-0fe4f4d3056c on network e9b085a0-e0b5-4630-9607-8d0706a5122c {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:29:02.030524 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:02.030756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.035067 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-281e278e-42d8-40cc-96e9-9ca7b7e04d6d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "PUT /v2.0/ports/136fe677-c56a-4da0-8652-0fe4f4d3056c HTTP/1.1" status: 200 len: 921 time: 2.1390271 Dec 10 14:29:02.041825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57390) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:02.084273 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.162079 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.175094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 374 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:02.175505 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:02.180531 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:02.275904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Allocated IP 2001:db8:3::2 (e900a180-cce3-4df7-9e0d-298a290873ba/c0a6adbb-fcb5-45e3-859f-c62d695f545d/3790b372-089f-4aaa-a0cd-caa0a4231384) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:02.289167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00b8afe5-c0ce-4868-8c11-8d1c28982139 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.300866 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9e714f88-71db-4ac0-b06b-eedbfadb479e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port 136fe677-c56a-4da0-8652-0fe4f4d3056c {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:02.303913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e714f88-71db-4ac0-b06b-eedbfadb479e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.376378 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:29:02.376378 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:29:02.376378 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': 'bf6294a7-4503-48e7-9758-15d28122dea9'}] Dec 10 14:29:02.376378 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:29:02.376918 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:29:02.387383 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00b8afe5-c0ce-4868-8c11-8d1c28982139 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.388784 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::b4 (9bf91f32-9979-4b8d-97d8-65691082eab5/d2b69d21-837d-469a-bf15-17a45151604a/8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:02.401614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8:0:1::2fc (9bf91f32-9979-4b8d-97d8-65691082eab5/d49f8028-c2be-45ef-af9f-c0f8f1e82091/8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:02.408994 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00b8afe5-c0ce-4868-8c11-8d1c28982139 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3b7d07f1-d5b6-41a4-9fd6-6e3aa2a9c321,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:02.430929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Pushing event updated for resources: {'Port': ['ID=ce9ed0f4-a437-4778-b175-56dfce2ecd93,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:02.451858 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e714f88-71db-4ac0-b06b-eedbfadb479e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.467894 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c64bbb5-4e15-47c9-a2d7-1e3fb92bde16 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.473488 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Attempting to bind port fc65a73b-6f65-48cf-a023-6893470513e5 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:02.473874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Attempting to bind port fc65a73b-6f65-48cf-a023-6893470513e5 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'be109a19-83c1-4b2e-9d79-a7e7c62fa19d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'bf6294a7-4503-48e7-9758-15d28122dea9'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:02.474240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Attempting to bind port fc65a73b-6f65-48cf-a023-6893470513e5 on network bf6294a7-4503-48e7-9758-15d28122dea9 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:02.475915 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9e714f88-71db-4ac0-b06b-eedbfadb479e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for 136fe677-c56a-4da0-8652-0fe4f4d3056c owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:02.477521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Attempting to bind port ce9ed0f4-a437-4778-b175-56dfce2ecd93 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:02.477521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Attempting to bind port ce9ed0f4-a437-4778-b175-56dfce2ecd93 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'e5158ce0-9cf5-4f99-81b2-e66056474384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:02.477521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Attempting to bind port ce9ed0f4-a437-4778-b175-56dfce2ecd93 on network 9bf91f32-9979-4b8d-97d8-65691082eab5 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:02.502453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c64bbb5-4e15-47c9-a2d7-1e3fb92bde16 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=f9f8f466-5aa0-40a8-9f77-cfb52db44021,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:02.529527 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-00b8afe5-c0ce-4868-8c11-8d1c28982139 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.541136 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.545050 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-00b8afe5-c0ce-4868-8c11-8d1c28982139 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.9667661 Dec 10 14:29:02.546691 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c64bbb5-4e15-47c9-a2d7-1e3fb92bde16 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.550185 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2c64bbb5-4e15-47c9-a2d7-1e3fb92bde16 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/f9f8f466-5aa0-40a8-9f77-cfb52db44021 HTTP/1.1" status: 204 len: 168 time: 1.3787112 Dec 10 14:29:02.553866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57398) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:02.556793 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:02.556985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Checking segment: {'id': 'be109a19-83c1-4b2e-9d79-a7e7c62fa19d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'bf6294a7-4503-48e7-9758-15d28122dea9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:02.557332 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.557756 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Bound using segment: {'id': 'be109a19-83c1-4b2e-9d79-a7e7c62fa19d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'bf6294a7-4503-48e7-9758-15d28122dea9'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:02.558246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Bound port: fc65a73b-6f65-48cf-a023-6893470513e5, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'be109a19-83c1-4b2e-9d79-a7e7c62fa19d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': 'bf6294a7-4503-48e7-9758-15d28122dea9'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:02.558631 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.578765 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:02.579144 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Checking segment: {'id': 'e5158ce0-9cf5-4f99-81b2-e66056474384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:02.579548 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.579945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Bound using segment: {'id': 'e5158ce0-9cf5-4f99-81b2-e66056474384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:02.580427 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Bound port: ce9ed0f4-a437-4778-b175-56dfce2ecd93, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5158ce0-9cf5-4f99-81b2-e66056474384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:02.580811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.622140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13154141-20d6-46ee-88ca-f85a712052eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:02.623780 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13154141-20d6-46ee-88ca-f85a712052eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:02.628093 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-13154141-20d6-46ee-88ca-f85a712052eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0705526 Dec 10 14:29:02.629122 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57402) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:02.688845 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.725094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet f32deff0-5335-4e4e-a47e-fd16649a6044 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:02.753339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a937722-56b6-4c1a-b828-76547a543715 req-00736aa5-4316-44a1-a7ab-928781a29cb0 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:02.754942 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7a937722-56b6-4c1a-b828-76547a543715 req-00736aa5-4316-44a1-a7ab-928781a29cb0 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.0641925 Dec 10 14:29:02.794414 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e714f88-71db-4ac0-b06b-eedbfadb479e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.843897 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e714f88-71db-4ac0-b06b-eedbfadb479e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=136fe677-c56a-4da0-8652-0fe4f4d3056c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:02.846164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.855147 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-52a4708c-95ca-42bd-b346-b4e28b0c3380 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2078193994&fields=id&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 267 time: 0.0882466 Dec 10 14:29:02.855676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.855772 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7a937722-56b6-4c1a-b828-76547a543715 req-a759119a-8e6a-46cd-9a62-894ca1f7a0e8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0869308 Dec 10 14:29:02.881666 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.898215 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0ab23af3-1805-4c63-a15b-b032f649ca20 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:02.898590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:02.992861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-e830045b-855e-4920-bc0c-e0dc5c953a63 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:03.000596 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-e830045b-855e-4920-bc0c-e0dc5c953a63 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/networks?id=b44c5886-b77e-456d-b9b8-db5350758724 HTTP/1.1" status: 200 len: 796 time: 0.1437404 Dec 10 14:29:03.010559 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.011233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 9bf91f32-9979-4b8d-97d8-65691082eab5 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:03.021049 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-2c3896d7-7685-4755-aadf-99a5ae1af6c3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/quotas/c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 375 time: 0.0187190 Dec 10 14:29:03.027091 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] For port c5a938d2-d8e5-424b-aeda-a7917721322a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a938d2-d8e5-424b-aeda-a7917721322a,segment=NetworkSegment(8884a3d8-3d3b-4c8a-a374-8f994bb64e01),segment_id=8884a3d8-3d3b-4c8a-a374-8f994bb64e01)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:03.030550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:03.033553 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.037829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:03.042892 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:03.048871 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:03.049292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.079501 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e714f88-71db-4ac0-b06b-eedbfadb479e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.083657 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9e714f88-71db-4ac0-b06b-eedbfadb479e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/136fe677-c56a-4da0-8652-0fe4f4d3056c HTTP/1.1" status: 204 len: 168 time: 1.0407190 Dec 10 14:29:03.086591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57414) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:03.100079 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting port fc65a73b-6f65-48cf-a023-6893470513e5 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:03.100079 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.100342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-3f4dcf82-7741-441d-9e03-990ac65aa7c4 None None] Allocated IP 172.20.0.18 (e9b085a0-e0b5-4630-9607-8d0706a5122c/0ae340f0-e5b5-4d36-a2da-9c7736d1150e/c5a938d2-d8e5-424b-aeda-a7917721322a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:03.101963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.116239 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b8cff84f-9812-492f-ad4e-ae65b5dc306f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.150256 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-460df1bb-eaa0-414a-b80e-c8a4c642ba8b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&fields=id HTTP/1.1" status: 200 len: 394 time: 0.1285098 Dec 10 14:29:03.163363 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-f1e7097b-08b9-4be2-a6e9-dc501e3f1592 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:29:03.164801 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f1e7097b-08b9-4be2-a6e9-dc501e3f1592 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/136fe677-c56a-4da0-8652-0fe4f4d3056c HTTP/1.1" status: 404 len: 333 time: 0.0677388 Dec 10 14:29:03.166607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] For port ce9ed0f4-a437-4778-b175-56dfce2ecd93, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:03.171512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57416) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:03.180137 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c39db6f5-544e-4cac-a48c-b698651d9e8b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1016 time: 2.1015053 Dec 10 14:29:03.188509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57418) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:03.203307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'd2b69d21-837d-469a-bf15-17a45151604a'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:03.243198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] For port fc65a73b-6f65-48cf-a023-6893470513e5, host dv-neutron-821401-2-hyperv, got binding levels [] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:03.243566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.252835 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:03.254751 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.271306 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:03.282405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] For port ce9ed0f4-a437-4778-b175-56dfce2ecd93, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ce9ed0f4-a437-4778-b175-56dfce2ecd93,segment=NetworkSegment(e5158ce0-9cf5-4f99-81b2-e66056474384),segment_id=e5158ce0-9cf5-4f99-81b2-e66056474384)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:03.283204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Calling delete_port for fc65a73b-6f65-48cf-a023-6893470513e5 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:03.293305 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:03.297502 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Could not find standard attr ID for object 136fe677-c56a-4da0-8652-0fe4f4d3056c. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:03.302928 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] For port fc65a73b-6f65-48cf-a023-6893470513e5, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:03.349143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.375351 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.379740 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.388709 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] For port fc65a73b-6f65-48cf-a023-6893470513e5, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=fc65a73b-6f65-48cf-a023-6893470513e5,segment=NetworkSegment(be109a19-83c1-4b2e-9d79-a7e7c62fa19d),segment_id=be109a19-83c1-4b2e-9d79-a7e7c62fa19d)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:03.390037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.394372 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Pushing event updated for resources: {'Port': ['ID=ca498c99-21ce-4498-b4f1-a08eaa4cef74,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:03.412013 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-b0f01ecb-aa83-4203-9340-e8ff2ba241e9 service neutron] 10.222.0.57 "GET /v2.0/networks/b44c5886-b77e-456d-b9b8-db5350758724?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2327890 Dec 10 14:29:03.423467 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.452354 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-675be618-9c45-46f7-8702-65555518b1ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.515020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Provisioning complete for port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:03.515399 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.517527 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.563154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.565541 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.575082 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-c0748629-7c54-4d9f-b4df-cefac1be3de3 service neutron] 10.222.0.57 "GET /v2.0/networks/b44c5886-b77e-456d-b9b8-db5350758724?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1410694 Dec 10 14:29:03.578901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.585000 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ea1ccf81-23a5-41dd-8e9b-8ee0568b069e up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:03.600694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.606751 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/f32deff0-5335-4e4e-a47e-fd16649a6044 HTTP/1.1" status: 204 len: 168 time: 0.9744787 Dec 10 14:29:03.623686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57420) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:03.628761 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Allocated IP 2001:db8:3::1 (e900a180-cce3-4df7-9e0d-298a290873ba/c0a6adbb-fcb5-45e3-859f-c62d695f545d/b5844df0-aec5-4f9c-8ec0-ca35f45bb879) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:03.632565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=f32deff0-5335-4e4e-a47e-fd16649a6044,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:03.698335 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bf96192f-e550-427e-acf8-287a32d9cf8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0685344 Dec 10 14:29:03.698548 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Attempting to bind port ca498c99-21ce-4498-b4f1-a08eaa4cef74 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:03.698548 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Attempting to bind port ca498c99-21ce-4498-b4f1-a08eaa4cef74 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:03.698548 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Attempting to bind port ca498c99-21ce-4498-b4f1-a08eaa4cef74 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:03.699261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57422) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:03.710375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.711558 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.713881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.714374 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.714817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.715255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.716680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.717572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.717572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.719093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.719571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.720019 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.721803 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3accefed-d813-4a9b-81b8-07a687e19c6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:03.740209 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Pushing event updated for resources: {'Port': ['ID=c5a938d2-d8e5-424b-aeda-a7917721322a,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:03.740861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:03.755570 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Network e900a180-cce3-4df7-9e0d-298a290873ba is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:03.759666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:03.803151 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:03.808324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:03.808324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.808324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:03.808324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Bound port: ca498c99-21ce-4498-b4f1-a08eaa4cef74, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:03.808324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:03.808941 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:03.811898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3f4dcf82-7741-441d-9e03-990ac65aa7c4 None None] For port c5a938d2-d8e5-424b-aeda-a7917721322a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a938d2-d8e5-424b-aeda-a7917721322a,segment=NetworkSegment(8884a3d8-3d3b-4c8a-a374-8f994bb64e01),segment_id=8884a3d8-3d3b-4c8a-a374-8f994bb64e01)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:03.846496 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:03.958994 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911d6a0c-5a41-4583-a874-b59a43b0c546 None None] Pushing event updated for resources: {'Port': ['ID=ce9ed0f4-a437-4778-b175-56dfce2ecd93,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:04.001262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-675be618-9c45-46f7-8702-65555518b1ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.104555 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Provisioning complete for port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:04.105105 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.180181 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a8d2de0c-101f-4cee-9dc0-857e2c178bf2 req-29993e52-fc2f-4047-b4ba-9f84e25a68aa tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 210 time: 0.1017058 Dec 10 14:29:04.205038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66fcea0d-5b00-441c-9231-a5bfe9d0e0fa req-26b2bcc5-a688-419d-b904-ad53073a6b89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:04.205038 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-66fcea0d-5b00-441c-9231-a5bfe9d0e0fa req-26b2bcc5-a688-419d-b904-ad53073a6b89 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 1099 time: 0.8041127 Dec 10 14:29:04.250220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23736f9a-b618-481c-971e-15823d71b09e req-120ee0db-8e21-401c-849b-193650b1940a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:04.253487 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-23736f9a-b618-481c-971e-15823d71b09e req-120ee0db-8e21-401c-849b-193650b1940a tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.2283187 Dec 10 14:29:04.344987 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.347219 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.352393 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-23736f9a-b618-481c-971e-15823d71b09e req-ac6f7a97-22a1-4606-af0e-f3e679d7f9d9 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0795002 Dec 10 14:29:04.366681 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:04.370620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.387042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Port': ['ID=fc65a73b-6f65-48cf-a023-6893470513e5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:04.409282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-675be618-9c45-46f7-8702-65555518b1ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.412509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-675be618-9c45-46f7-8702-65555518b1ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.416201 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-675be618-9c45-46f7-8702-65555518b1ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/security-groups/90ff0443-2c15-427a-b443-4891d2756790 HTTP/1.1" status: 204 len: 168 time: 1.2368526 Dec 10 14:29:04.416754 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-66fcea0d-5b00-441c-9231-a5bfe9d0e0fa req-c672910f-fb2b-48ca-b8b1-87d70960358f service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1989431 Dec 10 14:29:04.422141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c13dad78-bbc6-4d88-8ce9-76a8556f5730 None None] Network bf6294a7-4503-48e7-9758-15d28122dea9 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:04.424392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a321af3f-3c5c-4ead-850d-463f5555ea71 None None] Pushing event updated for resources: {'Port': ['ID=fc65a73b-6f65-48cf-a023-6893470513e5,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:04.429950 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57434) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:04.441369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No DVR routers for this DVR port fc65a73b-6f65-48cf-a023-6893470513e5 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:04.519656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Delete allocated IP 2001:db8:0:1::2fc (9bf91f32-9979-4b8d-97d8-65691082eab5/d49f8028-c2be-45ef-af9f-c0f8f1e82091) {{(pid=103810) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 10 14:29:04.523926 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675be618-9c45-46f7-8702-65555518b1ad tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=90ff0443-2c15-427a-b443-4891d2756790,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:04.531912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6087be37-a494-42bd-b82f-34dfe8b56976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.556983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6087be37-a494-42bd-b82f-34dfe8b56976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.600388 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.642047 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f4dcf82-7741-441d-9e03-990ac65aa7c4 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.643374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.658461 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network e900a180-cce3-4df7-9e0d-298a290873ba is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:04.670600 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Attempting to bind port 3790b372-089f-4aaa-a0cd-caa0a4231384 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:04.671267 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Attempting to bind port 3790b372-089f-4aaa-a0cd-caa0a4231384 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:04.671641 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Attempting to bind port 3790b372-089f-4aaa-a0cd-caa0a4231384 on network e900a180-cce3-4df7-9e0d-298a290873ba {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:04.674265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bf6294a7-4503-48e7-9758-15d28122dea9']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:04.684481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:04.690325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 2648b8af-c0bf-4811-b353-779f2426f8b8 details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:29:04.691855 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6087be37-a494-42bd-b82f-34dfe8b56976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.694179 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6087be37-a494-42bd-b82f-34dfe8b56976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.694486 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'be109a19-83c1-4b2e-9d79-a7e7c62fa19d') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:04.694792 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'be109a19-83c1-4b2e-9d79-a7e7c62fa19d') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:04.695377 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6087be37-a494-42bd-b82f-34dfe8b56976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/security-groups/3c3cb48c-536f-4b39-bee4-61d8ba6a28e0 HTTP/1.1" status: 204 len: 168 time: 0.2643096 Dec 10 14:29:04.698204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:04.699121 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.703210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57436) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:04.703334 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:04.704450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.767392 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=b5844df0-aec5-4f9c-8ec0-ca35f45bb879,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:04.775584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6087be37-a494-42bd-b82f-34dfe8b56976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c3cb48c-536f-4b39-bee4-61d8ba6a28e0,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:04.787974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-4bb8651d-0ac1-40fa-9a67-fc8d3bc3a73f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet 9af374b7-feb5-4523-a05d-c9651ea05ab3 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:04.793295 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4bb8651d-0ac1-40fa-9a67-fc8d3bc3a73f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.813098 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Attempting to bind port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:04.813515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Attempting to bind port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '877fce5e-0213-4db9-862b-58436fd1cb89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:04.813894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Attempting to bind port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 on network 152411ab-4991-469e-bd27-c8d29a909a0f {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:04.821208 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:04.821632 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Checking segment: {'id': 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:04.822508 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.822982 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Bound using segment: {'id': 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:04.823462 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Bound port: 3790b372-089f-4aaa-a0cd-caa0a4231384, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:04.823918 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.841789 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:04.842329 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Checking segment: {'id': '877fce5e-0213-4db9-862b-58436fd1cb89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:04.842742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.843150 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Bound using segment: {'id': '877fce5e-0213-4db9-862b-58436fd1cb89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:04.844046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Bound port: cbcc7a12-8783-47cd-9c2b-9efbf73dac97, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '877fce5e-0213-4db9-862b-58436fd1cb89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:04.844609 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.846797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53ece556-0474-47a2-bbfd-15206ce7e5cc None None] Network bf6294a7-4503-48e7-9758-15d28122dea9 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:04.851668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f4dcf82-7741-441d-9e03-990ac65aa7c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.864893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4bb8651d-0ac1-40fa-9a67-fc8d3bc3a73f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.895392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.906107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.resource_extend [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 10 14:29:04.922432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da1a3b6-008f-4754-9b6d-355feaf749d9 None None] Pushing event updated for resources: {'Port': ['ID=cbcc7a12-8783-47cd-9c2b-9efbf73dac97,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:04.961526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.980952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.981209 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.993571 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 374 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:04.993986 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:04.997078 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:05.041736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:05.045468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:05.064392 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=5e1d1bb2-2ce1-4a3f-9f7b-526e93ce252b,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:05.072362 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:05.073067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.083345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4bb8651d-0ac1-40fa-9a67-fc8d3bc3a73f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.089612 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.137316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] For port ca498c99-21ce-4498-b4f1-a08eaa4cef74, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:05.183636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.188346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] In _notify_port_updated(), no bound segment for port 8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 on network 9bf91f32-9979-4b8d-97d8-65691082eab5 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:29:05.195734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:05.196384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.200945 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "PUT /v2.0/ports/8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 HTTP/1.1" status: 200 len: 925 time: 2.0114009 Dec 10 14:29:05.206494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57440) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:05.212600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'd2b69d21-837d-469a-bf15-17a45151604a'}, {'subnet_id': 'd49f8028-c2be-45ef-af9f-c0f8f1e82091'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:05.220447 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Pushing event updated for resources: {'Port': ['ID=3790b372-089f-4aaa-a0cd-caa0a4231384,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:05.258724 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] For port ca498c99-21ce-4498-b4f1-a08eaa4cef74, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ca498c99-21ce-4498-b4f1-a08eaa4cef74,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:05.265587 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f60a572b-4426-4de5-98d9-c2c502fb45bd None None] Network 9bf91f32-9979-4b8d-97d8-65691082eab5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:05.282104 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b81d8e1-f04c-4392-9b61-077acd09d64b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:05.299721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.315049 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.321173 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/bf6294a7-4503-48e7-9758-15d28122dea9 HTTP/1.1" status: 204 len: 168 time: 5.9985654 Dec 10 14:29:05.323390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57446) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:05.362076 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-9ac48af8-e13b-453f-b996-ead985dabee2 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:05.362693 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9ac48af8-e13b-453f-b996-ead985dabee2 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:05.369443 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9ac48af8-e13b-453f-b996-ead985dabee2 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/bf6294a7-4503-48e7-9758-15d28122dea9 HTTP/1.1" status: 404 len: 339 time: 0.0313284 Dec 10 14:29:05.369443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d016c06d-6b9b-42da-a042-f7ef2deb3abe tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=bf6294a7-4503-48e7-9758-15d28122dea9,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:05.370926 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57448) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:05.376441 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-209627238', 'description': 'd1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:05.427049 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c5d58f2e-e34b-48c3-ac18-b40e401f2b01 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.7211225 Dec 10 14:29:05.438003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.438348 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57452) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:05.449527 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'name': 'tempest-NetworksTestDHCPv6-767741523'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:05.452231 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.472224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b16ba781-3e38-4b05-9f29-5ae87c5726af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.513743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.517554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4bb8651d-0ac1-40fa-9a67-fc8d3bc3a73f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.539275 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-351e2eaa-dd2f-4456-925f-1e6babd6e755 req-4521ee8c-c684-4cff-a9fd-b0154573bf90 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 210 time: 0.1194031 Dec 10 14:29:05.550500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] For port cbcc7a12-8783-47cd-9c2b-9efbf73dac97, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:05.553831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] For port cbcc7a12-8783-47cd-9c2b-9efbf73dac97, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cbcc7a12-8783-47cd-9c2b-9efbf73dac97,segment=NetworkSegment(877fce5e-0213-4db9-862b-58436fd1cb89),segment_id=877fce5e-0213-4db9-862b-58436fd1cb89)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:05.593676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] For port 3790b372-089f-4aaa-a0cd-caa0a4231384, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:05.649314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] For port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ea1ccf81-23a5-41dd-8e9b-8ee0568b069e,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:05.658104 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4bb8651d-0ac1-40fa-9a67-fc8d3bc3a73f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.668578 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4bb8651d-0ac1-40fa-9a67-fc8d3bc3a73f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/9af374b7-feb5-4523-a05d-c9651ea05ab3 HTTP/1.1" status: 204 len: 168 time: 0.9617393 Dec 10 14:29:05.669093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb8651d-0ac1-40fa-9a67-fc8d3bc3a73f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=9af374b7-feb5-4523-a05d-c9651ea05ab3,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:05.670225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57454) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:05.675495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:05.690705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:05.694538 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.697929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:05.748679 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb6d665-6521-4111-944d-6c7ef369bab4 req-12671e3a-00fe-4afd-b2e4-819c10b07487 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:05.750658 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1eb6d665-6521-4111-944d-6c7ef369bab4 req-12671e3a-00fe-4afd-b2e4-819c10b07487 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.2211437 Dec 10 14:29:05.764306 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'port_id': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'mac_address': 'fa:16:3e:a5:15:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:29:05.774224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f4dcf82-7741-441d-9e03-990ac65aa7c4 None None] Pushing event updated for resources: {'Port': ['ID=c5a938d2-d8e5-424b-aeda-a7917721322a,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:05.796090 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.805629 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] For port 3790b372-089f-4aaa-a0cd-caa0a4231384, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3790b372-089f-4aaa-a0cd-caa0a4231384,segment=NetworkSegment(f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a),segment_id=f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:05.824219 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 392, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:29:05.846792 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.847303 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment 075775cf-ff51-41f8-a29e-21540cc0a1f9 of type vlan for network 07871862-68be-4160-aeac-f3302f018b2b Dec 10 14:29:05.849716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.854266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.948522 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.948857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.956011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:05.990979 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1eb6d665-6521-4111-944d-6c7ef369bab4 req-e754ba06-dfe8-436b-8ca1-c74d38c72acc tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2271175 Dec 10 14:29:06.020966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:06.028873 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.076825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.078353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.091581 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port 224bf8b6-3cb5-4ebd-be20-9fa406fe35fc yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:06.155212 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff485653-98fb-4a0d-bfd3-df1eb3a26acb None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:06.155939 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8:0:1::22b (9bf91f32-9979-4b8d-97d8-65691082eab5/d49f8028-c2be-45ef-af9f-c0f8f1e82091/8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:06.161820 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.167517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:06.168149 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.222377 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Provisioning complete for port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:06.222540 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.224155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:06.224802 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:06.251524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:06.256819 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.428819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-beaadb83-2300-4ee4-98db-95c13970f169 None None] Update dhcp port {'port': {'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5', 'fixed_ips': [{'subnet_id': 'd2b69d21-837d-469a-bf15-17a45151604a', 'ip_address': '2001:db8::2'}, {'subnet_id': 'd49f8028-c2be-45ef-af9f-c0f8f1e82091'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'ce9ed0f4-a437-4778-b175-56dfce2ecd93'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:29:06.437523 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a955ccd2-3585-493c-ad8e-ab2fd343c27f None None] Pushing event updated for resources: {'Port': ['ID=ca498c99-21ce-4498-b4f1-a08eaa4cef74,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:06.449708 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.0774181 Dec 10 14:29:06.463471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.464528 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57456) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:06.509896 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event updated for resources: {'Port': ['ID=b5844df0-aec5-4f9c-8ec0-ca35f45bb879,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:06.582801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b3c842a-8c46-4e9a-9052-c204b2d4ea94 None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:06.621868 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-694641b7-032c-437c-8695-8866d62b6b67 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:06.626831 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-694641b7-032c-437c-8695-8866d62b6b67 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/networks?id=07871862-68be-4160-aeac-f3302f018b2b HTTP/1.1" status: 200 len: 764 time: 0.1612263 Dec 10 14:29:06.634864 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57460) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:06.636632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::1f0 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/5e1d1bb2-2ce1-4a3f-9f7b-526e93ce252b/224bf8b6-3cb5-4ebd-be20-9fa406fe35fc) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:06.637332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.639742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=07871862-68be-4160-aeac-f3302f018b2b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:06.652326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.652686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.653184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7758bb45-8f24-40cd-8be8-86ae66b0c92a tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'description': 'd2'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:06.657036 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.657792 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.657933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.658255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.659058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.659408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.661009 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.661292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.661653 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.661998 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.662865 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba466ff4-57e9-416e-a735-b901b3776a3b tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:06.722423 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Network e900a180-cce3-4df7-9e0d-298a290873ba is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:06.755199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:06.757369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.788410 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-854baabf-a64a-402a-85ab-9a7e6e7844eb req-cb12b71b-ab44-41ee-b1d5-eef5488bc2c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 210 time: 0.0756605 Dec 10 14:29:06.807753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.828459 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 07871862-68be-4160-aeac-f3302f018b2b details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:29:06.873001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] In _notify_port_updated(), no bound segment for port 8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 on network 9bf91f32-9979-4b8d-97d8-65691082eab5 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:29:06.879167 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:06.880060 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.881858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 2648b8af-c0bf-4811-b353-779f2426f8b8 {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:29:06.884461 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "PUT /v2.0/ports/8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 HTTP/1.1" status: 200 len: 1011 time: 1.6762447 Dec 10 14:29:06.896704 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-beaadb83-2300-4ee4-98db-95c13970f169 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:06.896930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57462) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:06.935061 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:29:06.935404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:29:06.952069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d7b662-1f00-4f06-b04d-42dd28f062cc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:07.020001 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:07.028060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:07.064126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da1a3b6-008f-4754-9b6d-355feaf749d9 None None] Pushing event updated for resources: {'Port': ['ID=cbcc7a12-8783-47cd-9c2b-9efbf73dac97,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:07.164532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-8c8d78ce-e09b-4891-8061-751460f6cf86 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:07.166535 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-8c8d78ce-e09b-4891-8061-751460f6cf86 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/networks?id=b44c5886-b77e-456d-b9b8-db5350758724 HTTP/1.1" status: 200 len: 796 time: 0.2778387 Dec 10 14:29:07.170828 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.174048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-40a51fd1-8c6c-47f3-a698-7cf1b73461ca tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:07.174658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-40a51fd1-8c6c-47f3-a698-7cf1b73461ca tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.359343 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-b2c793ff-60a0-45c8-8be3-6e3ea1b8f9a8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 473 time: 0.1804521 Dec 10 14:29:07.375795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'port': {'device_id': '42f13496-e928-4712-aca5-df46dbe9b53b', 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724', 'admin_state_up': True, 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'security_groups': ['a7754821-56c9-4342-8d14-0e36a6c62482']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:07.379623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.475411 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-40a51fd1-8c6c-47f3-a698-7cf1b73461ca tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.497286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e47f1dd-89e1-4295-8fd2-d65438beb42f None None] Pushing event updated for resources: {'Port': ['ID=ea1ccf81-23a5-41dd-8e9b-8ee0568b069e,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:07.505933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:07.518619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-40a51fd1-8c6c-47f3-a698-7cf1b73461ca tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:07.562318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7758bb45-8f24-40cd-8be8-86ae66b0c92a tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.678843 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] For port cbcc7a12-8783-47cd-9c2b-9efbf73dac97, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cbcc7a12-8783-47cd-9c2b-9efbf73dac97,segment=NetworkSegment(877fce5e-0213-4db9-862b-58436fd1cb89),segment_id=877fce5e-0213-4db9-862b-58436fd1cb89)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:07.697701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a938d2-d8e5-424b-aeda-a7917721322a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:07.709532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c351f2eb-71d7-4a71-bc71-1e61deb86531 req-ecf504e6-a14d-42e0-9c9b-185e24b6e943 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:07.711042 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c351f2eb-71d7-4a71-bc71-1e61deb86531 req-ecf504e6-a14d-42e0-9c9b-185e24b6e943 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 945 time: 0.3136706 Dec 10 14:29:07.731450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.734375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7758bb45-8f24-40cd-8be8-86ae66b0c92a tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.757950 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48390277-33a6-462d-8e69-89200cf889ba None None] Network e900a180-cce3-4df7-9e0d-298a290873ba requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:07.770361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.785088 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-7758bb45-8f24-40cd-8be8-86ae66b0c92a tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network 07871862-68be-4160-aeac-f3302f018b2b is not hosted by any dhcp agent {{(pid=103811) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 10 14:29:07.790643 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7758bb45-8f24-40cd-8be8-86ae66b0c92a tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:07.791278 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7758bb45-8f24-40cd-8be8-86ae66b0c92a tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.793302 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7758bb45-8f24-40cd-8be8-86ae66b0c92a tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "PUT /v2.0/networks/07871862-68be-4160-aeac-f3302f018b2b HTTP/1.1" status: 200 len: 761 time: 1.1535158 Dec 10 14:29:07.793856 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:07.799276 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.799594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4df351-952a-449d-8483-e322cc04f028 None None] Pushing event updated for resources: {'Port': ['ID=3790b372-089f-4aaa-a0cd-caa0a4231384,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:07.817646 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57470) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:07.863811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.890983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:07.904829 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2f58cced-625d-4647-b8d4-7833451849fd tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.5234063 Dec 10 14:29:07.913576 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:07.917612 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57474) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:07.924613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-beaadb83-2300-4ee4-98db-95c13970f169 None None] Allocated IP 2001:db8:0:1::2 (9bf91f32-9979-4b8d-97d8-65691082eab5/d49f8028-c2be-45ef-af9f-c0f8f1e82091/ce9ed0f4-a437-4778-b175-56dfce2ecd93) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:07.936250 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20d4cdef-01b0-420e-af6a-ffef9f46485e None None] Update dhcp port {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': '5e1d1bb2-2ce1-4a3f-9f7b-526e93ce252b'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'ca498c99-21ce-4498-b4f1-a08eaa4cef74'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:29:07.936604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7758bb45-8f24-40cd-8be8-86ae66b0c92a tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=07871862-68be-4160-aeac-f3302f018b2b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:07.943344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'routes': [{'nexthop': '2001:db8:1::2', 'destination': '2001:db8:1::/64'}, {'nexthop': '2001:db8:2::2', 'destination': '2001:db8:2::/64'}, {'nexthop': '2001:db8:3::2', 'destination': '2001:db8:3::/64'}, {'nexthop': '2001:db8::2', 'destination': '2001:db8::/64'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:07.992775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 07871862-68be-4160-aeac-f3302f018b2b details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:29:08.006584 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c351f2eb-71d7-4a71-bc71-1e61deb86531 req-52346f9b-6f0f-4b2b-9ae7-b446d388fcae tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2832518 Dec 10 14:29:08.043824 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-03e150b1-b45a-4927-a2c2-6ba5ec684c1b req-e64b5f1a-3c14-4ad0-8b76-1c63fd686f38 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 210 time: 0.1251700 Dec 10 14:29:08.045806 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57476) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:08.106107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-20d4cdef-01b0-420e-af6a-ffef9f46485e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.124154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Provisioning complete for port 58db0125-8848-46c5-a0eb-a70079090a22 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:08.124601 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.132673 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.19 (b44c5886-b77e-456d-b9b8-db5350758724/8bcb9694-fbbf-4a44-b94d-96729fcd88cb/bac35f63-cb95-4d03-a0bc-4595f7bec69c) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:08.140840 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:08.154051 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:08.163264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:08.163859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.166239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=934733e0-bec4-499f-b524-7ee1a80477d5,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:08.206666 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.224909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=2648b8af-c0bf-4811-b353-779f2426f8b8,revision_number=6']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:08.248901 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e71622ff-b6fd-4cdf-946b-cafca6d173f4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:08.252254 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2b27446f-3e63-483f-acaa-c7d605573f14 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/floatingips/c31794c0-9085-409e-a56d-0bcda9bb0856 HTTP/1.1" status: 200 len: 992 time: 0.2015667 Dec 10 14:29:08.256382 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e71622ff-b6fd-4cdf-946b-cafca6d173f4 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/networks?id=07871862-68be-4160-aeac-f3302f018b2b HTTP/1.1" status: 200 len: 764 time: 0.4373286 Dec 10 14:29:08.257079 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57478) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:08.334465 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-74fc04a0-aecb-4d80-ac41-5518d1229710 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.6629472 Dec 10 14:29:08.342320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:08.342940 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.350806 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57480) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:08.358195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-4a6b526e-8087-423f-b35a-da74ca2b1a0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'security_group': {'name': 'tempest-secgroup-257653983'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:08.378301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:08.392234 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:08.407575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:08.414067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:08.414730 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.444603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=224bf8b6-3cb5-4ebd-be20-9fa406fe35fc,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:08.447100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:04Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:05Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:05Z', 'revision_number': 4, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:08.487827 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ae2a098-90ef-4698-99ee-3b4888a26721 None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:04Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:05Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:05Z', 'revision_number': 4, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:08.506854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-40a51fd1-8c6c-47f3-a698-7cf1b73461ca tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.600680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a6b526e-8087-423f-b35a-da74ca2b1a0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.669283 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a51fd1-8c6c-47f3-a698-7cf1b73461ca tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:08.673730 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a77f7d47-cfa8-46c1-b768-853aef413e6a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 3.2298043 Dec 10 14:29:08.674372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57482) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:08.710425 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-beaadb83-2300-4ee4-98db-95c13970f169 None None] For port ce9ed0f4-a437-4778-b175-56dfce2ecd93, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ce9ed0f4-a437-4778-b175-56dfce2ecd93,segment=NetworkSegment(e5158ce0-9cf5-4f99-81b2-e66056474384),segment_id=e5158ce0-9cf5-4f99-81b2-e66056474384)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:08.723394 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added routes are [{'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 10 14:29:08.737797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Pushing event updated for resources: {'Port': ['ID=cbcc7a12-8783-47cd-9c2b-9efbf73dac97,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:08.744211 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-052afbaa-c046-442c-a674-c2855565a400 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:08.746110 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-052afbaa-c046-442c-a674-c2855565a400 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.4767318 Dec 10 14:29:08.755678 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57484) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:08.795962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Removed routes are [] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 10 14:29:08.796282 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.816468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83a48e80-58c2-44f1-8850-36ee05bb5af6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:08.824226 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83a48e80-58c2-44f1-8850-36ee05bb5af6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:08.829712 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-83a48e80-58c2-44f1-8850-36ee05bb5af6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1589 time: 0.1503375 Dec 10 14:29:08.830759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57486) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:08.865931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-beaadb83-2300-4ee4-98db-95c13970f169 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.877609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-40a51fd1-8c6c-47f3-a698-7cf1b73461ca tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:08.887334 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-40a51fd1-8c6c-47f3-a698-7cf1b73461ca tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 HTTP/1.1" status: 204 len: 168 time: 1.9892025 Dec 10 14:29:08.892722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57488) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:08.918047 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0d0980d5-1a87-4ba9-8f2f-886fed18f177 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 207 time: 0.1490402 Dec 10 14:29:08.933724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57490) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:08.963386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.010830 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-bb326623-bee3-46af-8048-b1f3b384ab22 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:29:09.015784 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bb326623-bee3-46af-8048-b1f3b384ab22 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 HTTP/1.1" status: 404 len: 333 time: 0.1182032 Dec 10 14:29:09.016727 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57492) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:09.033983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a6b526e-8087-423f-b35a-da74ca2b1a0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.131022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-2e100e01-8e9d-4370-bc29-4457d1a11394 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet d49f8028-c2be-45ef-af9f-c0f8f1e82091 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:09.135338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2e100e01-8e9d-4370-bc29-4457d1a11394 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.171454 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 58db0125-8848-46c5-a0eb-a70079090a22 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:09.175074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.214758 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-20d4cdef-01b0-420e-af6a-ffef9f46485e None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/5e1d1bb2-2ce1-4a3f-9f7b-526e93ce252b/ca498c99-21ce-4498-b4f1-a08eaa4cef74) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:09.226373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2e100e01-8e9d-4370-bc29-4457d1a11394 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.251770 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a6b526e-8087-423f-b35a-da74ca2b1a0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.285724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network b44c5886-b77e-456d-b9b8-db5350758724 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:09.293039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:09.296108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:09.341086 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-daea049c-6c14-4adf-99f9-693d515f9ca4 None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:09.346144 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.351723 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-beaadb83-2300-4ee4-98db-95c13970f169 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.405479 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Provisioning complete for port ce9ed0f4-a437-4778-b175-56dfce2ecd93 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:09.408053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.410717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 2648b8af-c0bf-4811-b353-779f2426f8b8 details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:29:09.424096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=bac35f63-cb95-4d03-a0bc-4595f7bec69c,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:09.464721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:09.465840 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.540735 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2e100e01-8e9d-4370-bc29-4457d1a11394 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.561294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:09.579133 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 2648b8af-c0bf-4811-b353-779f2426f8b8 no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:09.630078 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a6b526e-8087-423f-b35a-da74ca2b1a0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.630078 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4a6b526e-8087-423f-b35a-da74ca2b1a0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 1.2715728 Dec 10 14:29:09.630947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57496) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:09.635047 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-9a3a4e34-0a7d-4c06-bcbb-8ac38c719e27 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2685788 Dec 10 14:29:09.653750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Request body: {'port': {'device_id': '42f13496-e928-4712-aca5-df46dbe9b53b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:09.664926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d881f76f-c85f-4727-8dbc-b5b54594070f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'security_group': {'name': 'tempest-secgroup-1697391262'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:09.670091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a6b526e-8087-423f-b35a-da74ca2b1a0a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'SecurityGroup': ['ID=095b410c-f731-4b01-a7cb-445a39e498ee,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:09.765326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2e100e01-8e9d-4370-bc29-4457d1a11394 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.795511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c208dd-e6d1-48ee-89d4-1a102c7c25ef req-b3a9c0a9-80c0-4788-83e1-9fa3c7cf0101 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:09.804114 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d2c208dd-e6d1-48ee-89d4-1a102c7c25ef req-b3a9c0a9-80c0-4788-83e1-9fa3c7cf0101 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 932 time: 0.5730491 Dec 10 14:29:09.812378 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.818382 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80875d08-1170-41b5-a96e-1a4ad07ce675 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:09.821090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e100e01-8e9d-4370-bc29-4457d1a11394 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=d49f8028-c2be-45ef-af9f-c0f8f1e82091,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:09.825207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80875d08-1170-41b5-a96e-1a4ad07ce675 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:09.829614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2e100e01-8e9d-4370-bc29-4457d1a11394 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.831443 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80875d08-1170-41b5-a96e-1a4ad07ce675 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:09.835842 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2e100e01-8e9d-4370-bc29-4457d1a11394 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/d49f8028-c2be-45ef-af9f-c0f8f1e82091 HTTP/1.1" status: 204 len: 168 time: 0.8120844 Dec 10 14:29:09.836512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57498) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:09.854506 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80875d08-1170-41b5-a96e-1a4ad07ce675 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:09.861265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80875d08-1170-41b5-a96e-1a4ad07ce675 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:09.867385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80875d08-1170-41b5-a96e-1a4ad07ce675 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:09.872686 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-80875d08-1170-41b5-a96e-1a4ad07ce675 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3731 time: 0.9294593 Dec 10 14:29:09.879581 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57500) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:09.915576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'port_id': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'mac_address': 'fa:16:3e:a5:15:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:29:09.945772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-c2a8d591-2bde-47ba-a465-9f382c34c8b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet d2b69d21-837d-469a-bf15-17a45151604a {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:09.951549 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2a8d591-2bde-47ba-a465-9f382c34c8b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:09.976882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-9b2929a2-daf2-4799-ade9-540bff653185 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 224bf8b6-3cb5-4ebd-be20-9fa406fe35fc {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:09.977241 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b2929a2-daf2-4799-ade9-540bff653185 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.008542 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-20d4cdef-01b0-420e-af6a-ffef9f46485e None None] For port ca498c99-21ce-4498-b4f1-a08eaa4cef74, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ca498c99-21ce-4498-b4f1-a08eaa4cef74,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:10.060911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2a8d591-2bde-47ba-a465-9f382c34c8b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.071636 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['2648b8af-c0bf-4811-b353-779f2426f8b8'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:29:10.114548 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beaadb83-2300-4ee4-98db-95c13970f169 None None] Pushing event updated for resources: {'Port': ['ID=ce9ed0f4-a437-4778-b175-56dfce2ecd93,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:10.199473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-20d4cdef-01b0-420e-af6a-ffef9f46485e None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.300111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.305216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.313345 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d881f76f-c85f-4727-8dbc-b5b54594070f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.350712 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-20d4cdef-01b0-420e-af6a-ffef9f46485e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.352661 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 58db0125-8848-46c5-a0eb-a70079090a22 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:10.353032 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.355848 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-26a253f2-15e6-4eec-882d-5377a6d01339 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 813 time: 0.4599237 Dec 10 14:29:10.366597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57502) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:10.368549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b2929a2-daf2-4799-ade9-540bff653185 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.432473 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-9b2929a2-daf2-4799-ade9-540bff653185 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 224bf8b6-3cb5-4ebd-be20-9fa406fe35fc owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:10.475906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.476128 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d2c208dd-e6d1-48ee-89d4-1a102c7c25ef req-6d27d149-a37e-4edd-ad8f-2721e7199f68 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6542077 Dec 10 14:29:10.492431 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.532397 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03ddc1e2-30b2-4176-bc18-352c725fc07e None None] Update dhcp port {'port': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'fixed_ips': [{'subnet_id': '0ae340f0-e5b5-4d36-a2da-9c7736d1150e', 'ip_address': '172.20.0.18'}, {'subnet_id': '934733e0-bec4-499f-b524-7ee1a80477d5'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'c5a938d2-d8e5-424b-aeda-a7917721322a'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:29:10.623952 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:10.637722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20d4cdef-01b0-420e-af6a-ffef9f46485e None None] Pushing event updated for resources: {'Port': ['ID=ca498c99-21ce-4498-b4f1-a08eaa4cef74,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:10.643047 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:10.643281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 2648b8af-c0bf-4811-b353-779f2426f8b8 {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:29:10.643897 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:10.674338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-03ddc1e2-30b2-4176-bc18-352c725fc07e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.878509 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] For port ce9ed0f4-a437-4778-b175-56dfce2ecd93, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ce9ed0f4-a437-4778-b175-56dfce2ecd93,segment=NetworkSegment(e5158ce0-9cf5-4f99-81b2-e66056474384),segment_id=e5158ce0-9cf5-4f99-81b2-e66056474384)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:10.963641 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bac35f63-cb95-4d03-a0bc-4595f7bec69c {{(pid=103810) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:29:10.966049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:10.986360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:10.998691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2a8d591-2bde-47ba-a465-9f382c34c8b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.038789 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.094862 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:11.109919 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.provisioning_blocks [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Transition to ACTIVE for port object bac35f63-cb95-4d03-a0bc-4595f7bec69c will not be triggered until provisioned by entity L2. {{(pid=103810) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:29:11.113307 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7c7cb72-6b95-4a92-a9d3-ce21da857eae None None] Network 9bf91f32-9979-4b8d-97d8-65691082eab5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:11.181814 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.229654 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2a8d591-2bde-47ba-a465-9f382c34c8b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.317269 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.344749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a8d591-2bde-47ba-a465-9f382c34c8b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=d2b69d21-837d-469a-bf15-17a45151604a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:11.365142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2a8d591-2bde-47ba-a465-9f382c34c8b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.371357 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c2a8d591-2bde-47ba-a465-9f382c34c8b6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/d2b69d21-837d-469a-bf15-17a45151604a HTTP/1.1" status: 204 len: 168 time: 1.5316401 Dec 10 14:29:11.375116 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57504) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:11.404978 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:08Z', 'revision_number': 6, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:05Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:11.445439 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d881f76f-c85f-4727-8dbc-b5b54594070f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.446008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Provisioning complete for port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:11.446008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.451462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a283a201-dbd0-4ee5-9d7c-6e5e3c31ec35 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.453132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a283a201-dbd0-4ee5-9d7c-6e5e3c31ec35 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.454709 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a283a201-dbd0-4ee5-9d7c-6e5e3c31ec35 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.456416 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a283a201-dbd0-4ee5-9d7c-6e5e3c31ec35 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.459105 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a283a201-dbd0-4ee5-9d7c-6e5e3c31ec35 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.461254 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a283a201-dbd0-4ee5-9d7c-6e5e3c31ec35 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 1.0878119 Dec 10 14:29:11.465325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57506) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:11.468097 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:11.468697 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Updating router 84410bb0-960a-4ef0-a5c1-72cde49aba0f port b5844df0-aec5-4f9c-8ec0-ca35f45bb879 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:29:11.492560 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Pushing event updated for resources: {'Port': ['ID=bac35f63-cb95-4d03-a0bc-4595f7bec69c,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:11.517505 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.532634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d881f76f-c85f-4727-8dbc-b5b54594070f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.533394 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40645752-9c78-485f-800e-8888eccd6d26 None None] Pushing event updated for resources: {'Port': ['ID=ce9ed0f4-a437-4778-b175-56dfce2ecd93,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:11.569252 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device be101111-dc57-4a49-9754-8ff78b3190e3 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:11.670902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.684160 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: be101111-dc57-4a49-9754-8ff78b3190e3 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:11.684524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device be101111-dc57-4a49-9754-8ff78b3190e3 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:11.697008 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Attempting to bind port bac35f63-cb95-4d03-a0bc-4595f7bec69c on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:11.697462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Attempting to bind port bac35f63-cb95-4d03-a0bc-4595f7bec69c by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:11.698205 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Attempting to bind port bac35f63-cb95-4d03-a0bc-4595f7bec69c on network b44c5886-b77e-456d-b9b8-db5350758724 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:11.698617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=2648b8af-c0bf-4811-b353-779f2426f8b8,revision_number=7']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:11.705703 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:11.706481 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Port bac35f63-cb95-4d03-a0bc-4595f7bec69c on network b44c5886-b77e-456d-b9b8-db5350758724 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:29:11.712991 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Attempting to bind port bac35f63-cb95-4d03-a0bc-4595f7bec69c on network b44c5886-b77e-456d-b9b8-db5350758724 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:11.713490 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0840d6c6-3b63-4d08-82c7-ebf81f1dfa60 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.717279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0840d6c6-3b63-4d08-82c7-ebf81f1dfa60 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.718390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-03ddc1e2-30b2-4176-bc18-352c725fc07e None None] Allocated IP 172.20.0.2 (e9b085a0-e0b5-4630-9607-8d0706a5122c/934733e0-bec4-499f-b524-7ee1a80477d5/c5a938d2-d8e5-424b-aeda-a7917721322a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:11.719336 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0840d6c6-3b63-4d08-82c7-ebf81f1dfa60 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.720943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0840d6c6-3b63-4d08-82c7-ebf81f1dfa60 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.722713 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0840d6c6-3b63-4d08-82c7-ebf81f1dfa60 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['shared'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.724544 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0840d6c6-3b63-4d08-82c7-ebf81f1dfa60 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 697 time: 0.2580764 Dec 10 14:29:11.734993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57510) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:11.743913 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d881f76f-c85f-4727-8dbc-b5b54594070f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.749252 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d881f76f-c85f-4727-8dbc-b5b54594070f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 2.0982273 Dec 10 14:29:11.755279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57512) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:11.767564 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c9d9bf85-f619-4e9e-ace1-e605e68f252e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'security_group': {'name': 'tempest-secgroup-1252946981'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:11.769010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:11.769529 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Checking segment: {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:11.770018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Bound using segment: {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:11.772402 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Bound port: bac35f63-cb95-4d03-a0bc-4595f7bec69c, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'}}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:11.772874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:11.793298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d881f76f-c85f-4727-8dbc-b5b54594070f tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4e095f0a-6836-42d1-b39c-9b050a8841b1,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:11.981918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3dd059-4826-4b2b-8d9b-76ca61f5b137 req-0c0a45e9-c08d-439a-9c8f-ddfe12ab8ba2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:11.983815 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6a3dd059-4826-4b2b-8d9b-76ca61f5b137 req-0c0a45e9-c08d-439a-9c8f-ddfe12ab8ba2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 944 time: 0.3953450 Dec 10 14:29:12.029501 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.039489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port ce9ed0f4-a437-4778-b175-56dfce2ecd93 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:12.040065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.055736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9d9bf85-f619-4e9e-ace1-e605e68f252e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.108761 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.137971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] For port ce9ed0f4-a437-4778-b175-56dfce2ecd93, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ce9ed0f4-a437-4778-b175-56dfce2ecd93,segment=NetworkSegment(e5158ce0-9cf5-4f99-81b2-e66056474384),segment_id=e5158ce0-9cf5-4f99-81b2-e66056474384)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:12.138443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.155839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for ce9ed0f4-a437-4778-b175-56dfce2ecd93 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:12.183941 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:12.212275 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.214096 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8c4ca5c8-8aec-4a9a-b5b5-5b34255f6906 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f HTTP/1.1" status: 200 len: 952 time: 4.2749531 Dec 10 14:29:12.218935 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6a3dd059-4826-4b2b-8d9b-76ca61f5b137 req-a21925e7-e670-46da-bbd3-a5430fb33fb8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1827562 Dec 10 14:29:12.219865 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] For port bac35f63-cb95-4d03-a0bc-4595f7bec69c, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:12.224795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57514) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:12.231574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b2929a2-daf2-4799-ade9-540bff653185 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.231930 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47be85be-9e05-4f6e-bac1-6b2efe49e983 None None] Pushing event updated for resources: {'Port': ['ID=b5844df0-aec5-4f9c-8ec0-ca35f45bb879,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:12.233366 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46d889d1-a96f-4adf-a16c-65e4f7c25c02 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:12.239168 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-46d889d1-a96f-4adf-a16c-65e4f7c25c02 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/networks/b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 HTTP/1.1" status: 200 len: 804 time: 0.4861882 Dec 10 14:29:12.247278 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57516) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:12.371172 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Attempting to bind port b5844df0-aec5-4f9c-8ec0-ca35f45bb879 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:12.371559 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Attempting to bind port b5844df0-aec5-4f9c-8ec0-ca35f45bb879 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:12.371929 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Attempting to bind port b5844df0-aec5-4f9c-8ec0-ca35f45bb879 on network e900a180-cce3-4df7-9e0d-298a290873ba {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:12.379360 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:12.379684 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Checking segment: {'id': 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:12.380090 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.380491 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Bound using segment: {'id': 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:12.380977 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Bound port: b5844df0-aec5-4f9c-8ec0-ca35f45bb879, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:12.381879 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.384132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b2929a2-daf2-4799-ade9-540bff653185 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=224bf8b6-3cb5-4ebd-be20-9fa406fe35fc,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:12.398908 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] For port bac35f63-cb95-4d03-a0bc-4595f7bec69c, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=bac35f63-cb95-4d03-a0bc-4595f7bec69c,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:12.456543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9d9bf85-f619-4e9e-ace1-e605e68f252e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.458549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9b2929a2-daf2-4799-ade9-540bff653185 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.469561 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9b2929a2-daf2-4799-ade9-540bff653185 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/224bf8b6-3cb5-4ebd-be20-9fa406fe35fc HTTP/1.1" status: 204 len: 168 time: 3.6300206 Dec 10 14:29:12.469561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57518) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:12.490211 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3790b372-089f-4aaa-a0cd-caa0a4231384 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:12.499425 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] For port b5844df0-aec5-4f9c-8ec0-ca35f45bb879, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:12.504871 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] For port b5844df0-aec5-4f9c-8ec0-ca35f45bb879, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b5844df0-aec5-4f9c-8ec0-ca35f45bb879,segment=NetworkSegment(f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a),segment_id=f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:12.527597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9d9bf85-f619-4e9e-ace1-e605e68f252e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.565233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.568825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a77bf5cb-96a7-4c42-80f3-185df191a440 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:12.570748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a77bf5cb-96a7-4c42-80f3-185df191a440 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:12.574829 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a77bf5cb-96a7-4c42-80f3-185df191a440 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1068940 Dec 10 14:29:12.575283 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57520) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:12.577995 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:12.578379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.585532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d9bf85-f619-4e9e-ace1-e605e68f252e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5b6bf120-dc0d-4f09-a3a1-c05aeb047e4b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:12.591636 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.632994 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67eb0726-8baa-4004-9b68-f66042254c36 None None] Update dhcp port {'port': {'network_id': '9bf91f32-9979-4b8d-97d8-65691082eab5', 'fixed_ips': [{'subnet_id': 'd2b69d21-837d-469a-bf15-17a45151604a'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'ce9ed0f4-a437-4778-b175-56dfce2ecd93'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:29:12.644582 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c9d9bf85-f619-4e9e-ace1-e605e68f252e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.645903 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c9d9bf85-f619-4e9e-ace1-e605e68f252e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.8867781 Dec 10 14:29:12.649783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57522) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:12.658012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1075092232', 'security_groups': ['5b6bf120-dc0d-4f09-a3a1-c05aeb047e4b'], 'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '934733e0-bec4-499f-b524-7ee1a80477d5'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:12.677829 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-67eb0726-8baa-4004-9b68-f66042254c36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.695378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57524) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:12.695626 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-63903819-78c1-438d-9069-7ba7b466387a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f HTTP/1.1" status: 200 len: 952 time: 0.4585838 Dec 10 14:29:12.698134 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:12.700999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:12.713521 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] 10.222.0.39 "PUT /v2.0/ports/bac35f63-cb95-4d03-a0bc-4595f7bec69c HTTP/1.1" status: 200 len: 1094 time: 3.0667145 Dec 10 14:29:12.736345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '42f13496-e928-4712-aca5-df46dbe9b53b', 'tag': 'bac35f63-cb95-4d03-a0bc-4595f7bec69c'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:29:12.747859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5ceee79c-0684-4422-8962-d7e153da5dde" -d '{"events": [{"name": "network-changed", "server_uuid": "42f13496-e928-4712-aca5-df46dbe9b53b", "tag": "bac35f63-cb95-4d03-a0bc-4595f7bec69c"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:29:12.767624 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47be85be-9e05-4f6e-bac1-6b2efe49e983 None None] Pushing event updated for resources: {'Port': ['ID=b5844df0-aec5-4f9c-8ec0-ca35f45bb879,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:12.782611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-03ddc1e2-30b2-4176-bc18-352c725fc07e None None] For port c5a938d2-d8e5-424b-aeda-a7917721322a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a938d2-d8e5-424b-aeda-a7917721322a,segment=NetworkSegment(8884a3d8-3d3b-4c8a-a374-8f994bb64e01),segment_id=8884a3d8-3d3b-4c8a-a374-8f994bb64e01)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:12.782922 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:12.783588 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:12.830168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:29:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81227985-8e06-404c-a6a5-31cb056ae0a2 x-openstack-request-id: req-81227985-8e06-404c-a6a5-31cb056ae0a2 {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:29:12.830569 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "42f13496-e928-4712-aca5-df46dbe9b53b", "tag": "bac35f63-cb95-4d03-a0bc-4595f7bec69c", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:29:12.830928 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-81227985-8e06-404c-a6a5-31cb056ae0a2 {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:29:12.831490 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '42f13496-e928-4712-aca5-df46dbe9b53b', 'tag': 'bac35f63-cb95-4d03-a0bc-4595f7bec69c', 'status': 'completed', 'code': 200} Dec 10 14:29:12.832564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b4b9d61-cfb8-442d-a50b-e956b68ca505 service neutron] Pushing event updated for resources: {'Port': ['ID=bac35f63-cb95-4d03-a0bc-4595f7bec69c,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:12.856698 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0103376c-213d-4d18-bd9f-83130ee54a45 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/networks/b27b6c39-0c3d-4675-89cd-9e6d2b6a2229?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 320 time: 0.6065660 Dec 10 14:29:12.863150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57528) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:12.881045 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'routes': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:12.883749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.008787 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:13.026389 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3790b372-089f-4aaa-a0cd-caa0a4231384 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:13.026768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.042153 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4d249e8-c343-48f8-a28a-ca82f591da83 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:13.048887 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d4d249e8-c343-48f8-a28a-ca82f591da83 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/subnets/87d059f9-1c74-4752-a500-2102db4239b7 HTTP/1.1" status: 200 len: 843 time: 0.1512625 Dec 10 14:29:13.050494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No DVR routers for this DVR port ce9ed0f4-a437-4778-b175-56dfce2ecd93 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:13.052082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57530) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:13.089751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=ce9ed0f4-a437-4778-b175-56dfce2ecd93,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:13.101942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-8191b2ed-786e-4173-a6ff-efb63b94eb69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 5e1d1bb2-2ce1-4a3f-9f7b-526e93ce252b {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:13.114859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8191b2ed-786e-4173-a6ff-efb63b94eb69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.133326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-03ddc1e2-30b2-4176-bc18-352c725fc07e None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.188464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Provisioning complete for port b5844df0-aec5-4f9c-8ec0-ca35f45bb879 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:13.189390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.253896 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 2648b8af-c0bf-4811-b353-779f2426f8b8 up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:13.302114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8191b2ed-786e-4173-a6ff-efb63b94eb69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.307642 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca42e091-c2f1-44ea-a5eb-1d965e38f602 None None] Network 9bf91f32-9979-4b8d-97d8-65691082eab5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:13.308745 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.309957 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-03ddc1e2-30b2-4176-bc18-352c725fc07e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.334974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9bf91f32-9979-4b8d-97d8-65691082eab5']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:13.355202 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e5158ce0-9cf5-4f99-81b2-e66056474384') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:13.355781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e5158ce0-9cf5-4f99-81b2-e66056474384') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:13.379186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.407055 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.419869 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Releasing vlan 351 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:13.420413 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:13.479078 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:13.507124 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:08Z', 'revision_number': 6, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:12Z', 'revision_number': 4, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:13.537709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2df7543c-dbbc-4a39-a8f3-578ec580c941 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['shared'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:13.539531 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2df7543c-dbbc-4a39-a8f3-578ec580c941 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "GET /v2.0/subnets/87d059f9-1c74-4752-a500-2102db4239b7?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.4464691 Dec 10 14:29:13.551124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc2c0d78-05c0-42c3-8961-a0fa6ac1431f req-402f7d3a-5b15-490b-9cd1-5d877907ffcc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:13.553792 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-bc2c0d78-05c0-42c3-8961-a0fa6ac1431f req-402f7d3a-5b15-490b-9cd1-5d877907ffcc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 944 time: 0.1200414 Dec 10 14:29:13.554618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:13.554868 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57534) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:13.559950 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1623676588'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:13.564389 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ceee79c-0684-4422-8962-d7e153da5dde req-6f90bd96-68f2-4540-be49-0adbf81db2b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:13.565753 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cf427e1-99c3-4559-a86f-7fb182191e44 None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:08Z', 'revision_number': 6, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:12Z', 'revision_number': 4, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:13.566947 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5ceee79c-0684-4422-8962-d7e153da5dde req-6f90bd96-68f2-4540-be49-0adbf81db2b6 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 1097 time: 0.7248435 Dec 10 14:29:13.571532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ddc1e2-30b2-4176-bc18-352c725fc07e None None] Pushing event updated for resources: {'Port': ['ID=c5a938d2-d8e5-424b-aeda-a7917721322a,revision_number=6']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:13.606466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.677872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf9a826a-b0c5-4837-aef7-d068ee1fa1e8 None None] DHCP port deletion for 9bf91f32-9979-4b8d-97d8-65691082eab5 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:13.698449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8191b2ed-786e-4173-a6ff-efb63b94eb69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.722504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port 2648b8af-c0bf-4811-b353-779f2426f8b8 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:13.723428 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.728124 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.768778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.813910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.821113 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 3790b372-089f-4aaa-a0cd-caa0a4231384, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3790b372-089f-4aaa-a0cd-caa0a4231384,segment=NetworkSegment(f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a),segment_id=f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:13.822419 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/networks/9bf91f32-9979-4b8d-97d8-65691082eab5 HTTP/1.1" status: 204 len: 168 time: 2.4459651 Dec 10 14:29:13.828580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57536) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:13.853065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:13.859668 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.864301 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3fc7845-306f-44cb-a685-769cecf6793b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Network': ['ID=9bf91f32-9979-4b8d-97d8-65691082eab5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:13.873616 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ceee79c-0684-4422-8962-d7e153da5dde req-da4b9e08-2791-4d1a-9f8c-46b00bf00397 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:13.874101 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ceee79c-0684-4422-8962-d7e153da5dde req-da4b9e08-2791-4d1a-9f8c-46b00bf00397 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:13.879039 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5ceee79c-0684-4422-8962-d7e153da5dde req-da4b9e08-2791-4d1a-9f8c-46b00bf00397 service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&shared=False HTTP/1.1" status: 200 len: 1583 time: 0.3005335 Dec 10 14:29:13.880826 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] For port b5844df0-aec5-4f9c-8ec0-ca35f45bb879, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b5844df0-aec5-4f9c-8ec0-ca35f45bb879,segment=NetworkSegment(f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a),segment_id=f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:13.886242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:13.888068 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ea1ccf81-23a5-41dd-8e9b-8ee0568b069e up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:13.952734 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-bc2c0d78-05c0-42c3-8961-a0fa6ac1431f req-7a865bc5-6942-4773-938b-156da0d8a22d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3919203 Dec 10 14:29:13.996632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] vlan segment allocate from pool success with {'vlan_id': 386, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:29:14.015625 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.016116 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Added segment c4ebe3d3-0e48-42bd-a927-dd16fa286ca3 of type vlan for network c0b59116-099a-4a27-9f21-a60d08c1d049 Dec 10 14:29:14.057117 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.068199 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:14.110556 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.114202 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ceee79c-0684-4422-8962-d7e153da5dde req-f36c4db1-ddc5-4ce7-a785-e5703a318f5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:14.116405 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5ceee79c-0684-4422-8962-d7e153da5dde req-f36c4db1-ddc5-4ce7-a785-e5703a318f5e service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2299557 Dec 10 14:29:14.120097 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.164386 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.182746 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:14.183377 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:14.186810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Provisioning complete for port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:14.187176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.198912 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=3790b372-089f-4aaa-a0cd-caa0a4231384,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:14.200325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db3d2b3d-8b09-4b53-9972-0f4b9222c672 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:14.206859 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-db3d2b3d-8b09-4b53-9972-0f4b9222c672 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.3646934 Dec 10 14:29:14.208183 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57538) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:14.209380 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.227474 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:14.229044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.246620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8191b2ed-786e-4173-a6ff-efb63b94eb69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.298107 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8191b2ed-786e-4173-a6ff-efb63b94eb69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.304400 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8191b2ed-786e-4173-a6ff-efb63b94eb69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/5e1d1bb2-2ce1-4a3f-9f7b-526e93ce252b HTTP/1.1" status: 204 len: 168 time: 1.7260845 Dec 10 14:29:14.309164 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] device_id is not set on port a5ed60d6-f7ac-4680-87df-ba23c054c9fb yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:14.310302 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57540) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:14.316994 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:29:14.322702 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cfa4746f-9c5e-4996-99d8-65a0cc5c814a" -d '{"events": [{"server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "name": "network-vif-plugged", "status": "completed", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:29:14.358607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-488fc9d3-4025-413b-a8df-1e32555c420a None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:14.370899 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8191b2ed-786e-4173-a6ff-efb63b94eb69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=5e1d1bb2-2ce1-4a3f-9f7b-526e93ce252b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:14.385283 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f2ded23f-fca2-4279-8e57-079a327de26c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0707195 Dec 10 14:29:14.386651 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-98f677aa-01a8-414d-be53-875f11ae2f04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:14.389597 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-98f677aa-01a8-414d-be53-875f11ae2f04 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 1097 time: 0.2290673 Dec 10 14:29:14.389768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57544) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:14.392627 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.8368087 Dec 10 14:29:14.393583 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bacf1ad4-f455-498e-8933-93e7472c526d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Network': ['ID=c0b59116-099a-4a27-9f21-a60d08c1d049,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:14.396251 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57546) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:14.401178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'network_id': 'c0b59116-099a-4a27-9f21-a60d08c1d049', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888'], 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:14.420875 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:14.433921 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:29:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f92ff7c5-9d34-4926-a43f-b12426dda128 x-openstack-request-id: req-f92ff7c5-9d34-4926-a43f-b12426dda128 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:29:14.434299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "name": "network-vif-plugged", "status": "completed", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:29:14.434487 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-f92ff7c5-9d34-4926-a43f-b12426dda128 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:29:14.434858 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'code': 200} Dec 10 14:29:14.438630 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network c0b59116-099a-4a27-9f21-a60d08c1d049 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:29:14.490594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added routes are [] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 10 14:29:14.490910 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Removed routes are [{'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 10 14:29:14.510302 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-605477c1-7e11-4fae-9c82-bc31c44915b6 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.19&port_id=bac35f63-cb95-4d03-a0bc-4595f7bec69c HTTP/1.1" status: 200 len: 217 time: 0.1033471 Dec 10 14:29:14.537035 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.554115 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.561073 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Pushing event updated for resources: {'Port': ['ID=b5844df0-aec5-4f9c-8ec0-ca35f45bb879,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:14.574955 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:14.575563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.576871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:14.598510 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7cd68192-68a3-4864-a07f-bb3cc8578e55 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.3811414 Dec 10 14:29:14.599864 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57548) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:14.605225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-630165006'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:14.617249 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-8bd198da-f6e2-4ec4-8e29-e7f9e02f8117 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:14.617958 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-8bd198da-f6e2-4ec4-8e29-e7f9e02f8117 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=8bcb9694-fbbf-4a44-b94d-96729fcd88cb HTTP/1.1" status: 200 len: 837 time: 0.0998013 Dec 10 14:29:14.623509 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:14.642288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-607beddf-0809-4e08-9ef6-9192fded61bb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:14.646822 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-607beddf-0809-4e08-9ef6-9192fded61bb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.2534499 Dec 10 14:29:14.649615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57550) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:14.707628 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-511241e0-7328-4f42-a8ef-14f496bc3cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:14.710348 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-511241e0-7328-4f42-a8ef-14f496bc3cc1 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=b44c5886-b77e-456d-b9b8-db5350758724&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0792620 Dec 10 14:29:14.779680 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Made reservation on behalf of 243ec7ec23134148a44eb888e6040f25 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:14.785894 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.786899 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Could not find standard attr ID for object 8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:14.799983 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Could not find standard attr ID for object ce9ed0f4-a437-4778-b175-56dfce2ecd93. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:14.802932 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=2648b8af-c0bf-4811-b353-779f2426f8b8,revision_number=8']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:14.823916 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Could not find standard attr ID for object 136fe677-c56a-4da0-8652-0fe4f4d3056c. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:14.833721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e794cab-4726-4e89-b0af-74dfd9676997 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:14.835205 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7e794cab-4726-4e89-b0af-74dfd9676997 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1847708 Dec 10 14:29:14.838973 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.8 (e9b085a0-e0b5-4630-9607-8d0706a5122c/934733e0-bec4-499f-b524-7ee1a80477d5/a5ed60d6-f7ac-4680-87df-ba23c054c9fb) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:14.843808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57552) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:14.889374 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8691c3e8-cc00-46d0-b631-ad206d8c17ce tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0438848 Dec 10 14:29:14.897650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57554) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:14.904964 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Performing IP validity checks on allocation pools {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 10 14:29:14.905844 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103810) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 10 14:29:14.907831 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:14.926571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:14.926571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.926836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Provisioning complete for port 3790b372-089f-4aaa-a0cd-caa0a4231384 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:14.926836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81316943-7a46-42f8-a02c-1f95282bd89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:14.989279 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-401a1d46-c1e3-4cf6-b31d-098b20d53df0 service neutron] 10.222.0.39 "GET /v2.0/networks/b44c5886-b77e-456d-b9b8-db5350758724?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2718549 Dec 10 14:29:15.135275 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-027eb53f-9062-43aa-a374-d1e505b011cb None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:15.136073 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4b134f17-e449-4a7a-93ed-f41a82f79825 req-69a6c689-b1d6-4421-a554-aa1726c07820 service neutron] 10.222.0.39 "GET /v2.0/networks/b44c5886-b77e-456d-b9b8-db5350758724?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1378376 Dec 10 14:29:15.196766 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a938d2-d8e5-424b-aeda-a7917721322a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:15.213801 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] vlan segment allocate from pool success with {'vlan_id': 399, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:29:15.286104 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.358148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=1400b6d2-fa10-43bc-96fa-938d15edeb81,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:15.368833 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-027eb53f-9062-43aa-a374-d1e505b011cb None None] Deleting port ca498c99-21ce-4498-b4f1-a08eaa4cef74 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:15.369208 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-027eb53f-9062-43aa-a374-d1e505b011cb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.382379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Checking segment: {'id': 'c4ebe3d3-0e48-42bd-a927-dd16fa286ca3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': 'c0b59116-099a-4a27-9f21-a60d08c1d049'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:15.382821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network hostable DHCP agents. Network: c0b59116-099a-4a27-9f21-a60d08c1d049, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:29:15.388471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:15.388856 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.456025 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Network c0b59116-099a-4a27-9f21-a60d08c1d049 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:29:15.473976 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:08Z', 'revision_number': 6, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:13Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:15.483793 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-027eb53f-9062-43aa-a374-d1e505b011cb None None] For port ca498c99-21ce-4498-b4f1-a08eaa4cef74, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ca498c99-21ce-4498-b4f1-a08eaa4cef74,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:15.484198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-027eb53f-9062-43aa-a374-d1e505b011cb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.520007 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, c0b59116-099a-4a27-9f21-a60d08c1d049) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:15.525534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:15.529775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.531348 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:15.535524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-027eb53f-9062-43aa-a374-d1e505b011cb None None] Calling delete_port for ca498c99-21ce-4498-b4f1-a08eaa4cef74 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:15.538518 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28a7e928-c049-409a-b75c-f40131af62fc None None] Network c0b59116-099a-4a27-9f21-a60d08c1d049 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:15.609919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.611581 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d8ba40ab-c669-4d97-8508-2146f1828655 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 895 time: 1.2125943 Dec 10 14:29:15.612505 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57558) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:15.619751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ee39f5b5-c04f-4dc8-b7f2-bf4b556a483e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2005::1'}], 'dns_nameservers': ['2001:4860:4860::7744', '2001:4860:4860::7888'], 'gateway_ip': '2001:db8::2', 'enable_dhcp': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:15.627516 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.627874 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Added segment 6d3309d3-c08c-48d0-850c-624e72fc3bb5 of type vlan for network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 Dec 10 14:29:15.643664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Provisioning complete for port ca498c99-21ce-4498-b4f1-a08eaa4cef74 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:15.644266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.645851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:15.647173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:15.647316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.667105 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-493c903b-fbaf-4008-80a7-905c36f8dbc7 req-829963e5-7525-4ad0-bb56-4ffdd57ed353 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:15.668776 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-493c903b-fbaf-4008-80a7-905c36f8dbc7 req-829963e5-7525-4ad0-bb56-4ffdd57ed353 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 944 time: 0.5866711 Dec 10 14:29:15.747970 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee39f5b5-c04f-4dc8-b7f2-bf4b556a483e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-127044008'] for subnet, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.772080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.774180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:15.777855 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.865400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:15.868487 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device cbcc7a12-8783-47cd-9c2b-9efbf73dac97 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:15.906780 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.db.resource_extend [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 10 14:29:15.951520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-c0b59116-099a-4a27-9f21-a60d08c1d049', 'network_id': 'c0b59116-099a-4a27-9f21-a60d08c1d049', 'project_id': '243ec7ec23134148a44eb888e6040f25', 'fixed_ips': [{'subnet_id': '1400b6d2-fa10-43bc-96fa-938d15edeb81'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:15.952419 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.958470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:15.973449 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-493c903b-fbaf-4008-80a7-905c36f8dbc7 req-86f8fab3-b27d-4492-a3cf-934c1199ab58 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2754383 Dec 10 14:29:16.002729 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee39f5b5-c04f-4dc8-b7f2-bf4b556a483e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8745562688988', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-127408590'] for subnet, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.003787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:16.047171 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee39f5b5-c04f-4dc8-b7f2-bf4b556a483e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:16.048117 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee39f5b5-c04f-4dc8-b7f2-bf4b556a483e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.050021 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ee39f5b5-c04f-4dc8-b7f2-bf4b556a483e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "PUT /v2.0/subnets/1400b6d2-fa10-43bc-96fa-938d15edeb81 HTTP/1.1" status: 200 len: 900 time: 0.4352827 Dec 10 14:29:16.058722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57560) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:16.066594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-027eb53f-9062-43aa-a374-d1e505b011cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.104015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.109794 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:16.110616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.120288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee39f5b5-c04f-4dc8-b7f2-bf4b556a483e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event updated for resources: {'Subnet': ['ID=1400b6d2-fa10-43bc-96fa-938d15edeb81,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:16.170715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.195588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-027eb53f-9062-43aa-a374-d1e505b011cb None None] Pushing event deleted for resources: {'Port': ['ID=ca498c99-21ce-4498-b4f1-a08eaa4cef74,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:16.200119 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-027eb53f-9062-43aa-a374-d1e505b011cb None None] No DVR routers for this DVR port ca498c99-21ce-4498-b4f1-a08eaa4cef74 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:16.221490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.228606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.241360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.306258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:16.306634 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.312824 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.7119732 Dec 10 14:29:16.315805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57562) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:16.323399 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c9c7ba8-1ad8-447b-9a39-714ad648dd78 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Network': ['ID=b4f6bb8c-3923-4753-8423-c8d091bbbbe2,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:16.335027 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': 'b4f6bb8c-3923-4753-8423-c8d091bbbbe2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:16.347242 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:16.354250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:16.363325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.367155 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b8bd3c4c-fb3c-402f-b86a-55993fb58735 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f HTTP/1.1" status: 200 len: 702 time: 3.4895914 Dec 10 14:29:16.367757 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57564) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:16.374442 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:16.389137 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:29:16.414861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:16.479158 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=a5ed60d6-f7ac-4680-87df-ba23c054c9fb,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:16.488646 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.493861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Allocated IP 2001:db8::3 (c0b59116-099a-4a27-9f21-a60d08c1d049/1400b6d2-fa10-43bc-96fa-938d15edeb81/e74c868c-b1c7-4408-bebf-29968d0ff00e) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:16.527993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:16.531614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.560344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:16.560985 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.564220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:16.564575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:16.564685 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.576893 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7c58a994-4c01-4b52-bfc1-d4a31001b304 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f HTTP/1.1" status: 200 len: 702 time: 0.2075858 Dec 10 14:29:16.583128 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:16.585188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57566) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:16.590430 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:16.591281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.608392 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=27c801e6-c2b3-4a50-844a-b4d8911c9a98,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:16.616122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa2c6201-a510-4933-a411-fa6b8040b82b None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:16.690858 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3c4b50da-e41c-4164-b5dc-efa86e055b1e tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 4.0397291 Dec 10 14:29:16.694632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57568) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:16.705856 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-cfb039a0-8583-4083-b8d0-54c33bf9d976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:16.738279 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-979f3344-8ce4-4701-ba2b-2d9980cb52ab tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.8352270 Dec 10 14:29:16.742980 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57570) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:16.747924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': '27c801e6-c2b3-4a50-844a-b4d8911c9a98', 'ip_address': '2001:db8::2f7e:9242:857:8476'}], 'name': 'tempest-NetworksTestDHCPv6-1776743879'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:16.945816 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cfb039a0-8583-4083-b8d0-54c33bf9d976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:16.951308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cfb039a0-8583-4083-b8d0-54c33bf9d976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:16.964459 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:14Z', 'revision_number': 7, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:13Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:16.977907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ca498c99-21ce-4498-b4f1-a08eaa4cef74 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:17.057732 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7acfe8ff-50c1-480e-9612-1c9d9b957b60 None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:14Z', 'revision_number': 7, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:13Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:17.067750 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: ca498c99-21ce-4498-b4f1-a08eaa4cef74 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:17.068099 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ca498c99-21ce-4498-b4f1-a08eaa4cef74 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Dec 10 14:29:17.085307 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.ipam_backend_mixin [None req-cfb039a0-8583-4083-b8d0-54c33bf9d976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 934733e0-bec4-499f-b524-7ee1a80477d5 (CIDR: 172.20.0.0/28) Dec 10 14:29:17.137461 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Port ca498c99-21ce-4498-b4f1-a08eaa4cef74 not found, will not notify nova. {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Dec 10 14:29:17.137774 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ce9ed0f4-a437-4778-b175-56dfce2ecd93 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:17.165814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '27c801e6-c2b3-4a50-844a-b4d8911c9a98'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:17.166705 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0820a11-a1c6-436f-b8e1-0917c048288e req-3aa882d5-10c5-469f-943d-47186c8a1574 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:17.166836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.168857 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d0820a11-a1c6-436f-b8e1-0917c048288e req-3aa882d5-10c5-469f-943d-47186c8a1574 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 944 time: 0.0818019 Dec 10 14:29:17.171404 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-cfb039a0-8583-4083-b8d0-54c33bf9d976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:29:17.171815 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cfb039a0-8583-4083-b8d0-54c33bf9d976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:17.174151 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: ce9ed0f4-a437-4778-b175-56dfce2ecd93 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:17.174525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ce9ed0f4-a437-4778-b175-56dfce2ecd93 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Dec 10 14:29:17.217590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.219983 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Port ce9ed0f4-a437-4778-b175-56dfce2ecd93 not found, will not notify nova. {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Dec 10 14:29:17.235432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Provisioning complete for port b5844df0-aec5-4f9c-8ec0-ca35f45bb879 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:17.235783 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.236969 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d0820a11-a1c6-436f-b8e1-0917c048288e req-8959ef8a-b22d-4cdf-99d0-3bbcb6105ae1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0617092 Dec 10 14:29:17.240680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device bac35f63-cb95-4d03-a0bc-4595f7bec69c details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:29:17.296387 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cfb039a0-8583-4083-b8d0-54c33bf9d976 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.6004517 Dec 10 14:29:17.301807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57574) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:17.312530 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3865a624-94ba-4932-a7ac-b0cfde0ddda6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:17.352383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.477701 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:17.492889 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:17.493903 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:17.522227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Network c0b59116-099a-4a27-9f21-a60d08c1d049 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:17.523537 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b5844df0-aec5-4f9c-8ec0-ca35f45bb879 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:17.535997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:17.555521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.573832 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:17.577674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Pushing event updated for resources: {'Port': ['ID=e74c868c-b1c7-4408-bebf-29968d0ff00e,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:17.592255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:17.597694 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=1400b6d2-fa10-43bc-96fa-938d15edeb81,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:17.602940 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:17.640130 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.640403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.641918 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.642412 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.643309 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.643309 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.643668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.645906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.646949 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.647392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.652726 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.652726 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.652726 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:29:17.662812 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.699524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3865a624-94ba-4932-a7ac-b0cfde0ddda6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:17.704136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3865a624-94ba-4932-a7ac-b0cfde0ddda6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.740695 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.742026 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port bac35f63-cb95-4d03-a0bc-4595f7bec69c, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=bac35f63-cb95-4d03-a0bc-4595f7bec69c,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:17.767210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': 'bac35f63-cb95-4d03-a0bc-4595f7bec69c', 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724', 'port_id': 'bac35f63-cb95-4d03-a0bc-4595f7bec69c', 'mac_address': 'fa:16:3e:fd:05:d0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8bcb9694-fbbf-4a44-b94d-96729fcd88cb', 'ip_address': '172.20.0.19'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:29:17.771331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/27c801e6-c2b3-4a50-844a-b4d8911c9a98/42f82a8e-32c9-468d-9dcd-2c3df4805875) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:17.798267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c0b59116-099a-4a27-9f21-a60d08c1d049']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:17.803336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=0c2f6b45-2d45-4c04-aa82-d2dd4a5553ac,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:17.814533 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.ipam_backend_mixin [None req-3865a624-94ba-4932-a7ac-b0cfde0ddda6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Validation for CIDR: 172.20.0.16/28 failed - overlaps with subnet 0ae340f0-e5b5-4d36-a2da-9c7736d1150e (CIDR: 172.20.0.16/28) Dec 10 14:29:17.845445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c4ebe3d3-0e48-42bd-a927-dd16fa286ca3') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:17.845728 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c4ebe3d3-0e48-42bd-a927-dd16fa286ca3') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:17.860024 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-3865a624-94ba-4932-a7ac-b0cfde0ddda6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:29:17.860995 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3865a624-94ba-4932-a7ac-b0cfde0ddda6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:17.878839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.904721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.911367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.925210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Checking segment: {'id': '6d3309d3-c08c-48d0-850c-624e72fc3bb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b4f6bb8c-3923-4753-8423-c8d091bbbbe2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:17.925766 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network hostable DHCP agents. Network: b4f6bb8c-3923-4753-8423-c8d091bbbbe2, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:29:17.933827 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Attempting to bind port e74c868c-b1c7-4408-bebf-29968d0ff00e on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:17.934210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Attempting to bind port e74c868c-b1c7-4408-bebf-29968d0ff00e by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'c4ebe3d3-0e48-42bd-a927-dd16fa286ca3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': 'c0b59116-099a-4a27-9f21-a60d08c1d049'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:17.934336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 386 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:17.934659 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.934804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Attempting to bind port e74c868c-b1c7-4408-bebf-29968d0ff00e on network c0b59116-099a-4a27-9f21-a60d08c1d049 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:17.939342 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:17.960672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:17.960933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port c9a9d483-c13d-44fa-b912-76ed0d11521b yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:17.961066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Checking segment: {'id': 'c4ebe3d3-0e48-42bd-a927-dd16fa286ca3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': 'c0b59116-099a-4a27-9f21-a60d08c1d049'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:17.961495 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.961904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Bound using segment: {'id': 'c4ebe3d3-0e48-42bd-a927-dd16fa286ca3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': 'c0b59116-099a-4a27-9f21-a60d08c1d049'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:17.962402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Bound port: e74c868c-b1c7-4408-bebf-29968d0ff00e, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c4ebe3d3-0e48-42bd-a927-dd16fa286ca3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': 'c0b59116-099a-4a27-9f21-a60d08c1d049'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:17.962793 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.968686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b5844df0-aec5-4f9c-8ec0-ca35f45bb879 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:17.969335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.970857 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Provisioning complete for port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:17.971435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.984441 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3865a624-94ba-4932-a7ac-b0cfde0ddda6 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 425 time: 0.6811395 Dec 10 14:29:17.990965 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57576) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:17.991126 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:17.998051 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'subnet': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'cidr': '172.20.0.32/28', 'ip_version': 4, 'gateway_ip': '172.20.0.33'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:18.031770 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:14Z', 'revision_number': 7, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:13Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:18.060557 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.087107 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:18.106360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.db.api [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 10 14:29:18.106360 dv-neutron-821401-2-hyperv neutron-server[103810]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 10 14:29:18.106360 dv-neutron-821401-2-hyperv neutron-server[103810]: [parameters: {'id': 'c0b59116-099a-4a27-9f21-a60d08c1d049'}] Dec 10 14:29:18.106360 dv-neutron-821401-2-hyperv neutron-server[103810]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103810) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:29:18.106907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG oslo_db.api [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:29:18.108716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bac35f63-cb95-4d03-a0bc-4595f7bec69c {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:29:18.130824 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:18.131894 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:18.135808 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:18.173541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:29:18.193579 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port bac35f63-cb95-4d03-a0bc-4595f7bec69c, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=bac35f63-cb95-4d03-a0bc-4595f7bec69c,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:18.216693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] For port e74c868c-b1c7-4408-bebf-29968d0ff00e, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:18.224251 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] For port e74c868c-b1c7-4408-bebf-29968d0ff00e, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e74c868c-b1c7-4408-bebf-29968d0ff00e,segment=NetworkSegment(c4ebe3d3-0e48-42bd-a927-dd16fa286ca3),segment_id=c4ebe3d3-0e48-42bd-a927-dd16fa286ca3)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:18.225930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.231000 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:18.259926 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Could not find standard attr ID for object ce9ed0f4-a437-4778-b175-56dfce2ecd93. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:18.267337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Could not find standard attr ID for object f9f8f466-5aa0-40a8-9f77-cfb52db44021. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:18.273564 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a938d2-d8e5-424b-aeda-a7917721322a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:18.276255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Could not find standard attr ID for object 136fe677-c56a-4da0-8652-0fe4f4d3056c. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:18.307364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.316130 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-25b97037-a6e9-4858-8e6b-ad546558b324 None None] Could not find standard attr ID for object 224bf8b6-3cb5-4ebd-be20-9fa406fe35fc. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:18.340318 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.342537 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.389620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Made reservation on behalf of 7a25938276dc428b9a5723e37d120269 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:18.391887 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:18.393280 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.397926 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, b4f6bb8c-3923-4753-8423-c8d091bbbbe2) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:18.428724 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b75df2ff-2468-4420-9c26-c5ea7689ca7e None None] Network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:18.431887 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:18.435389 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:18.451132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:18.452095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.474451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=bac35f63-cb95-4d03-a0bc-4595f7bec69c,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:18.475060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9392ef55-1156-4c85-9ec3-f76ae63f2834 req-ff03754d-da50-403b-9d82-416598d3cf3a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:18.487396 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9392ef55-1156-4c85-9ec3-f76ae63f2834 req-ff03754d-da50-403b-9d82-416598d3cf3a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 945 time: 0.1369364 Dec 10 14:29:18.506323 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:14Z', 'revision_number': 7, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:13Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:18.509005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::2f7e:9242:857:8476 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/27c801e6-c2b3-4a50-844a-b4d8911c9a98/c9a9d483-c13d-44fa-b912-76ed0d11521b) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:18.548747 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2afb4f88-b07f-4113-8df5-e160070f80a9 None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:14Z', 'revision_number': 7, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b5844df0-aec5-4f9c-8ec0-ca35f45bb879', 'name': '', 'network_id': 'e900a180-cce3-4df7-9e0d-298a290873ba', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:fe:66:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1000, 'fixed_ips': [{'subnet_id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:01Z', 'updated_at': '2021-12-10T14:29:13Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'c0a6adbb-fcb5-45e3-859f-c62d695f545d', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:18.572415 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:18.572795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.580154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['bac35f63-cb95-4d03-a0bc-4595f7bec69c'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:29:18.582728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15ed9320-0596-4b64-b30b-945504f246e1 None None] Network c0b59116-099a-4a27-9f21-a60d08c1d049 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:18.583372 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9392ef55-1156-4c85-9ec3-f76ae63f2834 req-7379e729-876c-49f8-bcdd-56accf88a249 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0847831 Dec 10 14:29:18.610930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.664278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-41e8c368-ee41-49ca-9f97-5018efb2cee1 None None] Provisioning complete for port a5ed60d6-f7ac-4680-87df-ba23c054c9fb triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:18.664645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-41e8c368-ee41-49ca-9f97-5018efb2cee1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.690493 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f5a1bfeb-43b7-43ae-bfe0-a130aba0615e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.3688161 Dec 10 14:29:18.694295 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57580) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:18.704275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': 'b4f6bb8c-3923-4753-8423-c8d091bbbbe2', 'name': 'tempest-PortsIpV6TestJSON-1033758452'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:18.829350 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Attempting to bind port 42f82a8e-32c9-468d-9dcd-2c3df4805875 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:18.829741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Attempting to bind port 42f82a8e-32c9-468d-9dcd-2c3df4805875 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:18.830114 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Attempting to bind port 42f82a8e-32c9-468d-9dcd-2c3df4805875 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:18.832598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb71c00-34b9-4b6e-92e7-cae217db4c1d None None] Pushing event updated for resources: {'Port': ['ID=e74c868c-b1c7-4408-bebf-29968d0ff00e,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:18.844201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port b5844df0-aec5-4f9c-8ec0-ca35f45bb879 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:18.844609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.850058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-41e8c368-ee41-49ca-9f97-5018efb2cee1 None None] Port a5ed60d6-f7ac-4680-87df-ba23c054c9fb cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:18.872452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.919144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Network e9b085a0-e0b5-4630-9607-8d0706a5122c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:18.922840 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:18.927592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:18.928474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.933137 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:18.946098 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Subnet': ['ID=90e402f7-1e02-4221-bd7e-fa30480a5069,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:18.978911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting port e74c868c-b1c7-4408-bebf-29968d0ff00e {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:18.979247 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.018917 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f673eb60-c4a6-4d6a-9aaf-ed448a61fbd1 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.0271211 Dec 10 14:29:19.022887 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57582) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:19.028580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1742105382', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '90e402f7-1e02-4221-bd7e-fa30480a5069'}], 'security_groups': ['095b410c-f731-4b01-a7cb-445a39e498ee', '4e095f0a-6836-42d1-b39c-9b050a8841b1']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:19.072646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:19.072646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:19.072646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.072646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:19.072646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Bound port: 42f82a8e-32c9-468d-9dcd-2c3df4805875, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:19.072646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.081607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb39ff5a-33ef-476e-a8be-f71a565c6da9 None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:19.103234 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port b5844df0-aec5-4f9c-8ec0-ca35f45bb879, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b5844df0-aec5-4f9c-8ec0-ca35f45bb879,segment=NetworkSegment(f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a),segment_id=f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:19.103614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.113343 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.115559 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] For port e74c868c-b1c7-4408-bebf-29968d0ff00e, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e74c868c-b1c7-4408-bebf-29968d0ff00e,segment=NetworkSegment(c4ebe3d3-0e48-42bd-a927-dd16fa286ca3),segment_id=c4ebe3d3-0e48-42bd-a927-dd16fa286ca3)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:19.120287 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.127062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-b4f6bb8c-3923-4753-8423-c8d091bbbbe2', 'network_id': 'b4f6bb8c-3923-4753-8423-c8d091bbbbe2', 'project_id': 'cc793beea85f4cf887a3485aad20d8e7', 'fixed_ips': [{'subnet_id': '0c2f6b45-2d45-4c04-aa82-d2dd4a5553ac'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:19.128033 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.130623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for b5844df0-aec5-4f9c-8ec0-ca35f45bb879 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:19.136974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Calling delete_port for e74c868c-b1c7-4408-bebf-29968d0ff00e owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:19.197754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Pushing event updated for resources: {'Port': ['ID=42f82a8e-32c9-468d-9dcd-2c3df4805875,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:19.219219 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:19.222801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.228430 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.312371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a917e315-4b9a-4513-ab44-0880c7249a4b None None] Network c0b59116-099a-4a27-9f21-a60d08c1d049 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:19.312955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 344190df-560f-4063-8113-2044cb243d6e yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:19.337327 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:19.374152 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:19.376688 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:19.382893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:19.383471 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.385912 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=c9a9d483-c13d-44fa-b912-76ed0d11521b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:19.401257 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3790b372-089f-4aaa-a0cd-caa0a4231384 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:19.449325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Delete allocated IP 172.20.0.8 (e9b085a0-e0b5-4630-9607-8d0706a5122c/934733e0-bec4-499f-b524-7ee1a80477d5) {{(pid=103811) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 10 14:29:19.459997 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Allocated IP 172.20.0.35 (e9b085a0-e0b5-4630-9607-8d0706a5122c/90e402f7-1e02-4221-bd7e-fa30480a5069/a5ed60d6-f7ac-4680-87df-ba23c054c9fb) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:19.516151 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] For port 42f82a8e-32c9-468d-9dcd-2c3df4805875, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:19.543968 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5fbb4567-02bf-4c98-ab3e-88f90a46b9e7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.7974970 Dec 10 14:29:19.553612 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57584) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:19.554074 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] For port 42f82a8e-32c9-468d-9dcd-2c3df4805875, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=42f82a8e-32c9-468d-9dcd-2c3df4805875,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:19.568721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.629700 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 3790b372-089f-4aaa-a0cd-caa0a4231384 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:19.630078 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.637278 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::16b (b4f6bb8c-3923-4753-8423-c8d091bbbbe2/0c2f6b45-2d45-4c04-aa82-d2dd4a5553ac/344190df-560f-4063-8113-2044cb243d6e) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:19.648971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No DVR routers for this DVR port e74c868c-b1c7-4408-bebf-29968d0ff00e on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:19.655074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Port': ['ID=e74c868c-b1c7-4408-bebf-29968d0ff00e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:19.664860 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.757232 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.770966 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b443f33-c20e-4d77-a2f7-a28b59f412a6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:19.777599 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b443f33-c20e-4d77-a2f7-a28b59f412a6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:19.779407 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3b443f33-c20e-4d77-a2f7-a28b59f412a6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.2223051 Dec 10 14:29:19.785537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401864a0-52bf-459b-b508-40fd1d00ea29 req-cf7f71da-6e0a-47fa-b341-e3dbae46795d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:19.785537 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-401864a0-52bf-459b-b508-40fd1d00ea29 req-cf7f71da-6e0a-47fa-b341-e3dbae46795d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 945 time: 0.0929959 Dec 10 14:29:19.785537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57588) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:19.799770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.813215 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97abe2db-360a-42a1-ba7c-199d98c75a9d None None] Update dhcp port {'port': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'fixed_ips': [{'subnet_id': '0ae340f0-e5b5-4d36-a2da-9c7736d1150e', 'ip_address': '172.20.0.18'}, {'subnet_id': '934733e0-bec4-499f-b524-7ee1a80477d5', 'ip_address': '172.20.0.2'}, {'subnet_id': '90e402f7-1e02-4221-bd7e-fa30480a5069'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'c5a938d2-d8e5-424b-aeda-a7917721322a'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:29:19.820601 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e94ce8-7ded-4c1d-98e7-2ee77b827441 None None] Pushing event updated for resources: {'Port': ['ID=42f82a8e-32c9-468d-9dcd-2c3df4805875,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:19.853127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.858731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=b5844df0-aec5-4f9c-8ec0-ca35f45bb879,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:19.870559 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:29:19.880118 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.911360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-97abe2db-360a-42a1-ba7c-199d98c75a9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:19.913825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c0b59116-099a-4a27-9f21-a60d08c1d049']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:19.997038 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-401864a0-52bf-459b-b508-40fd1d00ea29 req-aba4993a-19a8-43ae-bfc8-f9210a1e5b33 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1790435 Dec 10 14:29:20.001352 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c4ebe3d3-0e48-42bd-a927-dd16fa286ca3') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:20.001583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event updated for resources: {'Port': ['ID=a5ed60d6-f7ac-4680-87df-ba23c054c9fb,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:20.001689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c4ebe3d3-0e48-42bd-a927-dd16fa286ca3') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:20.053382 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.144137 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.197991 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 386 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:20.198408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.201707 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] In _notify_port_updated(), no bound segment for port a5ed60d6-f7ac-4680-87df-ba23c054c9fb on network e9b085a0-e0b5-4630-9607-8d0706a5122c {{(pid=103811) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:20.203356 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:20.207344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ce9ed0f4-a437-4778-b175-56dfce2ecd93 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:20.211456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:20.215218 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.215218 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-59b7806d-fe40-41c4-b3c3-2530b170a254 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "PUT /v2.0/ports/a5ed60d6-f7ac-4680-87df-ba23c054c9fb HTTP/1.1" status: 200 len: 960 time: 1.1892390 Dec 10 14:29:20.216181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57590) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:20.260160 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: ce9ed0f4-a437-4778-b175-56dfce2ecd93 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:20.260578 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ce9ed0f4-a437-4778-b175-56dfce2ecd93 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:20.261062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ca498c99-21ce-4498-b4f1-a08eaa4cef74 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:20.281515 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-40b674f8-ac73-412c-b37a-2dfc8c13f70e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port c9a9d483-c13d-44fa-b912-76ed0d11521b {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:20.281763 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40b674f8-ac73-412c-b37a-2dfc8c13f70e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.302457 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-97abe2db-360a-42a1-ba7c-199d98c75a9d None None] Allocated IP 172.20.0.34 (e9b085a0-e0b5-4630-9607-8d0706a5122c/90e402f7-1e02-4221-bd7e-fa30480a5069/c5a938d2-d8e5-424b-aeda-a7917721322a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:20.306673 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: ca498c99-21ce-4498-b4f1-a08eaa4cef74 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:20.306673 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ca498c99-21ce-4498-b4f1-a08eaa4cef74 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:20.319110 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.321738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.406541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.439348 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.446349 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/c0b59116-099a-4a27-9f21-a60d08c1d049 HTTP/1.1" status: 204 len: 168 time: 4.3865187 Dec 10 14:29:20.456579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57592) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:20.461757 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e3a7f9-5ea8-41ea-a4fd-bd2edbec3893 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=c0b59116-099a-4a27-9f21-a60d08c1d049,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:20.489466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-97abe2db-360a-42a1-ba7c-199d98c75a9d None None] For port c5a938d2-d8e5-424b-aeda-a7917721322a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a938d2-d8e5-424b-aeda-a7917721322a,segment=NetworkSegment(8884a3d8-3d3b-4c8a-a374-8f994bb64e01),segment_id=8884a3d8-3d3b-4c8a-a374-8f994bb64e01)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:20.504426 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-8563c986-efa0-4c49-b121-27fd9bb952b3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:20.505040 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8563c986-efa0-4c49-b121-27fd9bb952b3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:20.508690 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8563c986-efa0-4c49-b121-27fd9bb952b3 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/1400b6d2-fa10-43bc-96fa-938d15edeb81 HTTP/1.1" status: 404 len: 337 time: 0.0487647 Dec 10 14:29:20.515466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57594) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:20.548983 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-3222fe94-8e93-407e-9afa-9c49893d7a21 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:20.550062 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3222fe94-8e93-407e-9afa-9c49893d7a21 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:20.553465 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3222fe94-8e93-407e-9afa-9c49893d7a21 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/c0b59116-099a-4a27-9f21-a60d08c1d049 HTTP/1.1" status: 404 len: 339 time: 0.0315669 Dec 10 14:29:20.555590 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40b674f8-ac73-412c-b37a-2dfc8c13f70e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.561883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-04bcfdf6-2a25-4000-a2a8-456c69c945d9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port a5ed60d6-f7ac-4680-87df-ba23c054c9fb {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:20.562224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-04bcfdf6-2a25-4000-a2a8-456c69c945d9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.563731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-97abe2db-360a-42a1-ba7c-199d98c75a9d None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.602763 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 42f82a8e-32c9-468d-9dcd-2c3df4805875 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:20.610842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57596) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:20.627911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:20.630483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.642627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-97abe2db-360a-42a1-ba7c-199d98c75a9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.650905 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-40b674f8-ac73-412c-b37a-2dfc8c13f70e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for c9a9d483-c13d-44fa-b912-76ed0d11521b owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:20.693138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Allocated IP 2001:db8::2 (b4f6bb8c-3923-4753-8423-c8d091bbbbe2/0c2f6b45-2d45-4c04-aa82-d2dd4a5553ac/df586b0a-b4af-494c-a728-760f5cabfbf9) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:20.705012 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=344190df-560f-4063-8113-2044cb243d6e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:20.737294 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.752541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:20.755452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97abe2db-360a-42a1-ba7c-199d98c75a9d None None] Pushing event updated for resources: {'Port': ['ID=c5a938d2-d8e5-424b-aeda-a7917721322a,revision_number=7']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:20.757595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:20.760691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:20.766808 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:20.767449 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.790077 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-04bcfdf6-2a25-4000-a2a8-456c69c945d9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.805195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-04bcfdf6-2a25-4000-a2a8-456c69c945d9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for a5ed60d6-f7ac-4680-87df-ba23c054c9fb owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:20.839989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:20.851951 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a6c376ef-2f07-466a-a2f0-d752ad203ee0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2627637 Dec 10 14:29:20.853518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57598) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:20.855387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 42f82a8e-32c9-468d-9dcd-2c3df4805875 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:20.855791 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:20.881466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:20.907450 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c7f5e90b-6dd8-4c10-9769-b63ad392f4f8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.2083783 Dec 10 14:29:20.913771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57600) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:20.919962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': 'b4f6bb8c-3923-4753-8423-c8d091bbbbe2', 'name': 'tempest-PortsIpV6TestJSON-945315721'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:20.983690 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.004780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-21191db7-993c-4f73-954c-a9f83582e007 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting subnet c0a6adbb-fcb5-45e3-859f-c62d695f545d {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:21.012429 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:21.013216 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:21.014964 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21191db7-993c-4f73-954c-a9f83582e007 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.061610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.117705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21191db7-993c-4f73-954c-a9f83582e007 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.213706 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:21.226028 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:21.233012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:21.256214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21191db7-993c-4f73-954c-a9f83582e007 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.256375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.256375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Pushing event updated for resources: {'Port': ['ID=df586b0a-b4af-494c-a728-760f5cabfbf9,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:21.257178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:21.292515 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40b674f8-ac73-412c-b37a-2dfc8c13f70e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.323403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device bac35f63-cb95-4d03-a0bc-4595f7bec69c up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:21.336311 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:21.350739 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.371363 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 9199c743-fd58-4b06-92a9-6a8b9e4409e1 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:21.380390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.405611 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07871862-68be-4160-aeac-f3302f018b2b']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:21.417319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '075775cf-ff51-41f8-a29e-21540cc0a1f9') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:21.417714 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '075775cf-ff51-41f8-a29e-21540cc0a1f9') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:21.469982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40b674f8-ac73-412c-b37a-2dfc8c13f70e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=c9a9d483-c13d-44fa-b912-76ed0d11521b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:21.488790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.495505 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21191db7-993c-4f73-954c-a9f83582e007 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.525466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-04bcfdf6-2a25-4000-a2a8-456c69c945d9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.537000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.565142 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7926c54-c3a9-457f-a1a6-0fb3ca6b848f req-2e0e1cca-1b8c-448d-a43f-f663d762281d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:21.573042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21191db7-993c-4f73-954c-a9f83582e007 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Subnet': ['ID=c0a6adbb-fcb5-45e3-859f-c62d695f545d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:21.577188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21191db7-993c-4f73-954c-a9f83582e007 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.579844 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d7926c54-c3a9-457f-a1a6-0fb3ca6b848f req-2e0e1cca-1b8c-448d-a43f-f663d762281d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 945 time: 0.3726549 Dec 10 14:29:21.581034 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-21191db7-993c-4f73-954c-a9f83582e007 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/c0a6adbb-fcb5-45e3-859f-c62d695f545d HTTP/1.1" status: 204 len: 168 time: 0.7255449 Dec 10 14:29:21.592361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57604) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:21.628359 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ad5246a-8800-42b7-895b-5c97af11e049 None None] Network e900a180-cce3-4df7-9e0d-298a290873ba requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:21.647127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 392 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:21.647550 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.652572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40b674f8-ac73-412c-b37a-2dfc8c13f70e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.655933 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-40b674f8-ac73-412c-b37a-2dfc8c13f70e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/c9a9d483-c13d-44fa-b912-76ed0d11521b HTTP/1.1" status: 204 len: 168 time: 1.8688438 Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:21.656811 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:21.670306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04bcfdf6-2a25-4000-a2a8-456c69c945d9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=a5ed60d6-f7ac-4680-87df-ba23c054c9fb,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:21.680845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57606) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:21.705036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Attempting to bind port df586b0a-b4af-494c-a728-760f5cabfbf9 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:21.705441 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Attempting to bind port df586b0a-b4af-494c-a728-760f5cabfbf9 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6d3309d3-c08c-48d0-850c-624e72fc3bb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b4f6bb8c-3923-4753-8423-c8d091bbbbe2'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:21.705809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Attempting to bind port df586b0a-b4af-494c-a728-760f5cabfbf9 on network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:21.746702 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:21.747093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Checking segment: {'id': '6d3309d3-c08c-48d0-850c-624e72fc3bb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b4f6bb8c-3923-4753-8423-c8d091bbbbe2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:21.747405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.747809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Bound using segment: {'id': '6d3309d3-c08c-48d0-850c-624e72fc3bb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b4f6bb8c-3923-4753-8423-c8d091bbbbe2'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:21.748306 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Bound port: df586b0a-b4af-494c-a728-760f5cabfbf9, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6d3309d3-c08c-48d0-850c-624e72fc3bb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b4f6bb8c-3923-4753-8423-c8d091bbbbe2'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:21.748705 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.777717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 42f82a8e-32c9-468d-9dcd-2c3df4805875, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=42f82a8e-32c9-468d-9dcd-2c3df4805875,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:21.805100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f95f990-2409-40d4-bd83-44db1f3723ac tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:21.806883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f95f990-2409-40d4-bd83-44db1f3723ac tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:21.809788 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9f95f990-2409-40d4-bd83-44db1f3723ac tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1216636 Dec 10 14:29:21.852033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57608) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:21.874042 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d7926c54-c3a9-457f-a1a6-0fb3ca6b848f req-78b4615d-e667-41df-b5d9-e82fa3479e81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2931507 Dec 10 14:29:21.894369 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:21.964672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=42f82a8e-32c9-468d-9dcd-2c3df4805875,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:21.968718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-13860531-73d2-4e76-9580-8f4dd04393ca None None] Provisioning complete for port 42f82a8e-32c9-468d-9dcd-2c3df4805875 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:21.969102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-13860531-73d2-4e76-9580-8f4dd04393ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.006363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-62e37dad-07b2-49bc-a892-df908e98651e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 27c801e6-c2b3-4a50-844a-b4d8911c9a98 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:22.010204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-62e37dad-07b2-49bc-a892-df908e98651e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.035768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port bac35f63-cb95-4d03-a0bc-4595f7bec69c completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:29:22.063645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-62e37dad-07b2-49bc-a892-df908e98651e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.067967 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port bac35f63-cb95-4d03-a0bc-4595f7bec69c triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:22.068341 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.079476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] For port df586b0a-b4af-494c-a728-760f5cabfbf9, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:22.136922 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::243 (b4f6bb8c-3923-4753-8423-c8d091bbbbe2/0c2f6b45-2d45-4c04-aa82-d2dd4a5553ac/9199c743-fd58-4b06-92a9-6a8b9e4409e1) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:22.144921 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] For port df586b0a-b4af-494c-a728-760f5cabfbf9, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=df586b0a-b4af-494c-a728-760f5cabfbf9,segment=NetworkSegment(6d3309d3-c08c-48d0-850c-624e72fc3bb5),segment_id=6d3309d3-c08c-48d0-850c-624e72fc3bb5)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:22.169232 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.179366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-62e37dad-07b2-49bc-a892-df908e98651e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.227166 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.237172 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.296681 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] DHCP port deletion for e900a180-cce3-4df7-9e0d-298a290873ba request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:22.385478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 3790b372-089f-4aaa-a0cd-caa0a4231384 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:22.386217 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.387098 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57df859a-a2cf-4050-aa40-3500df193c46 None None] Pushing event updated for resources: {'Port': ['ID=df586b0a-b4af-494c-a728-760f5cabfbf9,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:22.416716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:19Z', 'revision_number': 8, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:22.423336 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.498817 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.506480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:22.513476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 42f82a8e-32c9-468d-9dcd-2c3df4805875 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:22.523432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port 3790b372-089f-4aaa-a0cd-caa0a4231384, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=3790b372-089f-4aaa-a0cd-caa0a4231384,segment=NetworkSegment(f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a),segment_id=f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:22.523811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.549656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 3790b372-089f-4aaa-a0cd-caa0a4231384 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:22.584339 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f435d34b-7097-487e-b98a-f240099eaa91 None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:22.584731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f435d34b-7097-487e-b98a-f240099eaa91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.607450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '42f13496-e928-4712-aca5-df46dbe9b53b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bac35f63-cb95-4d03-a0bc-4595f7bec69c'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:29:22.615117 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-575bac22-9884-49bc-b68c-e66210ed7278" -d '{"events": [{"server_uuid": "42f13496-e928-4712-aca5-df46dbe9b53b", "name": "network-vif-plugged", "status": "completed", "tag": "bac35f63-cb95-4d03-a0bc-4595f7bec69c"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:29:22.643987 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port bac35f63-cb95-4d03-a0bc-4595f7bec69c, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=bac35f63-cb95-4d03-a0bc-4595f7bec69c,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:22.674662 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:22.675525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:22.686172 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.753332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:22.761846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:22.764549 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:22.772249 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:22.772934 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.778724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=9199c743-fd58-4b06-92a9-6a8b9e4409e1,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:22.808230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:29:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-66f8cef7-c703-4690-baab-cf8b6b62f974 x-openstack-request-id: req-66f8cef7-c703-4690-baab-cf8b6b62f974 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:29:22.808546 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "42f13496-e928-4712-aca5-df46dbe9b53b", "name": "network-vif-plugged", "status": "completed", "tag": "bac35f63-cb95-4d03-a0bc-4595f7bec69c", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:29:22.808789 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-66f8cef7-c703-4690-baab-cf8b6b62f974 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:29:22.809193 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '42f13496-e928-4712-aca5-df46dbe9b53b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bac35f63-cb95-4d03-a0bc-4595f7bec69c', 'code': 200} Dec 10 14:29:22.817482 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.833493 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:22.867463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.867689 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.873052 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/07871862-68be-4160-aeac-f3302f018b2b HTTP/1.1" status: 204 len: 168 time: 2.2495654 Dec 10 14:29:22.875509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57612) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:22.896449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df5a377-9c88-498b-b22d-2f68bb2382ee tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=07871862-68be-4160-aeac-f3302f018b2b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:22.932127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-04bcfdf6-2a25-4000-a2a8-456c69c945d9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:22.937567 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-04bcfdf6-2a25-4000-a2a8-456c69c945d9 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/a5ed60d6-f7ac-4680-87df-ba23c054c9fb HTTP/1.1" status: 204 len: 168 time: 2.7180202 Dec 10 14:29:22.937881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57616) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:22.972776 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-4a7b854a-5379-48ba-8d33-0ba348f4df8b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] GET failed (client error): The resource could not be found. Dec 10 14:29:22.977328 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4a7b854a-5379-48ba-8d33-0ba348f4df8b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports/a5ed60d6-f7ac-4680-87df-ba23c054c9fb HTTP/1.1" status: 404 len: 333 time: 0.0355313 Dec 10 14:29:22.977667 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57618) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:22.987121 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1f4bf0b9-88e5-43fd-a140-632e8143c951 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.0710871 Dec 10 14:29:22.987425 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=3790b372-089f-4aaa-a0cd-caa0a4231384,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:22.992926 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No DVR routers for this DVR port 3790b372-089f-4aaa-a0cd-caa0a4231384 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:22.996250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57620) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:22.999479 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-62840eb8-a3d9-47bf-969e-c532f3834159 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:22.999949 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-62840eb8-a3d9-47bf-969e-c532f3834159 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:23.003180 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-62840eb8-a3d9-47bf-969e-c532f3834159 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/e4d6cc5b-98af-43cc-ad59-a1c1bffc23c0 HTTP/1.1" status: 404 len: 337 time: 0.1212723 Dec 10 14:29:23.021650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57622) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:23.044656 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-011fac75-2076-4507-9d8a-9831662df8dc tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:23.045191 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-011fac75-2076-4507-9d8a-9831662df8dc tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:23.048978 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-011fac75-2076-4507-9d8a-9831662df8dc tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/bf6294a7-4503-48e7-9758-15d28122dea9 HTTP/1.1" status: 404 len: 339 time: 0.0263181 Dec 10 14:29:23.059771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57624) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:23.077455 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] Deleting port 3790b372-089f-4aaa-a0cd-caa0a4231384 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:23.077842 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.084489 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=bac35f63-cb95-4d03-a0bc-4595f7bec69c,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:23.092513 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-62e37dad-07b2-49bc-a892-df908e98651e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.158025 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62e37dad-07b2-49bc-a892-df908e98651e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=27c801e6-c2b3-4a50-844a-b4d8911c9a98,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:23.177165 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-62e37dad-07b2-49bc-a892-df908e98651e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.182693 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-62e37dad-07b2-49bc-a892-df908e98651e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/27c801e6-c2b3-4a50-844a-b4d8911c9a98 HTTP/1.1" status: 204 len: 168 time: 1.3045783 Dec 10 14:29:23.190486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b4ba316-5002-4ef0-b7be-00a3aa129287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:23.192080 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4b4ba316-5002-4ef0-b7be-00a3aa129287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports?fixed_ips=ip_address%3D2001%3Adb8%3A%3A16b HTTP/1.1" status: 200 len: 929 time: 0.1768186 Dec 10 14:29:23.194727 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57626) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:23.194860 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.195302 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57628) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:23.218940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b3edbc-f02c-459d-962d-159a73e882cf req-bf926089-e40d-4ce5-a80c-cdc2e00c659e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:23.223040 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f2b3edbc-f02c-459d-962d-159a73e882cf req-bf926089-e40d-4ce5-a80c-cdc2e00c659e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 946 time: 0.2239347 Dec 10 14:29:23.235621 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-5b32238e-4d16-48f5-8470-cba2367ee8ba tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting subnet 40c35da0-250b-4798-93cd-be113fc5d35a {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:23.238412 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8aaa25d7-cb7e-43cf-81e6-1a6ce09eff99 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:23.241726 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b32238e-4d16-48f5-8470-cba2367ee8ba tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.246581 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e900a180-cce3-4df7-9e0d-298a290873ba']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:23.265970 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 42f82a8e-32c9-468d-9dcd-2c3df4805875 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:23.266356 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.294628 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad50f72b-d22a-4d37-8ab8-298c0cc2f011 req-98014031-2a14-4530-826f-403ef2ad049f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:23.296663 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ad50f72b-d22a-4d37-8ab8-298c0cc2f011 req-98014031-2a14-4530-826f-403ef2ad049f service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 1099 time: 0.1484864 Dec 10 14:29:23.306107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:23.306107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f7aebcb9-f31a-4d04-b8ea-5d21fb7c984a') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:23.311802 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4658c330-2245-4ed3-89eb-a800052d7ae6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1152978 Dec 10 14:29:23.320507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57630) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:23.326588 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:23.353587 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.365377 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b32238e-4d16-48f5-8470-cba2367ee8ba tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.458999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] For port 3790b372-089f-4aaa-a0cd-caa0a4231384, host dv-neutron-821401-2-hyperv, got binding levels [] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:23.458999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.459236 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ac61c1f-e98e-4d04-8018-edb7c2758a7b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.459345 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ad50f72b-d22a-4d37-8ab8-298c0cc2f011 req-3f044e16-1249-46ef-8528-3e3332a249e8 service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1111102 Dec 10 14:29:23.459345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.459345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Releasing vlan 395 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:23.459345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.459731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] Calling delete_port for 3790b372-089f-4aaa-a0cd-caa0a4231384 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:23.459832 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:23.462506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.ipam_backend_mixin [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] Port 3790b372-089f-4aaa-a0cd-caa0a4231384 was not found and therefore no delete operation was performed {{(pid=103812) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 10 14:29:23.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f2b3edbc-f02c-459d-962d-159a73e882cf req-c4391704-e290-46ad-a53e-bcbfa650df67 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1760521 Dec 10 14:29:23.535567 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.535822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ac61c1f-e98e-4d04-8018-edb7c2758a7b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.546963 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a938d2-d8e5-424b-aeda-a7917721322a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:23.548545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f435d34b-7097-487e-b98a-f240099eaa91 None None] Provisioning complete for port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:23.548916 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f435d34b-7097-487e-b98a-f240099eaa91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.590702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b32238e-4d16-48f5-8470-cba2367ee8ba tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.603188 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-3bf7e10f-4eab-4ece-968c-755cb9b72ef1 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 9199c743-fd58-4b06-92a9-6a8b9e4409e1 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:23.603732 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bf7e10f-4eab-4ece-968c-755cb9b72ef1 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.642325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] Pushing event deleted for resources: {'Port': ['ID=3790b372-089f-4aaa-a0cd-caa0a4231384,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:23.662708 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f25359e5-a840-4b05-93b5-8edee2526f2c None None] No DVR routers for this DVR port 3790b372-089f-4aaa-a0cd-caa0a4231384 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:23.670635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.678892 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.686338 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/networks/e900a180-cce3-4df7-9e0d-298a290873ba HTTP/1.1" status: 204 len: 168 time: 2.0902770 Dec 10 14:29:23.687583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57632) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:23.699103 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:23.703600 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.711923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b407b44-4cd4-4f7a-b193-b230b513223c tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Network': ['ID=e900a180-cce3-4df7-9e0d-298a290873ba,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:23.719754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f435d34b-7097-487e-b98a-f240099eaa91 None None] Port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:23.730422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f435d34b-7097-487e-b98a-f240099eaa91 None None] Could not find standard attr ID for object a5ed60d6-f7ac-4680-87df-ba23c054c9fb. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:23.738535 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f435d34b-7097-487e-b98a-f240099eaa91 None None] Could not find standard attr ID for object c9a9d483-c13d-44fa-b912-76ed0d11521b. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:23.764552 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:23.764552 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.765027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ac61c1f-e98e-4d04-8018-edb7c2758a7b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.767625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5ac61c1f-e98e-4d04-8018-edb7c2758a7b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.769465 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5ac61c1f-e98e-4d04-8018-edb7c2758a7b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/security-groups/5b6bf120-dc0d-4f09-a3a1-c05aeb047e4b HTTP/1.1" status: 204 len: 168 time: 0.7903459 Dec 10 14:29:23.771306 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b32238e-4d16-48f5-8470-cba2367ee8ba tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.773660 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57634) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:23.826887 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5b32238e-4d16-48f5-8470-cba2367ee8ba tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.826887 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5b32238e-4d16-48f5-8470-cba2367ee8ba tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/40c35da0-250b-4798-93cd-be113fc5d35a HTTP/1.1" status: 204 len: 168 time: 0.7652540 Dec 10 14:29:23.829607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57636) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:23.838502 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b32238e-4d16-48f5-8470-cba2367ee8ba tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=40c35da0-250b-4798-93cd-be113fc5d35a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:23.922465 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-24d72579-5bd3-48a5-83fe-a4d10eee8c76 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.932971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-b0e157f5-ce60-44fb-9ae1-90df7f17cc2e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting subnet 2c8fca0e-c54d-4804-9947-80f97a9597e9 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:23.951444 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b0e157f5-ce60-44fb-9ae1-90df7f17cc2e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.989556 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-24d72579-5bd3-48a5-83fe-a4d10eee8c76 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:23.993662 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62322a06-1cc2-4a90-bf54-c6ca75367056 None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:23.996793 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd9ff2b3-bf01-40c9-bfc3-96ef8131ff68 None None] Network 522c6690-944f-4247-91b9-f2e1df1754f5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:24.005081 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80760647-f6a6-40a8-9220-5c6702886e37 None None] Network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:24.018862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b0e157f5-ce60-44fb-9ae1-90df7f17cc2e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.073641 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6d0e6d45-f417-48c9-b382-6412a109afb7 None None] Could not find standard attr ID for object a5ed60d6-f7ac-4680-87df-ba23c054c9fb. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:24.115370 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ac61c1f-e98e-4d04-8018-edb7c2758a7b tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b6bf120-dc0d-4f09-a3a1-c05aeb047e4b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:24.131345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b0e157f5-ce60-44fb-9ae1-90df7f17cc2e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.160323 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-24d72579-5bd3-48a5-83fe-a4d10eee8c76 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.163954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-24d72579-5bd3-48a5-83fe-a4d10eee8c76 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.165606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:19Z', 'revision_number': 8, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:24.166222 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-24d72579-5bd3-48a5-83fe-a4d10eee8c76 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/security-groups/4e095f0a-6836-42d1-b39c-9b050a8841b1 HTTP/1.1" status: 204 len: 168 time: 0.3862948 Dec 10 14:29:24.167241 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57638) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:24.173916 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bf7e10f-4eab-4ece-968c-755cb9b72ef1 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.193818 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-3bf7e10f-4eab-4ece-968c-755cb9b72ef1 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 9199c743-fd58-4b06-92a9-6a8b9e4409e1 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:24.200773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-872f1da6-cbe3-478a-9829-51998b31b88b None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:19Z', 'revision_number': 8, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'cbcc7a12-8783-47cd-9c2b-9efbf73dac97', 'name': '', 'network_id': '152411ab-4991-469e-bd27-c8d29a909a0f', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:4e:6a:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 964, 'fixed_ips': [{'subnet_id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:52Z', 'updated_at': '2021-12-10T14:29:07Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': '26e3d43e-96a1-4cc9-a6a1-d9e609028ad8', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:24.215006 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24d72579-5bd3-48a5-83fe-a4d10eee8c76 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e095f0a-6836-42d1-b39c-9b050a8841b1,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:24.242603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.272039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd7bafa0-6711-405e-8961-e49ceea86472 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.273691 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-98d71f45-fd2e-4491-8eee-bfccfff2c598 None None] Provisioning complete for port df586b0a-b4af-494c-a728-760f5cabfbf9 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:24.274181 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98d71f45-fd2e-4491-8eee-bfccfff2c598 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.303432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd7bafa0-6711-405e-8961-e49ceea86472 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.331824 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b0e157f5-ce60-44fb-9ae1-90df7f17cc2e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.348543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:24.352414 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b0e157f5-ce60-44fb-9ae1-90df7f17cc2e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.356076 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b0e157f5-ce60-44fb-9ae1-90df7f17cc2e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/2c8fca0e-c54d-4804-9947-80f97a9597e9 HTTP/1.1" status: 204 len: 168 time: 0.5248401 Dec 10 14:29:24.359530 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57640) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:24.366294 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:24.388273 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e157f5-ce60-44fb-9ae1-90df7f17cc2e tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=2c8fca0e-c54d-4804-9947-80f97a9597e9,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:24.389302 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:24.389941 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.395642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=51f47c75-1482-4e83-8bd1-7a21d5404caa,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:24.475981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd7bafa0-6711-405e-8961-e49ceea86472 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.479723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bd7bafa0-6711-405e-8961-e49ceea86472 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.483731 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bd7bafa0-6711-405e-8961-e49ceea86472 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/security-groups/095b410c-f731-4b01-a7cb-445a39e498ee HTTP/1.1" status: 204 len: 168 time: 0.2965713 Dec 10 14:29:24.484493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57642) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:24.494851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-62322a06-1cc2-4a90-bf54-c6ca75367056 None None] Deleting port 42f82a8e-32c9-468d-9dcd-2c3df4805875 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:24.495165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-62322a06-1cc2-4a90-bf54-c6ca75367056 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.516685 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f17b0dee-6719-4a28-ae26-1fc8f08319f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.1947846 Dec 10 14:29:24.523366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57646) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:24.530672 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': '51f47c75-1482-4e83-8bd1-7a21d5404caa', 'ip_address': '2001:db8::1e4e:d189:ecb1:12ad'}], 'name': 'tempest-NetworksTestDHCPv6-562356784'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:24.615988 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd7bafa0-6711-405e-8961-e49ceea86472 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=095b410c-f731-4b01-a7cb-445a39e498ee,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:24.627619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.688073 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-338cd912-6bb0-4153-9312-44f373da7b33 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet 934733e0-bec4-499f-b524-7ee1a80477d5 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:24.695864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3790b372-089f-4aaa-a0cd-caa0a4231384 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:24.696201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-338cd912-6bb0-4153-9312-44f373da7b33 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.724384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bf7e10f-4eab-4ece-968c-755cb9b72ef1 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.750897 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 3790b372-089f-4aaa-a0cd-caa0a4231384 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:24.751339 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 3790b372-089f-4aaa-a0cd-caa0a4231384 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:24.760039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98d71f45-fd2e-4491-8eee-bfccfff2c598 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.774090 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21e91e5c-4e4d-4f4f-a373-56638627103d None None] Update dhcp port {'port': {'network_id': '522c6690-944f-4247-91b9-f2e1df1754f5', 'fixed_ips': [{'subnet_id': '2c8fca0e-c54d-4804-9947-80f97a9597e9'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': '58db0125-8848-46c5-a0eb-a70079090a22'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:29:24.808963 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-338cd912-6bb0-4153-9312-44f373da7b33 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.829485 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf7e10f-4eab-4ece-968c-755cb9b72ef1 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=9199c743-fd58-4b06-92a9-6a8b9e4409e1,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:24.836515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-62322a06-1cc2-4a90-bf54-c6ca75367056 None None] For port 42f82a8e-32c9-468d-9dcd-2c3df4805875, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=42f82a8e-32c9-468d-9dcd-2c3df4805875,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:24.837153 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-62322a06-1cc2-4a90-bf54-c6ca75367056 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.886373 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-21e91e5c-4e4d-4f4f-a373-56638627103d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.889574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting port 58db0125-8848-46c5-a0eb-a70079090a22 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:24.889923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.891025 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-62322a06-1cc2-4a90-bf54-c6ca75367056 None None] Calling delete_port for 42f82a8e-32c9-468d-9dcd-2c3df4805875 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:24.894842 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-98d71f45-fd2e-4491-8eee-bfccfff2c598 None None] For port df586b0a-b4af-494c-a728-760f5cabfbf9, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=df586b0a-b4af-494c-a728-760f5cabfbf9,segment=NetworkSegment(6d3309d3-c08c-48d0-850c-624e72fc3bb5),segment_id=6d3309d3-c08c-48d0-850c-624e72fc3bb5)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:24.901989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bf7e10f-4eab-4ece-968c-755cb9b72ef1 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:24.908006 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3bf7e10f-4eab-4ece-968c-755cb9b72ef1 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/9199c743-fd58-4b06-92a9-6a8b9e4409e1 HTTP/1.1" status: 204 len: 168 time: 1.7078357 Dec 10 14:29:24.919978 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c909fd3-5153-45a8-98cb-6c2027a0f280 req-02a2d91f-9ffd-4346-9276-ee5694f946c4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:24.921604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57648) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:24.928183 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0c909fd3-5153-45a8-98cb-6c2027a0f280 req-02a2d91f-9ffd-4346-9276-ee5694f946c4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 946 time: 0.3462422 Dec 10 14:29:24.975667 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98d71f45-fd2e-4491-8eee-bfccfff2c598 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.013176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.032205 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-8686b972-6c4c-41d4-9b1b-8a763f78726f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:29:25.037762 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8686b972-6c4c-41d4-9b1b-8a763f78726f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/9199c743-fd58-4b06-92a9-6a8b9e4409e1 HTTP/1.1" status: 404 len: 333 time: 0.1006954 Dec 10 14:29:25.041288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57650) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:25.078379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device df586b0a-b4af-494c-a728-760f5cabfbf9 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:25.080810 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0c909fd3-5153-45a8-98cb-6c2027a0f280 req-1ebd17bd-2e7a-4188-8d19-1ffc02d9948a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1517286 Dec 10 14:29:25.137918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:25.189000 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] For port 58db0125-8848-46c5-a0eb-a70079090a22, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=58db0125-8848-46c5-a0eb-a70079090a22,segment=NetworkSegment(0195cb1d-3621-4f78-bead-37566cfcb3c0),segment_id=0195cb1d-3621-4f78-bead-37566cfcb3c0)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:25.189385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.215373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Calling delete_port for 58db0125-8848-46c5-a0eb-a70079090a22 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:25.225064 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-338cd912-6bb0-4153-9312-44f373da7b33 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.241000 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d71f45-fd2e-4491-8eee-bfccfff2c598 None None] Pushing event updated for resources: {'Port': ['ID=df586b0a-b4af-494c-a728-760f5cabfbf9,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:25.271939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-4c6f0e03-bbe2-4f35-a74b-057f1949dcb7 None None] Provisioning complete for port 344190df-560f-4063-8113-2044cb243d6e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:25.272583 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c6f0e03-bbe2-4f35-a74b-057f1949dcb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.315370 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-4c6f0e03-bbe2-4f35-a74b-057f1949dcb7 None None] Port 344190df-560f-4063-8113-2044cb243d6e cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:25.318796 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.323732 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port df586b0a-b4af-494c-a728-760f5cabfbf9 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:25.325282 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.330006 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f8dd07b-4d48-48f1-a42a-fd92c948de2f None None] Network 522c6690-944f-4247-91b9-f2e1df1754f5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:25.335786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-4c6f0e03-bbe2-4f35-a74b-057f1949dcb7 None None] Could not find standard attr ID for object 9199c743-fd58-4b06-92a9-6a8b9e4409e1. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:25.345782 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port 832a3614-528d-4d6b-a571-e3a9afaecf3d yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:25.433204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-f367a85c-6736-42eb-8544-c919240cc320 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 344190df-560f-4063-8113-2044cb243d6e {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:25.433792 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f367a85c-6736-42eb-8544-c919240cc320 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.440446 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-4c6f0e03-bbe2-4f35-a74b-057f1949dcb7 None None] Provisioning complete for port df586b0a-b4af-494c-a728-760f5cabfbf9 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:25.440820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c6f0e03-bbe2-4f35-a74b-057f1949dcb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.489823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-62322a06-1cc2-4a90-bf54-c6ca75367056 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.535437 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62322a06-1cc2-4a90-bf54-c6ca75367056 None None] Pushing event deleted for resources: {'Port': ['ID=42f82a8e-32c9-468d-9dcd-2c3df4805875,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:25.552864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62322a06-1cc2-4a90-bf54-c6ca75367056 None None] No DVR routers for this DVR port 42f82a8e-32c9-468d-9dcd-2c3df4805875 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:25.581497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-338cd912-6bb0-4153-9312-44f373da7b33 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.586876 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f367a85c-6736-42eb-8544-c919240cc320 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.588352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::1e4e:d189:ecb1:12ad (cdc891b5-3e75-4d62-a51b-0f84be9af82d/51f47c75-1482-4e83-8bd1-7a21d5404caa/832a3614-528d-4d6b-a571-e3a9afaecf3d) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:25.590749 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51c5626a-d9c3-4298-9299-7b4ee7a7648a None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:25.620354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port cbcc7a12-8783-47cd-9c2b-9efbf73dac97 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:25.620850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.625261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-338cd912-6bb0-4153-9312-44f373da7b33 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=934733e0-bec4-499f-b524-7ee1a80477d5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:25.639531 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-f367a85c-6736-42eb-8544-c919240cc320 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 344190df-560f-4063-8113-2044cb243d6e owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:25.680166 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-338cd912-6bb0-4153-9312-44f373da7b33 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.682613 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-338cd912-6bb0-4153-9312-44f373da7b33 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/934733e0-bec4-499f-b524-7ee1a80477d5 HTTP/1.1" status: 204 len: 168 time: 1.1732512 Dec 10 14:29:25.690246 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57652) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:25.729014 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b18cfa86-6be3-4b7f-a38c-b4951f8dafb8 None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:25.731029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-506231f9-bbb1-40bc-87b6-36eed0ff5283 None None] DHCP port deletion for 522c6690-944f-4247-91b9-f2e1df1754f5 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:25.758605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.779514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-fceec1fb-da9d-4130-a7b0-17a01ae33af8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet 90e402f7-1e02-4221-bd7e-fa30480a5069 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:25.783460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fceec1fb-da9d-4130-a7b0-17a01ae33af8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.810225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 42f82a8e-32c9-468d-9dcd-2c3df4805875 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:25.820246 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Port': ['ID=58db0125-8848-46c5-a0eb-a70079090a22,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:25.827350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No DVR routers for this DVR port 58db0125-8848-46c5-a0eb-a70079090a22 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:25.833775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fceec1fb-da9d-4130-a7b0-17a01ae33af8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.843616 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 42f82a8e-32c9-468d-9dcd-2c3df4805875 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:25.843962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 42f82a8e-32c9-468d-9dcd-2c3df4805875 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:25.844387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b5844df0-aec5-4f9c-8ec0-ca35f45bb879 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:25.892148 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: b5844df0-aec5-4f9c-8ec0-ca35f45bb879 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:25.893320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b5844df0-aec5-4f9c-8ec0-ca35f45bb879 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:25.928970 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '51f47c75-1482-4e83-8bd1-7a21d5404caa'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:25.928970 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:25.994631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.024379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['522c6690-944f-4247-91b9-f2e1df1754f5']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:26.038337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0195cb1d-3621-4f78-bead-37566cfcb3c0') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:26.038718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0195cb1d-3621-4f78-bead-37566cfcb3c0') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:26.049016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port cbcc7a12-8783-47cd-9c2b-9efbf73dac97, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cbcc7a12-8783-47cd-9c2b-9efbf73dac97,segment=NetworkSegment(877fce5e-0213-4db9-862b-58436fd1cb89),segment_id=877fce5e-0213-4db9-862b-58436fd1cb89)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:26.049389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.053259 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.072718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.079541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f367a85c-6736-42eb-8544-c919240cc320 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.089052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 363 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:26.095396 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.095586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for cbcc7a12-8783-47cd-9c2b-9efbf73dac97 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:26.095714 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:26.107998 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fceec1fb-da9d-4130-a7b0-17a01ae33af8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.118154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.141538 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f367a85c-6736-42eb-8544-c919240cc320 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=344190df-560f-4063-8113-2044cb243d6e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:26.149845 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f5e35e0f-6451-446a-8838-efb039ee4ba4 None None] Could not find standard attr ID for object 344190df-560f-4063-8113-2044cb243d6e. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:26.216594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f5e35e0f-6451-446a-8838-efb039ee4ba4 None None] Could not find standard attr ID for object 9199c743-fd58-4b06-92a9-6a8b9e4409e1. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:26.231053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f5e35e0f-6451-446a-8838-efb039ee4ba4 None None] Could not find standard attr ID for object 58db0125-8848-46c5-a0eb-a70079090a22. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:26.231721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f367a85c-6736-42eb-8544-c919240cc320 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.238461 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f367a85c-6736-42eb-8544-c919240cc320 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/344190df-560f-4063-8113-2044cb243d6e HTTP/1.1" status: 204 len: 168 time: 1.1899400 Dec 10 14:29:26.242308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57656) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:26.276987 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-6145f803-862c-4e68-b60a-ee25799c1bc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:29:26.281923 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6145f803-862c-4e68-b60a-ee25799c1bc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/344190df-560f-4063-8113-2044cb243d6e HTTP/1.1" status: 404 len: 333 time: 0.0343201 Dec 10 14:29:26.282730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57658) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:26.359390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fceec1fb-da9d-4130-a7b0-17a01ae33af8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.373462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-f56cbf0b-dcde-4bca-a008-b47acf21b0c7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet 0c2f6b45-2d45-4c04-aa82-d2dd4a5553ac {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:26.377204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f56cbf0b-dcde-4bca-a008-b47acf21b0c7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.396050 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fceec1fb-da9d-4130-a7b0-17a01ae33af8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=90e402f7-1e02-4221-bd7e-fa30480a5069,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:26.403030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.411310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.428566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.431879 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/522c6690-944f-4247-91b9-f2e1df1754f5 HTTP/1.1" status: 204 len: 168 time: 2.0533457 Dec 10 14:29:26.436283 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57662) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:26.455204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c3112fb-b8ec-49c5-ab30-ed34dc8308ff tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=522c6690-944f-4247-91b9-f2e1df1754f5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:26.484418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f56cbf0b-dcde-4bca-a008-b47acf21b0c7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.501880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/51f47c75-1482-4e83-8bd1-7a21d5404caa/575803b5-a55e-4690-9e70-bdd10d4b4cc9) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:26.554705 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fceec1fb-da9d-4130-a7b0-17a01ae33af8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.564977 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fceec1fb-da9d-4130-a7b0-17a01ae33af8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/90e402f7-1e02-4221-bd7e-fa30480a5069 HTTP/1.1" status: 204 len: 168 time: 0.8673024 Dec 10 14:29:26.568543 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57664) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:26.624262 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-5765042e-41ac-46e1-9f8a-974c0c5a779a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:26.626549 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5765042e-41ac-46e1-9f8a-974c0c5a779a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:26.632234 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5765042e-41ac-46e1-9f8a-974c0c5a779a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/934733e0-bec4-499f-b524-7ee1a80477d5 HTTP/1.1" status: 404 len: 337 time: 0.0590382 Dec 10 14:29:26.641691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57666) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:26.734565 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.740846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f56cbf0b-dcde-4bca-a008-b47acf21b0c7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.769678 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-3f811727-30a3-437e-912f-1f7bc41825ce tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting subnet 0ae340f0-e5b5-4d36-a2da-9c7736d1150e {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:26.773360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3f811727-30a3-437e-912f-1f7bc41825ce tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.830239 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3f811727-30a3-437e-912f-1f7bc41825ce tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.857787 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:26.926877 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:26.930329 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:26.934260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:26.949451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Pushing event updated for resources: {'Port': ['ID=575803b5-a55e-4690-9e70-bdd10d4b4cc9,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:26.957644 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device df586b0a-b4af-494c-a728-760f5cabfbf9 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:26.973799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:26.979395 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3f811727-30a3-437e-912f-1f7bc41825ce tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.004681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f56cbf0b-dcde-4bca-a008-b47acf21b0c7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.011916 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-439e2b42-0896-4449-a81f-7de6d6f7f787 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:27.012605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-439e2b42-0896-4449-a81f-7de6d6f7f787 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:27.016244 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-439e2b42-0896-4449-a81f-7de6d6f7f787 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/0608725b-fb13-4634-b952-c24d9cd07a16 HTTP/1.1" status: 404 len: 337 time: 0.5375271 Dec 10 14:29:27.019589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:27.022175 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=832a3614-528d-4d6b-a571-e3a9afaecf3d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:27.028851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:27.029151 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57668) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.030325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:27.030977 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.043513 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bd7b64b-9fe8-413d-8a3b-2b0fd05fba90 None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:27.069925 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f56cbf0b-dcde-4bca-a008-b47acf21b0c7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=0c2f6b45-2d45-4c04-aa82-d2dd4a5553ac,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:27.084670 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-160469fe-aaa5-4e48-9bdd-cb39d41097a0 req-da8b1409-6423-4d93-96b4-11551cf1aff2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:27.092490 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-160469fe-aaa5-4e48-9bdd-cb39d41097a0 req-da8b1409-6423-4d93-96b4-11551cf1aff2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 946 time: 0.7737296 Dec 10 14:29:27.092948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f56cbf0b-dcde-4bca-a008-b47acf21b0c7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.099458 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f56cbf0b-dcde-4bca-a008-b47acf21b0c7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/0c2f6b45-2d45-4c04-aa82-d2dd4a5553ac HTTP/1.1" status: 204 len: 168 time: 0.8125861 Dec 10 14:29:27.099458 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-03b927f9-f8f9-4f38-84fe-b9b650c3954d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:27.099458 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-03b927f9-f8f9-4f38-84fe-b9b650c3954d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:27.100043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57670) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.102007 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-03b927f9-f8f9-4f38-84fe-b9b650c3954d tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/60caf174-b8c2-4cad-a2ec-484ecd98e9cd HTTP/1.1" status: 404 len: 339 time: 0.0463099 Dec 10 14:29:27.110478 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.111603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57672) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.114512 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f11cfbb1-29a2-4886-a632-0fb62d7398ba None None] Network b4f6bb8c-3923-4753-8423-c8d091bbbbe2 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:27.122121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Attempting to bind port 575803b5-a55e-4690-9e70-bdd10d4b4cc9 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:27.122121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Attempting to bind port 575803b5-a55e-4690-9e70-bdd10d4b4cc9 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:27.122454 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Attempting to bind port 575803b5-a55e-4690-9e70-bdd10d4b4cc9 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:27.142652 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-a5765c8a-20ef-450a-8a0f-ba301dfd3bc5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:27.143210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a5765c8a-20ef-450a-8a0f-ba301dfd3bc5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:27.150709 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a5765c8a-20ef-450a-8a0f-ba301dfd3bc5 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/435ba331-d384-442f-9256-56d56034dca6 HTTP/1.1" status: 404 len: 337 time: 0.0330369 Dec 10 14:29:27.150709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57674) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.157650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=cbcc7a12-8783-47cd-9c2b-9efbf73dac97,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:27.163038 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-547adf31-0443-4f19-b478-eeecb9c4341a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.6366980 Dec 10 14:29:27.168773 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-34981f67-7b3d-4944-83ae-ab89b7182980 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:27.168940 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-34981f67-7b3d-4944-83ae-ab89b7182980 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:27.174237 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-34981f67-7b3d-4944-83ae-ab89b7182980 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/1addbd2f-5af1-4bfe-9ba3-dfcfc547a55e HTTP/1.1" status: 404 len: 339 time: 0.0215297 Dec 10 14:29:27.174237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57676) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.181097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57678) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.186012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:27.186393 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:27.186797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.187190 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:27.187676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Bound port: 575803b5-a55e-4690-9e70-bdd10d4b4cc9, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:27.188055 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.223614 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-911ff284-0a0c-4f26-bde8-9a2105dcff12 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:27.225287 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-911ff284-0a0c-4f26-bde8-9a2105dcff12 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:27.229862 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-911ff284-0a0c-4f26-bde8-9a2105dcff12 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/cfbe956c-e8d1-443d-ac97-bc40998a8257 HTTP/1.1" status: 404 len: 337 time: 0.0453320 Dec 10 14:29:27.229862 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3f811727-30a3-437e-912f-1f7bc41825ce tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.230636 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-4894e0d2-abc7-4ebb-8006-9ef7360e4242 None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:27.231192 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4894e0d2-abc7-4ebb-8006-9ef7360e4242 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.232080 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57680) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.255014 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port df586b0a-b4af-494c-a728-760f5cabfbf9 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:27.255610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.284853 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-c5c979d8-2de4-43db-a9b1-e8f649c09683 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:27.285493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c5c979d8-2de4-43db-a9b1-e8f649c09683 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:27.288676 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c5c979d8-2de4-43db-a9b1-e8f649c09683 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/1a0038ac-c697-478a-80dd-ac7bd00c9bc7 HTTP/1.1" status: 404 len: 339 time: 0.0531824 Dec 10 14:29:27.297007 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f811727-30a3-437e-912f-1f7bc41825ce tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Subnet': ['ID=0ae340f0-e5b5-4d36-a2da-9c7736d1150e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:27.298892 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57682) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.340479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3f811727-30a3-437e-912f-1f7bc41825ce tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.352147 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3f811727-30a3-437e-912f-1f7bc41825ce tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/0ae340f0-e5b5-4d36-a2da-9c7736d1150e HTTP/1.1" status: 204 len: 168 time: 0.7090960 Dec 10 14:29:27.353439 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-160469fe-aaa5-4e48-9bdd-cb39d41097a0 req-13907fda-f109-479a-a139-6567ebabe523 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2577922 Dec 10 14:29:27.356770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57684) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.398934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.432403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd00cbec-6e7d-4da5-9673-ca78743f7b48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:27.440268 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd00cbec-6e7d-4da5-9673-ca78743f7b48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:27.445102 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dd00cbec-6e7d-4da5-9673-ca78743f7b48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.2691860 Dec 10 14:29:27.452516 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-b7ab5535-81f1-473a-9821-0acca8f9b268 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:27.452516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b7ab5535-81f1-473a-9821-0acca8f9b268 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:27.452855 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b7ab5535-81f1-473a-9821-0acca8f9b268 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/9af374b7-feb5-4523-a05d-c9651ea05ab3 HTTP/1.1" status: 404 len: 337 time: 0.0949872 Dec 10 14:29:27.453464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57688) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.457946 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57690) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.483403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] For port 575803b5-a55e-4690-9e70-bdd10d4b4cc9, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:27.489078 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] For port 575803b5-a55e-4690-9e70-bdd10d4b4cc9, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=575803b5-a55e-4690-9e70-bdd10d4b4cc9,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:27.510261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.566914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-f3df5a2a-a9b8-4873-9f7e-783831f53b59 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting subnet 64ef917a-0482-4ee3-81df-b5cfdd339e0a {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:27.576241 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d4625fc1-041c-4a1c-936c-f1bc8846e02a tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "GET /v2.0/ports?device_id=d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1 HTTP/1.1" status: 200 len: 205 time: 0.1142550 Dec 10 14:29:27.578457 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f3df5a2a-a9b8-4873-9f7e-783831f53b59 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.578942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57692) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.593646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.611617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08740f5b-9e74-4979-af8c-ef43effa65c9 None None] DHCP port deletion for b4f6bb8c-3923-4753-8423-c8d091bbbbe2 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:27.633951 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f3df5a2a-a9b8-4873-9f7e-783831f53b59 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.696840 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-68df86ae-4f78-4770-a752-fdc830be7ecf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] delete failed (client error): The resource could not be found. Dec 10 14:29:27.697247 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-808b464a-f9bb-4412-90de-e63614b658b2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 832a3614-528d-4d6b-a571-e3a9afaecf3d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:27.697631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-808b464a-f9bb-4412-90de-e63614b658b2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.698829 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-68df86ae-4f78-4770-a752-fdc830be7ecf tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/routers/d71c0e7b-ecb7-4d18-a5e2-7c8c7ff0d6a1 HTTP/1.1" status: 404 len: 336 time: 0.1099086 Dec 10 14:29:27.704109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57694) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.704315 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef81396e-fddd-4f18-aea4-a27c091a7331 None None] Update dhcp port {'port': {'network_id': 'e9b085a0-e0b5-4630-9607-8d0706a5122c', 'fixed_ips': [{'subnet_id': '0ae340f0-e5b5-4d36-a2da-9c7736d1150e'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'c5a938d2-d8e5-424b-aeda-a7917721322a'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:29:27.733432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-4894e0d2-abc7-4ebb-8006-9ef7360e4242 None None] Provisioning complete for port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:27.733836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4894e0d2-abc7-4ebb-8006-9ef7360e4242 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.747118 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 58db0125-8848-46c5-a0eb-a70079090a22 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:27.760962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1fde96-987f-4083-9085-224696e1d6b6 req-fcb9d50f-7d68-4768-afa9-36a3709b39dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:27.762716 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ff1fde96-987f-4083-9085-224696e1d6b6 req-fcb9d50f-7d68-4768-afa9-36a3709b39dc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 946 time: 0.3240397 Dec 10 14:29:27.795000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port df586b0a-b4af-494c-a728-760f5cabfbf9 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:27.795679 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.809345 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-8995dbf7-d674-42dc-a5a1-7c6ac904495c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:27.809886 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8995dbf7-d674-42dc-a5a1-7c6ac904495c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:27.810886 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a14bd2b-337e-40e1-92ef-803947b56bac None None] Pushing event updated for resources: {'Port': ['ID=575803b5-a55e-4690-9e70-bdd10d4b4cc9,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:27.815538 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8995dbf7-d674-42dc-a5a1-7c6ac904495c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/7e848c66-8659-43af-bdae-aaac760b6048 HTTP/1.1" status: 404 len: 337 time: 0.1081367 Dec 10 14:29:27.815715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 58db0125-8848-46c5-a0eb-a70079090a22 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:27.815715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 58db0125-8848-46c5-a0eb-a70079090a22 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:27.816225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57698) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:27.821554 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ef81396e-fddd-4f18-aea4-a27c091a7331 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.841776 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-4894e0d2-abc7-4ebb-8006-9ef7360e4242 None None] Port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:27.913510 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f3df5a2a-a9b8-4873-9f7e-783831f53b59 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.942006 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-808b464a-f9bb-4412-90de-e63614b658b2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.953027 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-08740f5b-9e74-4979-af8c-ef43effa65c9 None None] Deleting port df586b0a-b4af-494c-a728-760f5cabfbf9 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:27.953027 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-08740f5b-9e74-4979-af8c-ef43effa65c9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:27.967168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-808b464a-f9bb-4412-90de-e63614b658b2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 832a3614-528d-4d6b-a571-e3a9afaecf3d owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:28.012274 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-38d73410-253e-4232-81de-eeca2a0a4910 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:28.014550 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-38d73410-253e-4232-81de-eeca2a0a4910 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:28.019577 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-38d73410-253e-4232-81de-eeca2a0a4910 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/df894c5e-6d1a-4ba8-97d1-6b1e1b299d43 HTTP/1.1" status: 404 len: 337 time: 0.1534231 Dec 10 14:29:28.024671 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57700) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.068957 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] For port df586b0a-b4af-494c-a728-760f5cabfbf9, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=df586b0a-b4af-494c-a728-760f5cabfbf9,segment=NetworkSegment(6d3309d3-c08c-48d0-850c-624e72fc3bb5),segment_id=6d3309d3-c08c-48d0-850c-624e72fc3bb5)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:28.069193 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-08740f5b-9e74-4979-af8c-ef43effa65c9 None None] For port df586b0a-b4af-494c-a728-760f5cabfbf9, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=df586b0a-b4af-494c-a728-760f5cabfbf9,segment=NetworkSegment(6d3309d3-c08c-48d0-850c-624e72fc3bb5),segment_id=6d3309d3-c08c-48d0-850c-624e72fc3bb5)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:28.069336 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.069458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-08740f5b-9e74-4979-af8c-ef43effa65c9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.073967 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-f15594c6-fa1e-4cec-a164-cc46f2ba41ae tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:28.074426 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f15594c6-fa1e-4cec-a164-cc46f2ba41ae tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:28.079993 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f15594c6-fa1e-4cec-a164-cc46f2ba41ae tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/53b74490-ce32-4c9b-aad3-0d2d044229bc HTTP/1.1" status: 404 len: 337 time: 0.0459368 Dec 10 14:29:28.083144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57702) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.085134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-08740f5b-9e74-4979-af8c-ef43effa65c9 None None] Calling delete_port for df586b0a-b4af-494c-a728-760f5cabfbf9 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:28.133550 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for df586b0a-b4af-494c-a728-760f5cabfbf9 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:28.140149 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-336b8c13-7b48-4667-b004-5cc80e6a85e5 None None] Network e9b085a0-e0b5-4630-9607-8d0706a5122c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:28.142357 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-c9c263fe-d3cb-470c-a4e3-95fe197ae345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:28.142956 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c9c263fe-d3cb-470c-a4e3-95fe197ae345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:28.146076 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c9c263fe-d3cb-470c-a4e3-95fe197ae345 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/93a5fd60-e98c-445d-8f5c-78cbde7497fc HTTP/1.1" status: 404 len: 333 time: 0.0538819 Dec 10 14:29:28.154586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:28.154732 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57704) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.173206 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ff1fde96-987f-4083-9085-224696e1d6b6 req-830768ab-4db0-4bf0-a1a1-6161f144384f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3935344 Dec 10 14:29:28.194248 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-7ac2595b-98b3-459e-b3f5-de0e2a33ca15 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:28.195015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7ac2595b-98b3-459e-b3f5-de0e2a33ca15 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:28.198404 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7ac2595b-98b3-459e-b3f5-de0e2a33ca15 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/c128e8d3-22fe-4f9d-8194-b65cbe4354ba HTTP/1.1" status: 404 len: 337 time: 0.0437505 Dec 10 14:29:28.200919 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57706) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.239074 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-a3755684-6268-488e-b6ba-5aecb0770130 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:28.239727 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a3755684-6268-488e-b6ba-5aecb0770130 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:28.246017 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a3755684-6268-488e-b6ba-5aecb0770130 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/dbf56665-f742-4f90-84a3-d3b89d971e5b HTTP/1.1" status: 404 len: 337 time: 0.0437615 Dec 10 14:29:28.247468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f3df5a2a-a9b8-4873-9f7e-783831f53b59 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.258541 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-46faa8f8-97a1-451f-973b-79acf044a392 None None] Provisioning complete for port c5a938d2-d8e5-424b-aeda-a7917721322a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:28.259631 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-46faa8f8-97a1-451f-973b-79acf044a392 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.263281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57710) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.268913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f3df5a2a-a9b8-4873-9f7e-783831f53b59 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.273172 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f3df5a2a-a9b8-4873-9f7e-783831f53b59 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/64ef917a-0482-4ee3-81df-b5cfdd339e0a HTTP/1.1" status: 204 len: 168 time: 0.9708605 Dec 10 14:29:28.282983 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dfbf5fb-230d-4ddd-a4cb-df88a64a0135 None None] Network f0a1d371-2ebf-4348-8c07-25cc745f67e4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:28.284501 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57712) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.353055 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:28.353465 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-2d07f82e-9fd1-4dd3-a8b0-8d06a327f52d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:28.354544 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2d07f82e-9fd1-4dd3-a8b0-8d06a327f52d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:28.363166 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4bfee061-d7a5-40a7-9801-df39c6533ea2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6744628 Dec 10 14:29:28.365451 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57714) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.365987 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:28.367855 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2d07f82e-9fd1-4dd3-a8b0-8d06a327f52d tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/a87cf8bf-0a0b-4eb3-8ddb-6b64adb6678a HTTP/1.1" status: 404 len: 333 time: 0.0921700 Dec 10 14:29:28.375060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57718) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.382125 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:28.383647 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:28.416751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3df5a2a-a9b8-4873-9f7e-783831f53b59 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=64ef917a-0482-4ee3-81df-b5cfdd339e0a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:28.437822 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-354674ec-d79f-4b45-b326-c68e001998f8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:28.440334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-354674ec-d79f-4b45-b326-c68e001998f8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:28.447454 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-354674ec-d79f-4b45-b326-c68e001998f8 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/8d603f1a-7d82-439b-a752-66f440a6f7ba HTTP/1.1" status: 404 len: 337 time: 0.0696795 Dec 10 14:29:28.453791 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f141ff1-b5b9-4350-a439-9c8adf88ca99 None None] DHCP port deletion for e9b085a0-e0b5-4630-9607-8d0706a5122c request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:28.454765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57720) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.503888 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.520480 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-98e8c3e3-de3e-4b83-8b2c-e35c6c00936c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:28.521273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-98e8c3e3-de3e-4b83-8b2c-e35c6c00936c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:28.525047 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-98e8c3e3-de3e-4b83-8b2c-e35c6c00936c tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/subnets/53baf5e5-852f-4a8b-af1e-806390cac297 HTTP/1.1" status: 404 len: 337 time: 0.0691578 Dec 10 14:29:28.529174 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57722) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:28.533562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.558442 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:28.567702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting port 2fc19a6e-6795-4b40-8d94-f7339f60807f {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:28.568043 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.599313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-b279d7a9-4cd7-4a43-913b-da2ea6f5edb4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting subnet 26e3d43e-96a1-4cc9-a6a1-d9e609028ad8 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:28.611563 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b279d7a9-4cd7-4a43-913b-da2ea6f5edb4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.612583 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-808b464a-f9bb-4412-90de-e63614b658b2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.615070 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=df586b0a-b4af-494c-a728-760f5cabfbf9,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:28.642596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No DVR routers for this DVR port df586b0a-b4af-494c-a728-760f5cabfbf9 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:28.660854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-808b464a-f9bb-4412-90de-e63614b658b2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=832a3614-528d-4d6b-a571-e3a9afaecf3d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:28.723705 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-08740f5b-9e74-4979-af8c-ef43effa65c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.761356 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08740f5b-9e74-4979-af8c-ef43effa65c9 None None] Pushing event deleted for resources: {'Port': ['ID=df586b0a-b4af-494c-a728-760f5cabfbf9,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:28.767878 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08740f5b-9e74-4979-af8c-ef43effa65c9 None None] No DVR routers for this DVR port df586b0a-b4af-494c-a728-760f5cabfbf9 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:28.789390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-46faa8f8-97a1-451f-973b-79acf044a392 None None] Provisioning complete for port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:28.789796 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-46faa8f8-97a1-451f-973b-79acf044a392 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.839636 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8f141ff1-b5b9-4350-a439-9c8adf88ca99 None None] Deleting port c5a938d2-d8e5-424b-aeda-a7917721322a {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:28.843253 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8f141ff1-b5b9-4350-a439-9c8adf88ca99 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.851552 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dec5276-ba14-4193-857c-7ef8895ffa2a None None] DHCP port deletion for f0a1d371-2ebf-4348-8c07-25cc745f67e4 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:28.868175 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b279d7a9-4cd7-4a43-913b-da2ea6f5edb4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:28.938867 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-46faa8f8-97a1-451f-973b-79acf044a392 None None] Port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:28.970028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.039022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b4f6bb8c-3923-4753-8423-c8d091bbbbe2']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:29.072672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8f141ff1-b5b9-4350-a439-9c8adf88ca99 None None] For port c5a938d2-d8e5-424b-aeda-a7917721322a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c5a938d2-d8e5-424b-aeda-a7917721322a,segment=NetworkSegment(8884a3d8-3d3b-4c8a-a374-8f994bb64e01),segment_id=8884a3d8-3d3b-4c8a-a374-8f994bb64e01)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:29.073433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8f141ff1-b5b9-4350-a439-9c8adf88ca99 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.083772 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6d3309d3-c08c-48d0-850c-624e72fc3bb5') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:29.084075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6d3309d3-c08c-48d0-850c-624e72fc3bb5') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:29.096332 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-40ffb238-7a3d-48a4-b8cb-7ff64c1585dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Deleting port d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:29.096712 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40ffb238-7a3d-48a4-b8cb-7ff64c1585dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.105028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.122239 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8f141ff1-b5b9-4350-a439-9c8adf88ca99 None None] Calling delete_port for c5a938d2-d8e5-424b-aeda-a7917721322a owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:29.137205 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:26Z', 'revision_number': 9, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:29.180293 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b279d7a9-4cd7-4a43-913b-da2ea6f5edb4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.198935 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:29.209302 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:29.209964 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:29.219904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-808b464a-f9bb-4412-90de-e63614b658b2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.227199 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-808b464a-f9bb-4412-90de-e63614b658b2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/832a3614-528d-4d6b-a571-e3a9afaecf3d HTTP/1.1" status: 204 len: 168 time: 1.7660577 Dec 10 14:29:29.234072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57724) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:29.250015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] For port 2fc19a6e-6795-4b40-8d94-f7339f60807f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=2fc19a6e-6795-4b40-8d94-f7339f60807f,segment=NetworkSegment(7e00621e-01fd-46ee-be25-5e6d777b3791),segment_id=7e00621e-01fd-46ee-be25-5e6d777b3791)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:29.251109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.255558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 575803b5-a55e-4690-9e70-bdd10d4b4cc9 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:29.273576 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Calling delete_port for 2fc19a6e-6795-4b40-8d94-f7339f60807f owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:29.293818 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.304865 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f976779-2c29-49f0-943d-408d9be4f4e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:29.306871 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f976779-2c29-49f0-943d-408d9be4f4e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:29.312096 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6f976779-2c29-49f0-943d-408d9be4f4e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0746667 Dec 10 14:29:29.322145 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57726) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:29.337566 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:29.337988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8dec5276-ba14-4193-857c-7ef8895ffa2a None None] Deleting port 2fc19a6e-6795-4b40-8d94-f7339f60807f {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:29.338672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dec5276-ba14-4193-857c-7ef8895ffa2a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.402167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40ffb238-7a3d-48a4-b8cb-7ff64c1585dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.404828 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 575803b5-a55e-4690-9e70-bdd10d4b4cc9 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:29.404982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Releasing vlan 399 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:29.405266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.406452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.421140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-b506884d-3984-4c2b-9c5a-63ab478ad7f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 51f47c75-1482-4e83-8bd1-7a21d5404caa {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:29.421290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8f141ff1-b5b9-4350-a439-9c8adf88ca99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:29.421393 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:29.442040 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b506884d-3984-4c2b-9c5a-63ab478ad7f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.477020 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-40ffb238-7a3d-48a4-b8cb-7ff64c1585dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Calling delete_port for d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:29.485055 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.519007 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f141ff1-b5b9-4350-a439-9c8adf88ca99 None None] Pushing event deleted for resources: {'Port': ['ID=c5a938d2-d8e5-424b-aeda-a7917721322a,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:29.532424 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f141ff1-b5b9-4350-a439-9c8adf88ca99 None None] No DVR routers for this DVR port c5a938d2-d8e5-424b-aeda-a7917721322a on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:29.539616 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8dec5276-ba14-4193-857c-7ef8895ffa2a None None] For port 2fc19a6e-6795-4b40-8d94-f7339f60807f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=2fc19a6e-6795-4b40-8d94-f7339f60807f,segment=NetworkSegment(7e00621e-01fd-46ee-be25-5e6d777b3791),segment_id=7e00621e-01fd-46ee-be25-5e6d777b3791)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:29.540031 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dec5276-ba14-4193-857c-7ef8895ffa2a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.545286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-36c4c476-8148-4c00-bae2-03bbb73138f5 None None] Provisioning complete for port 575803b5-a55e-4690-9e70-bdd10d4b4cc9 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:29.545774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Port': ['ID=2fc19a6e-6795-4b40-8d94-f7339f60807f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:29.545910 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-36c4c476-8148-4c00-bae2-03bbb73138f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.561920 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No DVR routers for this DVR port 2fc19a6e-6795-4b40-8d94-f7339f60807f on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:29.587866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b506884d-3984-4c2b-9c5a-63ab478ad7f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.598019 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8dec5276-ba14-4193-857c-7ef8895ffa2a None None] Calling delete_port for 2fc19a6e-6795-4b40-8d94-f7339f60807f owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:29.626895 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.678656 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:26Z', 'revision_number': 9, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:29.708956 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.716462 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/networks/b4f6bb8c-3923-4753-8423-c8d091bbbbe2 HTTP/1.1" status: 204 len: 168 time: 2.6099832 Dec 10 14:29:29.716613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.716730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57728) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:29.721189 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5877f635-2e25-4c9a-905b-4f75481582e1 None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:26Z', 'revision_number': 9, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '968ad944-9269-4599-a638-73d9c25aedbf', 'name': '', 'network_id': 'c23cb4a7-305b-44c0-859c-d250baf023e6', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:b0:54:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 933, 'fixed_ips': [{'subnet_id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:44Z', 'updated_at': '2021-12-10T14:28:50Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'd0bc12cf-44cd-4620-98df-8ce2c544d13c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:29.724060 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1361738078'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:29.745733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57730) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:29.753352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b279d7a9-4cd7-4a43-913b-da2ea6f5edb4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.759181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.794435 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f7ddc5-0e81-414a-b33e-dcc64aa8e262 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Network': ['ID=b4f6bb8c-3923-4753-8423-c8d091bbbbe2,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:29.830130 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40ffb238-7a3d-48a4-b8cb-7ff64c1585dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.833919 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f0a1d371-2ebf-4348-8c07-25cc745f67e4']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:29.841057 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-36c4c476-8148-4c00-bae2-03bbb73138f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.848547 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 575803b5-a55e-4690-9e70-bdd10d4b4cc9, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=575803b5-a55e-4690-9e70-bdd10d4b4cc9,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:29.849902 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b279d7a9-4cd7-4a43-913b-da2ea6f5edb4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Subnet': ['ID=26e3d43e-96a1-4cc9-a6a1-d9e609028ad8,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:29.852346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7e00621e-01fd-46ee-be25-5e6d777b3791') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:29.852774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7e00621e-01fd-46ee-be25-5e6d777b3791') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:29.856103 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b279d7a9-4cd7-4a43-913b-da2ea6f5edb4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.866085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57732) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:29.866346 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b279d7a9-4cd7-4a43-913b-da2ea6f5edb4 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/26e3d43e-96a1-4cc9-a6a1-d9e609028ad8 HTTP/1.1" status: 204 len: 168 time: 1.4980958 Dec 10 14:29:29.868820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c65d8892-5f10-4853-95ab-cfe4a3653651 None None] Network 152411ab-4991-469e-bd27-c8d29a909a0f requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:29.876828 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.893778 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dec5276-ba14-4193-857c-7ef8895ffa2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.901150 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40ffb238-7a3d-48a4-b8cb-7ff64c1585dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.907383 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-40ffb238-7a3d-48a4-b8cb-7ff64c1585dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/ports/d8a9f1e1-4205-4e96-9e7f-f18cabac63f6 HTTP/1.1" status: 204 len: 168 time: 1.3749406 Dec 10 14:29:29.908170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57734) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:29.909274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ffb238-7a3d-48a4-b8cb-7ff64c1585dd tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Port': ['ID=d8a9f1e1-4205-4e96-9e7f-f18cabac63f6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:29.943492 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dec5276-ba14-4193-857c-7ef8895ffa2a None None] No DVR routers for this DVR port 2fc19a6e-6795-4b40-8d94-f7339f60807f on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:29.970948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:29.971175 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.974942 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.977591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.977906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b506884d-3984-4c2b-9c5a-63ab478ad7f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:29.985974 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dec5276-ba14-4193-857c-7ef8895ffa2a None None] Pushing event deleted for resources: {'Port': ['ID=2fc19a6e-6795-4b40-8d94-f7339f60807f,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:30.009143 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 380 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:30.009748 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:30.012998 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:30.074750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.102519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=575803b5-a55e-4690-9e70-bdd10d4b4cc9,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:30.111987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.143105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] vlan segment allocate from pool success with {'vlan_id': 379, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:29:30.144025 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a938d2-d8e5-424b-aeda-a7917721322a no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:30.185033 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: c5a938d2-d8e5-424b-aeda-a7917721322a {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:30.185397 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c5a938d2-d8e5-424b-aeda-a7917721322a not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:30.185872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device df586b0a-b4af-494c-a728-760f5cabfbf9 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:30.210714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: df586b0a-b4af-494c-a728-760f5cabfbf9 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:30.211120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device df586b0a-b4af-494c-a728-760f5cabfbf9 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:30.211471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 2fc19a6e-6795-4b40-8d94-f7339f60807f no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:30.235920 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbf8144b-3f93-4c2a-8615-4dc2963f51d2 None None] DHCP port deletion for 152411ab-4991-469e-bd27-c8d29a909a0f request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:30.240068 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 2fc19a6e-6795-4b40-8d94-f7339f60807f {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:30.240447 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 2fc19a6e-6795-4b40-8d94-f7339f60807f not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:30.264942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.272223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b506884d-3984-4c2b-9c5a-63ab478ad7f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.310104 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.312447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.313010 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Added segment 11eecb57-fb6d-4bc2-b732-a14c8518fce6 of type vlan for network 3d97021c-8887-4ba8-9c45-2423b0852bc5 Dec 10 14:29:30.318437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b506884d-3984-4c2b-9c5a-63ab478ad7f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=51f47c75-1482-4e83-8bd1-7a21d5404caa,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:30.325058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e9b085a0-e0b5-4630-9607-8d0706a5122c']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:30.348485 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b506884d-3984-4c2b-9c5a-63ab478ad7f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.360246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1229c93-bee3-4cb5-9891-9a120d3a6a37 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:30.362544 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b506884d-3984-4c2b-9c5a-63ab478ad7f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/51f47c75-1482-4e83-8bd1-7a21d5404caa HTTP/1.1" status: 204 len: 168 time: 1.0379877 Dec 10 14:29:30.371751 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57738) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:30.382681 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-36c4c476-8148-4c00-bae2-03bbb73138f5 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:29:30.383143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-36c4c476-8148-4c00-bae2-03bbb73138f5 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:29:30.434108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.439724 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-bbf8144b-3f93-4c2a-8615-4dc2963f51d2 None None] Deleting port 0ab23af3-1805-4c63-a15b-b032f649ca20 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:30.439724 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bbf8144b-3f93-4c2a-8615-4dc2963f51d2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.441866 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/f0a1d371-2ebf-4348-8c07-25cc745f67e4 HTTP/1.1" status: 204 len: 168 time: 2.1539185 Dec 10 14:29:30.443278 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e37d69-e5c8-4670-9eb6-4c14121b9de0 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=f0a1d371-2ebf-4348-8c07-25cc745f67e4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:30.445705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57740) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:30.449396 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8884a3d8-3d3b-4c8a-a374-8f994bb64e01') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:30.453998 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8884a3d8-3d3b-4c8a-a374-8f994bb64e01') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:30.477044 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f696cfde-3faa-45cd-8576-cefad56e4ce2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0982702 Dec 10 14:29:30.478449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57742) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:30.486134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:30.506139 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.511845 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-bbf8144b-3f93-4c2a-8615-4dc2963f51d2 None None] For port 0ab23af3-1805-4c63-a15b-b032f649ca20, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0ab23af3-1805-4c63-a15b-b032f649ca20,segment=NetworkSegment(877fce5e-0213-4db9-862b-58436fd1cb89),segment_id=877fce5e-0213-4db9-862b-58436fd1cb89)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:30.512370 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bbf8144b-3f93-4c2a-8615-4dc2963f51d2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.526320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-bbf8144b-3f93-4c2a-8615-4dc2963f51d2 None None] Calling delete_port for 0ab23af3-1805-4c63-a15b-b032f649ca20 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:30.545517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.548833 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-8d35bcb8-96ff-42d1-8b00-905a578853db tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:30.549297 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8d35bcb8-96ff-42d1-8b00-905a578853db tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:30.554721 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8d35bcb8-96ff-42d1-8b00-905a578853db tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/e592802c-738d-442f-af41-1c40305185cd HTTP/1.1" status: 404 len: 337 time: 0.0999055 Dec 10 14:29:30.557388 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57746) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:30.565897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.573852 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 0ab23af3-1805-4c63-a15b-b032f649ca20 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:30.574192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.589117 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Releasing vlan 393 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:30.591534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:30.592632 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:30.598945 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-a6c8e7b8-8d73-484a-9332-4c361842d502 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:30.599352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a6c8e7b8-8d73-484a-9332-4c361842d502 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:30.604713 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a6c8e7b8-8d73-484a-9332-4c361842d502 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/57850d2b-b9dc-4c49-8eb5-09a692a7a89c HTTP/1.1" status: 404 len: 339 time: 0.0434964 Dec 10 14:29:30.615089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57748) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:30.686479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port 0ab23af3-1805-4c63-a15b-b032f649ca20, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0ab23af3-1805-4c63-a15b-b032f649ca20,segment=NetworkSegment(877fce5e-0213-4db9-862b-58436fd1cb89),segment_id=877fce5e-0213-4db9-862b-58436fd1cb89)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:30.686766 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.694134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bbf8144b-3f93-4c2a-8615-4dc2963f51d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.705584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 0ab23af3-1805-4c63-a15b-b032f649ca20 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:30.733565 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6753edd-02d8-4369-baed-22d1108a77be None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:30.735906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-40f7f735-1a46-4a7f-943d-514b528bb5b6 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting subnet 87d059f9-1c74-4752-a500-2102db4239b7 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:30.737673 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbf8144b-3f93-4c2a-8615-4dc2963f51d2 None None] Pushing event deleted for resources: {'Port': ['ID=0ab23af3-1805-4c63-a15b-b032f649ca20,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:30.739969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40f7f735-1a46-4a7f-943d-514b528bb5b6 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.743235 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbf8144b-3f93-4c2a-8615-4dc2963f51d2 None None] No DVR routers for this DVR port 0ab23af3-1805-4c63-a15b-b032f649ca20 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:30.749339 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.757689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:30.758509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.789002 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40f7f735-1a46-4a7f-943d-514b528bb5b6 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.799922 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d6753edd-02d8-4369-baed-22d1108a77be None None] Deleting port 575803b5-a55e-4690-9e70-bdd10d4b4cc9 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:30.800344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6753edd-02d8-4369-baed-22d1108a77be None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.813083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.834418 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.840527 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] 10.222.0.57 "DELETE /v2.0/networks/e9b085a0-e0b5-4630-9607-8d0706a5122c HTTP/1.1" status: 204 len: 168 time: 0.9256308 Dec 10 14:29:30.846566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-095aa314-05f1-481b-ba80-3440fba83122 tempest-PortsTestJSON-1921135871 tempest-PortsTestJSON-1921135871-project] Pushing event deleted for resources: {'Network': ['ID=e9b085a0-e0b5-4630-9607-8d0706a5122c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:30.851870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:30.856547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.899123 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d6753edd-02d8-4369-baed-22d1108a77be None None] For port 575803b5-a55e-4690-9e70-bdd10d4b4cc9, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=575803b5-a55e-4690-9e70-bdd10d4b4cc9,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:30.900361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6753edd-02d8-4369-baed-22d1108a77be None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:30.917942 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d6753edd-02d8-4369-baed-22d1108a77be None None] Calling delete_port for 575803b5-a55e-4690-9e70-bdd10d4b4cc9 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:30.928005 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.2092710 Dec 10 14:29:30.939771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57752) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:30.976861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0ab23af3-1805-4c63-a15b-b032f649ca20 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:30.993868 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '3d97021c-8887-4ba8-9c45-2423b0852bc5', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:31.025368 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae0c4222-23c9-4b45-a539-451424ba2144 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Network': ['ID=3d97021c-8887-4ba8-9c45-2423b0852bc5,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:31.047826 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 3d97021c-8887-4ba8-9c45-2423b0852bc5 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:29:31.049628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 0ab23af3-1805-4c63-a15b-b032f649ca20 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:31.049967 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0ab23af3-1805-4c63-a15b-b032f649ca20 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:31.050410 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device cbcc7a12-8783-47cd-9c2b-9efbf73dac97 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:31.094961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: cbcc7a12-8783-47cd-9c2b-9efbf73dac97 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:31.094961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device cbcc7a12-8783-47cd-9c2b-9efbf73dac97 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:31.095324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 575803b5-a55e-4690-9e70-bdd10d4b4cc9 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:31.099025 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.121349 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.133757 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.180151 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=0ab23af3-1805-4c63-a15b-b032f649ca20,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:31.187606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-cdc974f6-b151-4fa8-9520-52fb16abee43 None None] Could not find standard attr ID for object 832a3614-528d-4d6b-a571-e3a9afaecf3d. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:31.224520 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No DVR routers for this DVR port 0ab23af3-1805-4c63-a15b-b032f649ca20 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:31.266741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.346046 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:31.349888 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.355337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6753edd-02d8-4369-baed-22d1108a77be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.369907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40f7f735-1a46-4a7f-943d-514b528bb5b6 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.381110 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.385405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6753edd-02d8-4369-baed-22d1108a77be None None] No DVR routers for this DVR port 575803b5-a55e-4690-9e70-bdd10d4b4cc9 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:31.430123 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c6e3766-0f3d-46b6-b99c-ddbf594f0506 None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:29:31.435773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6753edd-02d8-4369-baed-22d1108a77be None None] Pushing event deleted for resources: {'Port': ['ID=575803b5-a55e-4690-9e70-bdd10d4b4cc9,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:31.469781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['152411ab-4991-469e-bd27-c8d29a909a0f']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:31.489624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '877fce5e-0213-4db9-862b-58436fd1cb89') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:31.489624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '877fce5e-0213-4db9-862b-58436fd1cb89') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:31.542442 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.562196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57756) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:31.573489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.585258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c6e3766-0f3d-46b6-b99c-ddbf594f0506 None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:29:31.610709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Releasing vlan 361 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:31.614142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:31.616449 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:31.633602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40f7f735-1a46-4a7f-943d-514b528bb5b6 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.662641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40f7f735-1a46-4a7f-943d-514b528bb5b6 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Subnet': ['ID=87d059f9-1c74-4752-a500-2102db4239b7,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:31.666412 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-40f7f735-1a46-4a7f-943d-514b528bb5b6 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.669724 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-40f7f735-1a46-4a7f-943d-514b528bb5b6 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/subnets/87d059f9-1c74-4752-a500-2102db4239b7 HTTP/1.1" status: 204 len: 168 time: 1.0536547 Dec 10 14:29:31.672186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57760) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:31.707974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.823993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.826475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:31.838682 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:31.844375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:31.845070 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.850829 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.859676 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a3b00727-14ca-4246-8bfa-dbd840cd7038 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=7a25938276dc428b9a5723e37d120269&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2932291 Dec 10 14:29:31.867715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57762) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:31.870658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.873093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '1cbd6562-25cf-4d77-95a5-de9d7d9d8841'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:31.874016 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.877687 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/networks/152411ab-4991-469e-bd27-c8d29a909a0f HTTP/1.1" status: 204 len: 168 time: 2.0109227 Dec 10 14:29:31.879416 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57764) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:31.883143 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.17 (b44c5886-b77e-456d-b9b8-db5350758724/8bcb9694-fbbf-4a44-b94d-96729fcd88cb/7e2c0168-99c0-451f-b813-4d00d9e18c39) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:31.885262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=1cbd6562-25cf-4d77-95a5-de9d7d9d8841,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:31.945751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dace484-6160-40c9-9dae-687653df32f3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Network': ['ID=152411ab-4991-469e-bd27-c8d29a909a0f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:31.957107 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5b8891b1-856b-4cbb-a2f6-56b4549ccb4c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:31.977092 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0e6cc1e6-cf8e-4a56-9072-b85c5cea2b79 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.4946864 Dec 10 14:29:31.978301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57766) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:31.984137 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': '1cbd6562-25cf-4d77-95a5-de9d7d9d8841', 'ip_address': '2001:db8::c709:343d:dc1e:43ea'}], 'name': 'tempest-NetworksTestDHCPv6-989756569'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:32.002783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5b8891b1-856b-4cbb-a2f6-56b4549ccb4c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.033316 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.046276 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/1cbd6562-25cf-4d77-95a5-de9d7d9d8841/a82c384c-f726-438d-a897-56a72f312f4a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:32.051749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Deleting port 4a2e3532-7894-4209-ad1e-5aca27394245 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:32.052106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.201092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] For port 4a2e3532-7894-4209-ad1e-5aca27394245, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=4a2e3532-7894-4209-ad1e-5aca27394245,segment=NetworkSegment(0babddd5-7dfe-4053-aadc-afd6a9cd9116),segment_id=0babddd5-7dfe-4053-aadc-afd6a9cd9116)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:32.201496 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.210994 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.218068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=d6694149-b28c-4bc2-a263-a61bda721e96,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:32.218846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Calling delete_port for 4a2e3532-7894-4209-ad1e-5aca27394245 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:32.247420 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.248852 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Checking segment: {'id': '11eecb57-fb6d-4bc2-b732-a14c8518fce6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '3d97021c-8887-4ba8-9c45-2423b0852bc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:32.249212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network hostable DHCP agents. Network: 3d97021c-8887-4ba8-9c45-2423b0852bc5, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:29:32.270181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5b8891b1-856b-4cbb-a2f6-56b4549ccb4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.272752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5b8891b1-856b-4cbb-a2f6-56b4549ccb4c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.273940 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5b8891b1-856b-4cbb-a2f6-56b4549ccb4c admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/6d924007-6dde-43f0-a9a9-5146398925e3 HTTP/1.1" status: 204 len: 168 time: 0.4054198 Dec 10 14:29:32.283624 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.285856 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b8891b1-856b-4cbb-a2f6-56b4549ccb4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d924007-6dde-43f0-a9a9-5146398925e3,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:32.340973 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:32.368771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 3d97021c-8887-4ba8-9c45-2423b0852bc5 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:29:32.372186 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:32.376730 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:32.382326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:32.384892 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Pushing event updated for resources: {'Port': ['ID=a82c384c-f726-438d-a897-56a72f312f4a,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:32.422347 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.445463 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Attempting to bind port a82c384c-f726-438d-a897-56a72f312f4a on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:32.445853 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Attempting to bind port a82c384c-f726-438d-a897-56a72f312f4a by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:32.446226 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Attempting to bind port a82c384c-f726-438d-a897-56a72f312f4a on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:32.450118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.454613 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 3d97021c-8887-4ba8-9c45-2423b0852bc5) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:32.466392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:32.466931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:32.467414 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.467830 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:32.469320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Bound port: a82c384c-f726-438d-a897-56a72f312f4a, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:32.470023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.481365 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] No DVR routers for this DVR port 4a2e3532-7894-4209-ad1e-5aca27394245 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:32.485332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:32.485763 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.509689 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Port': ['ID=4a2e3532-7894-4209-ad1e-5aca27394245,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:32.523373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network b44c5886-b77e-456d-b9b8-db5350758724 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:32.528642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:32.536067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:32.540846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.542024 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=7e2c0168-99c0-451f-b813-4d00d9e18c39,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:32.575602 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] For port a82c384c-f726-438d-a897-56a72f312f4a, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:32.579608 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] For port a82c384c-f726-438d-a897-56a72f312f4a, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a82c384c-f726-438d-a897-56a72f312f4a,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:32.583445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.595450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.604692 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port e55e62e8-cc60-4757-af52-ffb7a7428ba1 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:32.620005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.627506 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-09ac643f-f1b3-4939-b497-b62deaf3c79d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6839330 Dec 10 14:29:32.651826 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b27b6c39-0c3d-4675-89cd-9e6d2b6a2229']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:32.653963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57772) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:32.658701 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '3d97021c-8887-4ba8-9c45-2423b0852bc5', 'name': 'tempest-PortsIpV6TestJSON-444569658', 'fixed_ips': [{'subnet_id': 'd6694149-b28c-4bc2-a263-a61bda721e96', 'ip_address': '2001:db8::10'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:32.674220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0babddd5-7dfe-4053-aadc-afd6a9cd9116') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:32.674476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.674606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0babddd5-7dfe-4053-aadc-afd6a9cd9116') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:32.706190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.761137 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.810616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Releasing vlan 398 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:32.815066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:32.860876 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:32.984474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a141d8b0-f54b-438e-8a6a-cc204fcb0695 None None] Pushing event updated for resources: {'Port': ['ID=a82c384c-f726-438d-a897-56a72f312f4a,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:33.038603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2393c35c-368d-40b5-9010-e35fd3314294 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.066493 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::c709:343d:dc1e:43ea (cdc891b5-3e75-4d62-a51b-0f84be9af82d/1cbd6562-25cf-4d77-95a5-de9d7d9d8841/e55e62e8-cc60-4757-af52-ffb7a7428ba1) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:33.109936 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.125364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.129633 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] 10.222.0.57 "DELETE /v2.0/networks/b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 HTTP/1.1" status: 204 len: 168 time: 1.4551518 Dec 10 14:29:33.135518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:33.253996 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.266744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6e9540-aace-42f4-94c2-e13b567f6f31 tempest-NetworksIpV6Test-483244733 tempest-NetworksIpV6Test-483244733-project] Pushing event deleted for resources: {'Network': ['ID=b27b6c39-0c3d-4675-89cd-9e6d2b6a2229,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:33.337071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 5275a0b6-ac28-4845-829d-0c28ba93c2ad yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:33.380404 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.509380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.538207 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 968ad944-9269-4599-a638-73d9c25aedbf {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:33.538599 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.596017 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::10 (3d97021c-8887-4ba8-9c45-2423b0852bc5/d6694149-b28c-4bc2-a263-a61bda721e96/5275a0b6-ac28-4845-829d-0c28ba93c2ad) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:33.716615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.750803 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port 968ad944-9269-4599-a638-73d9c25aedbf, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=968ad944-9269-4599-a638-73d9c25aedbf,segment=NetworkSegment(c6598b53-1d26-477e-bd07-4d2d83dec5b6),segment_id=c6598b53-1d26-477e-bd07-4d2d83dec5b6)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:33.751157 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.774542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 968ad944-9269-4599-a638-73d9c25aedbf owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:33.787787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:33.800705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57796) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:33.806046 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:33.808483 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:33.823850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:33.824567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.839539 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=e55e62e8-cc60-4757-af52-ffb7a7428ba1,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:33.861834 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57800) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:33.871993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.920407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:33.949163 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c8bd8e27-287a-4972-ac8c-4a3b51a89d8a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.9686766 Dec 10 14:29:33.952177 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57804) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:34.023974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.071998 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 3d97021c-8887-4ba8-9c45-2423b0852bc5 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:34.076385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:34.089875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c206d7de-7b33-43c9-83d3-e6abaee3b33a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:34.094284 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.100554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c206d7de-7b33-43c9-83d3-e6abaee3b33a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:34.102557 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c206d7de-7b33-43c9-83d3-e6abaee3b33a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.1491065 Dec 10 14:29:34.106127 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:34.112214 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:34.113043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.115407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57806) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:34.152085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'network': {'name': 'tempest-RoutersTest-142448748'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:34.155835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=5275a0b6-ac28-4845-829d-0c28ba93c2ad,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:34.162470 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8d815c56-667c-4ed9-929b-d2a2270837c6 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=243ec7ec23134148a44eb888e6040f25&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2958658 Dec 10 14:29:34.164140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57808) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:34.181270 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.206718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.210629 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=7e2c0168-99c0-451f-b813-4d00d9e18c39,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:34.243212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=968ad944-9269-4599-a638-73d9c25aedbf,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:34.251670 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e1862ba9-ac42-401b-884d-14f18f77a200 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.5944948 Dec 10 14:29:34.252839 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57810) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:34.259837 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '3d97021c-8887-4ba8-9c45-2423b0852bc5', 'name': 'tempest-PortsIpV6TestJSON-1126162344', 'fixed_ips': [{'subnet_id': 'd6694149-b28c-4bc2-a263-a61bda721e96', 'ip_address': '2001:db8::f'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:34.323803 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c3bed856-44c8-4f82-8644-f5cfbc559977 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.352876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-8a83ead7-4757-486b-96b1-73cb364f104f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port e55e62e8-cc60-4757-af52-ffb7a7428ba1 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:34.353224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a83ead7-4757-486b-96b1-73cb364f104f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.366956 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c3bed856-44c8-4f82-8644-f5cfbc559977 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.404539 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-393586f4-17a3-47fe-b5fc-f6db95e80908 None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:29:34.430958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.453320 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:34.457875 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.470778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.479527 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c0f39e46-7eee-4d1d-99f0-5028af6cbd2c None None] Provisioning complete for port a82c384c-f726-438d-a897-56a72f312f4a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:34.479769 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c0f39e46-7eee-4d1d-99f0-5028af6cbd2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.523122 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a83ead7-4757-486b-96b1-73cb364f104f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.536632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-8a83ead7-4757-486b-96b1-73cb364f104f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for e55e62e8-cc60-4757-af52-ffb7a7428ba1 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:34.547357 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network b44c5886-b77e-456d-b9b8-db5350758724 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:34.585580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:34.588465 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:34.590732 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.594379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-393586f4-17a3-47fe-b5fc-f6db95e80908 None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:29:34.621237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port e1bfcff1-665d-470c-87b0-5259c3accade yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:34.621868 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c0f39e46-7eee-4d1d-99f0-5028af6cbd2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.662960 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c3bed856-44c8-4f82-8644-f5cfbc559977 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.666198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c3bed856-44c8-4f82-8644-f5cfbc559977 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.667367 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c3bed856-44c8-4f82-8644-f5cfbc559977 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/0bcf9766-8cb7-4c61-8f3b-2048d7ede622 HTTP/1.1" status: 204 len: 168 time: 0.5013330 Dec 10 14:29:34.695594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3bed856-44c8-4f82-8644-f5cfbc559977 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0bcf9766-8cb7-4c61-8f3b-2048d7ede622,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:34.814862 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c0f39e46-7eee-4d1d-99f0-5028af6cbd2c None None] For port a82c384c-f726-438d-a897-56a72f312f4a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a82c384c-f726-438d-a897-56a72f312f4a,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:34.850625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::f (3d97021c-8887-4ba8-9c45-2423b0852bc5/d6694149-b28c-4bc2-a263-a61bda721e96/e1bfcff1-665d-470c-87b0-5259c3accade) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:34.856119 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:34.877365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9d7899bb-a9e2-467f-bfc6-02634a8598ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:34.901877 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:34.936090 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c0f39e46-7eee-4d1d-99f0-5028af6cbd2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.009255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a83ead7-4757-486b-96b1-73cb364f104f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.016986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f39e46-7eee-4d1d-99f0-5028af6cbd2c None None] Pushing event updated for resources: {'Port': ['ID=a82c384c-f726-438d-a897-56a72f312f4a,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:35.043426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bda5860-6ab5-47e2-b4e0-34bda67275fe None None] DHCP port deletion for b27b6c39-0c3d-4675-89cd-9e6d2b6a2229 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:35.051430 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a83ead7-4757-486b-96b1-73cb364f104f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=e55e62e8-cc60-4757-af52-ffb7a7428ba1,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:35.056134 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.105342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-3d97021c-8887-4ba8-9c45-2423b0852bc5', 'network_id': '3d97021c-8887-4ba8-9c45-2423b0852bc5', 'project_id': 'cc793beea85f4cf887a3485aad20d8e7', 'fixed_ips': [{'subnet_id': 'd6694149-b28c-4bc2-a263-a61bda721e96'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:35.114101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8a83ead7-4757-486b-96b1-73cb364f104f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.114299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.121481 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8a83ead7-4757-486b-96b1-73cb364f104f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/e55e62e8-cc60-4757-af52-ffb7a7428ba1 HTTP/1.1" status: 204 len: 168 time: 1.0023036 Dec 10 14:29:35.124319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57816) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:35.144576 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] vlan segment allocate from pool success with {'vlan_id': 396, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:29:35.166507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a82c384c-f726-438d-a897-56a72f312f4a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:35.167184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.167625 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added segment 32df60c7-bd5d-4255-99ac-f954bb095ea6 of type vlan for network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 Dec 10 14:29:35.174479 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-73aa4df9-503c-47f3-8b08-2a23afda71d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.216537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.223970 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.236862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c83709d-c467-49e5-b8de-6f9fbfe4c67d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:35.239066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c83709d-c467-49e5-b8de-6f9fbfe4c67d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:35.241996 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0c83709d-c467-49e5-b8de-6f9fbfe4c67d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1168580 Dec 10 14:29:35.248099 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57818) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:35.258055 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d61529e1-10cf-461c-adfb-117bfd5a0066,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:35.318109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.342716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:35.344863 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.360435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a82c384c-f726-438d-a897-56a72f312f4a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:35.361780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.408136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.485636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 3d97021c-8887-4ba8-9c45-2423b0852bc5 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:35.492277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:35.494193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:35.514996 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:35.517702 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6df63d34-a547-4cc2-b0d3-27efa629b7e1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/routers/9d7899bb-a9e2-467f-bfc6-02634a8598ca/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7704015 Dec 10 14:29:35.518646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Sync routers for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:35.525765 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Allocated IP 2001:db8::2 (3d97021c-8887-4ba8-9c45-2423b0852bc5/d6694149-b28c-4bc2-a263-a61bda721e96/b8942d74-9850-47eb-b0f5-9b71b1e66422) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:35.526678 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.7249467 Dec 10 14:29:35.531753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:35.533362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57826) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:35.545251 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'network': {'name': 'tempest-RoutersTest-1135888229'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:35.545411 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:35.564178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:35.565109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:35.572036 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:35.572802 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:35.573066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:35.573880 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.580551 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9990f82a-cb50-4408-a073-2275430a6014 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6795795 Dec 10 14:29:35.590733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57830) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:35.591954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a36359ef-23a2-4b81-b9e7-904afd97d671 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Network': ['ID=96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:35.648371 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-52b6cfc0-220d-4b8d-8968-072ac7e97f41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 1cbd6562-25cf-4d77-95a5-de9d7d9d8841 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:35.671366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-52b6cfc0-220d-4b8d-8968-072ac7e97f41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.694999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:29:35.700640 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a1a49ac-b5c6-427a-8787-b0b14bf3c4f1 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting subnet d0bc12cf-44cd-4620-98df-8ce2c544d13c {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:35.707753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a1a49ac-b5c6-427a-8787-b0b14bf3c4f1 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.756316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=e1bfcff1-665d-470c-87b0-5259c3accade,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:35.774236 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:35.779761 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:35.802541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.813715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-52b6cfc0-220d-4b8d-8968-072ac7e97f41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:35.841295 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a1a49ac-b5c6-427a-8787-b0b14bf3c4f1 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.002509 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a1a49ac-b5c6-427a-8787-b0b14bf3c4f1 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.012847 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1301a960-ca02-4c3c-b6df-5dbdab3e4985 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.7581620 Dec 10 14:29:36.015655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57840) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.076586 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] vlan segment allocate from pool success with {'vlan_id': 361, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:29:36.083987 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-52b6cfc0-220d-4b8d-8968-072ac7e97f41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.099558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.100235 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added segment 97a96e15-5d5f-4994-a371-e42623166e47 of type vlan for network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 Dec 10 14:29:36.123744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:36.157860 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.167977 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a1a49ac-b5c6-427a-8787-b0b14bf3c4f1 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.208614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a1a49ac-b5c6-427a-8787-b0b14bf3c4f1 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Subnet': ['ID=d0bc12cf-44cd-4620-98df-8ce2c544d13c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:36.218389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f074b57f-0dc3-488d-932a-04c12c305b6d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:36.222768 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f074b57f-0dc3-488d-932a-04c12c305b6d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A1 HTTP/1.1" status: 200 len: 927 time: 0.2058439 Dec 10 14:29:36.229219 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a1a49ac-b5c6-427a-8787-b0b14bf3c4f1 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.232342 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57844) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.238019 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7a1a49ac-b5c6-427a-8787-b0b14bf3c4f1 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/d0bc12cf-44cd-4620-98df-8ce2c544d13c HTTP/1.1" status: 204 len: 168 time: 0.6341527 Dec 10 14:29:36.238784 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57846) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.319280 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-52b6cfc0-220d-4b8d-8968-072ac7e97f41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.333686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.338799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:36.338799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.379088 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52b6cfc0-220d-4b8d-8968-072ac7e97f41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=1cbd6562-25cf-4d77-95a5-de9d7d9d8841,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:36.396984 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.407732 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-52b6cfc0-220d-4b8d-8968-072ac7e97f41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.416384 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-52b6cfc0-220d-4b8d-8968-072ac7e97f41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/1cbd6562-25cf-4d77-95a5-de9d7d9d8841 HTTP/1.1" status: 204 len: 168 time: 1.1632814 Dec 10 14:29:36.421839 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57850) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.439438 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:33Z', 'revision_number': 10, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:36.465989 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0231d7e8-3e88-48a6-9c66-107d45d8672b None None] Provisioning complete for port a82c384c-f726-438d-a897-56a72f312f4a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:36.466655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0231d7e8-3e88-48a6-9c66-107d45d8672b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.477394 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57852) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.481201 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.484784 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:36.490066 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-be6da7b6-6012-4039-85f3-7a86ec0e6dc8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0648906 Dec 10 14:29:36.495316 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:36.495678 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:36.502419 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57858) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.510294 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a198d09-ae35-4c08-8202-54d0aa3c898e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:36.515588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.516460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a198d09-ae35-4c08-8202-54d0aa3c898e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:36.522333 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2a198d09-ae35-4c08-8202-54d0aa3c898e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A HTTP/1.1" status: 200 len: 1650 time: 0.2848270 Dec 10 14:29:36.527505 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57860) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.596360 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 1.0571325 Dec 10 14:29:36.598208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a53fdb-beaa-4830-8161-6d923bb2ef11 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Network': ['ID=5dc6676b-2ea0-4f66-8344-f1b50cefe135,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:36.599381 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.602702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57862) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.609586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'subnet': {'network_id': '96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:36.627655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:29:36.655472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29f1e4e2-60f9-45a6-9fb5-dbc4bf33ecdf tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:36.655472 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-29f1e4e2-60f9-45a6-9fb5-dbc4bf33ecdf tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1495132 Dec 10 14:29:36.659607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57864) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.692580 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:36.742224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Network 3d97021c-8887-4ba8-9c45-2423b0852bc5 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:36.748797 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abbda9af-8dac-4dc0-a82e-571a7813181e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:36.750724 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-abbda9af-8dac-4dc0-a82e-571a7813181e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0900874 Dec 10 14:29:36.753366 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57866) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.774376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:36.776915 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:36.790590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Pushing event updated for resources: {'Port': ['ID=b8942d74-9850-47eb-b0f5-9b71b1e66422,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:36.852540 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c0093ba5-e7dc-407d-b45b-c4e8057ba1b0 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0972755 Dec 10 14:29:36.861163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57868) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:36.875390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:36.915977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Attempting to bind port b8942d74-9850-47eb-b0f5-9b71b1e66422 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:36.916404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Attempting to bind port b8942d74-9850-47eb-b0f5-9b71b1e66422 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '11eecb57-fb6d-4bc2-b732-a14c8518fce6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '3d97021c-8887-4ba8-9c45-2423b0852bc5'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:36.916884 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Attempting to bind port b8942d74-9850-47eb-b0f5-9b71b1e66422 on network 3d97021c-8887-4ba8-9c45-2423b0852bc5 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:36.941529 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0231d7e8-3e88-48a6-9c66-107d45d8672b None None] Could not find standard attr ID for object e55e62e8-cc60-4757-af52-ffb7a7428ba1. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:36.957776 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:36.958493 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Checking segment: {'id': '11eecb57-fb6d-4bc2-b732-a14c8518fce6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '3d97021c-8887-4ba8-9c45-2423b0852bc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:36.959015 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:36.960230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Bound using segment: {'id': '11eecb57-fb6d-4bc2-b732-a14c8518fce6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '3d97021c-8887-4ba8-9c45-2423b0852bc5'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:36.960824 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Bound port: b8942d74-9850-47eb-b0f5-9b71b1e66422, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '11eecb57-fb6d-4bc2-b732-a14c8518fce6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '3d97021c-8887-4ba8-9c45-2423b0852bc5'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:36.961316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.001858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a82c384c-f726-438d-a897-56a72f312f4a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:37.059762 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:33Z', 'revision_number': 10, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:37.092040 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6738767c-2fb2-4ff3-9049-e10ad2434219 None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:33Z', 'revision_number': 10, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None, '_interfaces': [{'id': '8c0ec7f3-de0e-4f34-a74d-075932c3f070', 'name': '', 'network_id': '5fd1a66e-713e-4c71-b668-f7e44677057e', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'mac_address': 'fa:16:3e:c9:ea:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'device_owner': 'network:router_interface', 'standard_attr_id': 911, 'fixed_ips': [{'subnet_id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:28:36Z', 'updated_at': '2021-12-10T14:28:45Z', 'revision_number': 5, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'subnets': [{'id': 'a6cd01ad-5324-4b95-8569-d765ef925d22', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:37.167609 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-5ce7833f-abdd-43ec-9bb3-c48a10b8bb0e tempest-DvrRoutersNegativeTest-1518327337 tempest-DvrRoutersNegativeTest-1518327337-project] Request body: {'router': {'name': 'tempest-DvrRoutersNegativeTest-router-109044954', 'external_gateway_info': {}, 'admin_state_up': False, 'distributed': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:37.170804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.policy [None req-5ce7833f-abdd-43ec-9bb3-c48a10b8bb0e tempest-DvrRoutersNegativeTest-1518327337 tempest-DvrRoutersNegativeTest-1518327337-project] Enforcing rules: ['create_router', 'create_router:external_gateway_info', 'create_router:distributed'] {{(pid=103811) log_rule_list /opt/stack/neutron/neutron/policy.py:450}} Dec 10 14:29:37.172208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.policy [None req-5ce7833f-abdd-43ec-9bb3-c48a10b8bb0e tempest-DvrRoutersNegativeTest-1518327337 tempest-DvrRoutersNegativeTest-1518327337-project] Failed policy check for 'create_router' {{(pid=103811) enforce /opt/stack/neutron/neutron/policy.py:524}} Dec 10 14:29:37.172208 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-5ce7833f-abdd-43ec-9bb3-c48a10b8bb0e tempest-DvrRoutersNegativeTest-1518327337 tempest-DvrRoutersNegativeTest-1518327337-project] create failed (client error): Access was denied to this resource. Dec 10 14:29:37.173066 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5ce7833f-abdd-43ec-9bb3-c48a10b8bb0e tempest-DvrRoutersNegativeTest-1518327337 tempest-DvrRoutersNegativeTest-1518327337-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 403 len: 414 time: 0.6877635 Dec 10 14:29:37.205314 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:37.214052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.229184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 131d1bed-da3a-4c72-b20d-dee3f741a0e2 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:37.229710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.304269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port 131d1bed-da3a-4c72-b20d-dee3f741a0e2, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=131d1bed-da3a-4c72-b20d-dee3f741a0e2,segment=NetworkSegment(c6598b53-1d26-477e-bd07-4d2d83dec5b6),segment_id=c6598b53-1d26-477e-bd07-4d2d83dec5b6)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:37.304634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.339440 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-b547597a-1e2d-41fe-92d3-93d38f4fd4b5 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3220918 Dec 10 14:29:37.341293 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 131d1bed-da3a-4c72-b20d-dee3f741a0e2 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:37.413573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] For port b8942d74-9850-47eb-b0f5-9b71b1e66422, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:37.418045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] For port b8942d74-9850-47eb-b0f5-9b71b1e66422, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b8942d74-9850-47eb-b0f5-9b71b1e66422,segment=NetworkSegment(11eecb57-fb6d-4bc2-b732-a14c8518fce6),segment_id=11eecb57-fb6d-4bc2-b732-a14c8518fce6)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:37.435509 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a82c384c-f726-438d-a897-56a72f312f4a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:37.435885 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.439835 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:29:33Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '17a6f7a3-9b53-4a18-b1cf-56e4db4be95c', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.24', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 842, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:16Z', 'updated_at': '2021-12-10T14:28:21Z', 'revision_number': 1, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7e2c0168-99c0-451f-b813-4d00d9e18c39', 'name': '', 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:14:d5:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 1039, 'fixed_ips': [{'subnet_id': '8bcb9694-fbbf-4a44-b94d-96729fcd88cb', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:31Z', 'updated_at': '2021-12-10T14:29:33Z', 'revision_number': 2, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '8bcb9694-fbbf-4a44-b94d-96729fcd88cb', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:37.490903 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-826fbb17-595e-41e0-86b9-d2d9fc89e8d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:37.492874 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-826fbb17-595e-41e0-86b9-d2d9fc89e8d4 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 1098 time: 0.1226208 Dec 10 14:29:37.493113 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-010e7060-e6e2-465a-a7ba-37b08e54aa37 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port e1bfcff1-665d-470c-87b0-5259c3accade {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:37.493500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-010e7060-e6e2-465a-a7ba-37b08e54aa37 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.502729 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Checking router: 9d7899bb-a9e2-467f-bfc6-02634a8598ca for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:37.503649 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Updating router 9d7899bb-a9e2-467f-bfc6-02634a8598ca port 7e2c0168-99c0-451f-b813-4d00d9e18c39 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:29:37.522109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.608650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.624635 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-010e7060-e6e2-465a-a7ba-37b08e54aa37 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.640437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-010e7060-e6e2-465a-a7ba-37b08e54aa37 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for e1bfcff1-665d-470c-87b0-5259c3accade owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:37.661135 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.668861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:37.671739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.678731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-ea4c2eef-3d39-4396-a2d3-80f3baf2800d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:37.681066 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-ea4c2eef-3d39-4396-a2d3-80f3baf2800d service neutron] 10.222.0.39 "GET /v2.0/networks?id=041ac3a9-0ca7-4449-9782-639f1235b461 HTTP/1.1" status: 200 len: 898 time: 0.1396179 Dec 10 14:29:37.698302 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.702910 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f7f32a-1cd1-4bd5-af3e-7412721cb236 None None] Pushing event updated for resources: {'Port': ['ID=b8942d74-9850-47eb-b0f5-9b71b1e66422,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:37.754455 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4a2e3532-7894-4209-ad1e-5aca27394245 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:37.765503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=131d1bed-da3a-4c72-b20d-dee3f741a0e2,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:37.782260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.803648 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No DVR routers for this DVR port 131d1bed-da3a-4c72-b20d-dee3f741a0e2 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:37.846197 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:37.864945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:37.870900 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:37.871445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:37.873067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 4a2e3532-7894-4209-ad1e-5aca27394245 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:37.873398 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4a2e3532-7894-4209-ad1e-5aca27394245 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:37.932362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=aa8f6eca-77cd-4b2a-abe0-47af4532c196,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:37.953164 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-4cf11494-218e-47e6-b23e-c0016a6732a5 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e HTTP/1.1" status: 200 len: 1000 time: 0.2631998 Dec 10 14:29:38.025618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.028443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-6a02d7b0-ae98-4734-8066-b72757177fd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:38.029799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57876) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:38.034402 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-6a02d7b0-ae98-4734-8066-b72757177fd8 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a HTTP/1.1" status: 200 len: 834 time: 0.0648723 Dec 10 14:29:38.038704 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-086587db-dba2-4bc3-ad72-108b8a11ea4f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.1754127 Dec 10 14:29:38.041408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57878) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:38.047634 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': 'aa8f6eca-77cd-4b2a-abe0-47af4532c196', 'ip_address': '2001:db8::f0cb:4d08:7ac3:eafe'}], 'name': 'tempest-NetworksTestDHCPv6-823747345'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:38.092326 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c23cb4a7-305b-44c0-859c-d250baf023e6']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:38.120588 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c6598b53-1d26-477e-bd07-4d2d83dec5b6') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:38.124281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c6598b53-1d26-477e-bd07-4d2d83dec5b6') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:38.183934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.213752 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-1f1dff6f-badf-4023-9532-5fbb3310cf54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:38.215272 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-1f1dff6f-badf-4023-9532-5fbb3310cf54 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=041ac3a9-0ca7-4449-9782-639f1235b461&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1613221 Dec 10 14:29:38.239965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.245058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-73517b90-3391-4eb7-84cc-dc212edf9a8a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.250625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.283517 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Releasing vlan 371 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:38.284180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:38.292904 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:38.338838 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-b1130f74-dc4e-4f45-929f-0427692bc445 service neutron] 10.222.0.39 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1116495 Dec 10 14:29:38.340141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.349243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-010e7060-e6e2-465a-a7ba-37b08e54aa37 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.397064 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8ed4c64-df70-4e6d-ac17-3abf21d33a19 None None] Pushing event updated for resources: {'Port': ['ID=7e2c0168-99c0-451f-b813-4d00d9e18c39,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:38.409481 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:38.415651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-010e7060-e6e2-465a-a7ba-37b08e54aa37 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=e1bfcff1-665d-470c-87b0-5259c3accade,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:38.454320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-010e7060-e6e2-465a-a7ba-37b08e54aa37 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.454320 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-010e7060-e6e2-465a-a7ba-37b08e54aa37 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/e1bfcff1-665d-470c-87b0-5259c3accade HTTP/1.1" status: 204 len: 168 time: 1.9227185 Dec 10 14:29:38.454320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.457612 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57884) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:38.465390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Attempting to bind port 7e2c0168-99c0-451f-b813-4d00d9e18c39 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:38.466209 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Attempting to bind port 7e2c0168-99c0-451f-b813-4d00d9e18c39 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:38.466614 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Attempting to bind port 7e2c0168-99c0-451f-b813-4d00d9e18c39 on network b44c5886-b77e-456d-b9b8-db5350758724 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:38.472812 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:38.473479 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Checking segment: {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:38.473953 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.475138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Bound using segment: {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:38.475138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Bound port: 7e2c0168-99c0-451f-b813-4d00d9e18c39, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3298319f-ed8b-45f9-8ce9-abfd3a6af445', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:38.475451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.519625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.544500 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.547827 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/networks/c23cb4a7-305b-44c0-859c-d250baf023e6 HTTP/1.1" status: 204 len: 168 time: 2.3075299 Dec 10 14:29:38.553991 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-0f26d6ed-df34-4809-8d4c-549e317c3638 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:29:38.554383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] For port 7e2c0168-99c0-451f-b813-4d00d9e18c39, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:38.558005 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] For port 7e2c0168-99c0-451f-b813-4d00d9e18c39, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7e2c0168-99c0-451f-b813-4d00d9e18c39,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:38.558264 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0f26d6ed-df34-4809-8d4c-549e317c3638 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/e1bfcff1-665d-470c-87b0-5259c3accade HTTP/1.1" status: 404 len: 333 time: 0.0945623 Dec 10 14:29:38.558885 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57886) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:38.559216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57888) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:38.616994 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.669204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ca87bca-a35b-4709-95c3-e59684c52782 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Network': ['ID=c23cb4a7-305b-44c0-859c-d250baf023e6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:38.720576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:38.721132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:38.732097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Subnet': ['ID=57c9ba11-01e5-45c5-9332-cfdfee1d754c,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:38.735580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-73517b90-3391-4eb7-84cc-dc212edf9a8a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.752031 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Checking segment: {'id': '32df60c7-bd5d-4255-99ac-f954bb095ea6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:38.752427 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network hostable DHCP agents. Network: 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:29:38.785974 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8ed4c64-df70-4e6d-ac17-3abf21d33a19 None None] Pushing event updated for resources: {'Port': ['ID=7e2c0168-99c0-451f-b813-4d00d9e18c39,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:38.803499 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.887263 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:38.896041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:38.915492 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port 23fa6c92-49fd-413d-80d1-47d83bdfcfb9 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:38.957650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-73517b90-3391-4eb7-84cc-dc212edf9a8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.012138 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-73517b90-3391-4eb7-84cc-dc212edf9a8a admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=15aba387143444f79e466d3e22fceb3d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9812644 Dec 10 14:29:39.017754 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73517b90-3391-4eb7-84cc-dc212edf9a8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c58c0441-d23f-4f1c-a500-8d0a2ec21da7,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:39.019616 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57890) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:39.036869 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:29:39.046433 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-d50f528f-823b-4294-83b5-5e5f9b99cb01 req-48b7be01-b80a-4e7b-9708-dcb3aa97fe93 service neutron] 10.222.0.39 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6992843 Dec 10 14:29:39.146572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-dedb8e3b-75c8-480c-ae53-62b77284d896 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 5275a0b6-ac28-4845-829d-0c28ba93c2ad {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:39.147180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dedb8e3b-75c8-480c-ae53-62b77284d896 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.156846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:39.171018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b8942d74-9850-47eb-b0f5-9b71b1e66422 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:39.175989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9af8c537-fe8b-44d9-aa19-9a911cf5c38f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.203829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9af8c537-fe8b-44d9-aa19-9a911cf5c38f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.214637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:39.215380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.241925 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0774e24b-1db3-4d65-87bf-515893558a7c None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:39.245377 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6d92a22-9563-440a-924f-c82b18e53d17 None None] Network 3d97021c-8887-4ba8-9c45-2423b0852bc5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:39.251663 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e71ee36f-6f53-4135-95fc-c685c7bca2df None None] Network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:39.275804 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f0cb:4d08:7ac3:eafe (cdc891b5-3e75-4d62-a51b-0f84be9af82d/aa8f6eca-77cd-4b2a-abe0-47af4532c196/23fa6c92-49fd-413d-80d1-47d83bdfcfb9) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:39.351955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57892) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:39.352348 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2f429cd2-a4fe-4359-8b74-13c4e4b8367e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.7469456 Dec 10 14:29:39.354319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dedb8e3b-75c8-480c-ae53-62b77284d896 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.359121 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'subnet': {'network_id': '5dc6676b-2ea0-4f66-8344-f1b50cefe135', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:39.370887 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9af8c537-fe8b-44d9-aa19-9a911cf5c38f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.372875 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9af8c537-fe8b-44d9-aa19-9a911cf5c38f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.373266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-dedb8e3b-75c8-480c-ae53-62b77284d896 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 5275a0b6-ac28-4845-829d-0c28ba93c2ad owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:39.389027 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9af8c537-fe8b-44d9-aa19-9a911cf5c38f admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/c58c0441-d23f-4f1c-a500-8d0a2ec21da7 HTTP/1.1" status: 204 len: 168 time: 0.3568757 Dec 10 14:29:39.536778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af8c537-fe8b-44d9-aa19-9a911cf5c38f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c58c0441-d23f-4f1c-a500-8d0a2ec21da7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:39.568835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.676946 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.718617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-255f6e0c-9ad2-4b66-8a79-cb14eb15c21f None None] DHCP port deletion for c23cb4a7-305b-44c0-859c-d250baf023e6 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:39.744141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] Provisioning complete for port a82c384c-f726-438d-a897-56a72f312f4a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:39.744430 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:39.744960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.762094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.768674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b8942d74-9850-47eb-b0f5-9b71b1e66422 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:39.768674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.834064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dedb8e3b-75c8-480c-ae53-62b77284d896 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.875575 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.908475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dedb8e3b-75c8-480c-ae53-62b77284d896 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=5275a0b6-ac28-4845-829d-0c28ba93c2ad,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:39.957697 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dedb8e3b-75c8-480c-ae53-62b77284d896 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:39.964706 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dedb8e3b-75c8-480c-ae53-62b77284d896 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/5275a0b6-ac28-4845-829d-0c28ba93c2ad HTTP/1.1" status: 204 len: 168 time: 1.3979509 Dec 10 14:29:39.966521 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57896) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:40.012636 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-991de8a4-3ae2-4ded-a4c9-5f9fa4bbe61a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:29:40.017010 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-991de8a4-3ae2-4ded-a4c9-5f9fa4bbe61a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/5275a0b6-ac28-4845-829d-0c28ba93c2ad HTTP/1.1" status: 404 len: 333 time: 0.0494773 Dec 10 14:29:40.017721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=23fa6c92-49fd-413d-80d1-47d83bdfcfb9,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:40.019378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57898) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:40.031267 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5', 'network_id': '96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5', 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'fixed_ips': [{'subnet_id': '57c9ba11-01e5-45c5-9332-cfdfee1d754c'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:40.032346 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.088036 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:40.090472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:40.094763 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:40.101890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:40.103542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.109399 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:29:33Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '17a6f7a3-9b53-4a18-b1cf-56e4db4be95c', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.24', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 842, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:16Z', 'updated_at': '2021-12-10T14:28:21Z', 'revision_number': 1, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7e2c0168-99c0-451f-b813-4d00d9e18c39', 'name': '', 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:14:d5:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 1039, 'fixed_ips': [{'subnet_id': '8bcb9694-fbbf-4a44-b94d-96729fcd88cb', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:31Z', 'updated_at': '2021-12-10T14:29:38Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '8bcb9694-fbbf-4a44-b94d-96729fcd88cb', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:40.156739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-c365f877-16ca-4da1-ac9b-a4a9ae47e401 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet d6694149-b28c-4bc2-a263-a61bda721e96 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:40.178345 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c365f877-16ca-4da1-ac9b-a4a9ae47e401 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.181699 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2555142b-8221-4556-a3b6-0c97209d4b54 None None] The sync data for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv is: [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:29:33Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '17a6f7a3-9b53-4a18-b1cf-56e4db4be95c', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.24', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 842, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:16Z', 'updated_at': '2021-12-10T14:28:21Z', 'revision_number': 1, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7e2c0168-99c0-451f-b813-4d00d9e18c39', 'name': '', 'network_id': 'b44c5886-b77e-456d-b9b8-db5350758724', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:14:d5:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 1039, 'fixed_ips': [{'subnet_id': '8bcb9694-fbbf-4a44-b94d-96729fcd88cb', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:31Z', 'updated_at': '2021-12-10T14:29:38Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '8bcb9694-fbbf-4a44-b94d-96729fcd88cb', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:40.191684 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] Could not find standard attr ID for object 5275a0b6-ac28-4845-829d-0c28ba93c2ad. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:40.206870 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-736003b6-f6e5-4169-bac2-0e12714af38c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.1610317 Dec 10 14:29:40.212647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57900) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:40.221062 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-431fcc13-469e-4c32-a6ce-871d7de5f198 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': 'aa8f6eca-77cd-4b2a-abe0-47af4532c196', 'ip_address': '2001:db8::f0cb:4d08:7ac3:eafe'}], 'name': 'tempest-NetworksTestDHCPv6-1847318738'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:40.304618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] Could not find standard attr ID for object e55e62e8-cc60-4757-af52-ffb7a7428ba1. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:40.315489 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-679c33d3-e146-4991-9c81-e2414fbf31bd None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:40.334500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.367658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c365f877-16ca-4da1-ac9b-a4a9ae47e401 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.478760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.505219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c365f877-16ca-4da1-ac9b-a4a9ae47e401 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.601454 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Subnet': ['ID=c9398767-cec9-48fd-bdd3-815a3b0bab44,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:40.617988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 8c0ec7f3-de0e-4f34-a74d-075932c3f070 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:40.618332 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.664577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Checking segment: {'id': '97a96e15-5d5f-4994-a371-e42623166e47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '5dc6676b-2ea0-4f66-8344-f1b50cefe135'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:40.665344 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network hostable DHCP agents. Network: 5dc6676b-2ea0-4f66-8344-f1b50cefe135, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:29:40.692583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c365f877-16ca-4da1-ac9b-a4a9ae47e401 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.727431 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-431fcc13-469e-4c32-a6ce-871d7de5f198 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:40.733858 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-431fcc13-469e-4c32-a6ce-871d7de5f198 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.747863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c365f877-16ca-4da1-ac9b-a4a9ae47e401 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.752750 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c365f877-16ca-4da1-ac9b-a4a9ae47e401 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/d6694149-b28c-4bc2-a263-a61bda721e96 HTTP/1.1" status: 204 len: 168 time: 0.7322736 Dec 10 14:29:40.757237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c365f877-16ca-4da1-ac9b-a4a9ae47e401 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=d6694149-b28c-4bc2-a263-a61bda721e96,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:40.760418 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57904) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:40.780336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-431fcc13-469e-4c32-a6ce-871d7de5f198 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port b32a35de-8e9e-40cc-a078-fe415212b320 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:40.797318 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] Provisioning complete for port b8942d74-9850-47eb-b0f5-9b71b1e66422 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:40.798344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.872633 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.875264 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:29:40.925939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Allocated IP 172.20.0.2 (96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5/57c9ba11-01e5-45c5-9332-cfdfee1d754c/4fb240d1-b7b1-4215-bb8c-7e0a4ba97718) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:40.968702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port 8c0ec7f3-de0e-4f34-a74d-075932c3f070, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8c0ec7f3-de0e-4f34-a74d-075932c3f070,segment=NetworkSegment(d736d6f7-8b9d-47f6-8b67-dc23f9e2f057),segment_id=d736d6f7-8b9d-47f6-8b67-dc23f9e2f057)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:40.968904 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:40.973311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:29:40.973311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:29:40.992796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 5dc6676b-2ea0-4f66-8344-f1b50cefe135) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:40.996509 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 8c0ec7f3-de0e-4f34-a74d-075932c3f070 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:41.005463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:41.006245 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.030788 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port b8942d74-9850-47eb-b0f5-9b71b1e66422 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:41.031174 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.055544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b038e58-24de-4815-a586-b203125853db None None] Network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:41.095991 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-04666d90-03cd-4afd-8e59-2593aa5335a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7391291 Dec 10 14:29:41.096495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57906) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:41.101725 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b826ecd4-7039-46e0-a69a-be9f41515462 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-22950749', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:41.127135 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-431fcc13-469e-4c32-a6ce-871d7de5f198 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): There was a conflict when trying to complete your request. Dec 10 14:29:41.129335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-431fcc13-469e-4c32-a6ce-871d7de5f198 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:41.167577 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d127dd9-c18d-4cc6-bf45-866171cdca72 None None] Network 3d97021c-8887-4ba8-9c45-2423b0852bc5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:41.186102 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] For port b8942d74-9850-47eb-b0f5-9b71b1e66422, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b8942d74-9850-47eb-b0f5-9b71b1e66422,segment=NetworkSegment(11eecb57-fb6d-4bc2-b732-a14c8518fce6),segment_id=11eecb57-fb6d-4bc2-b732-a14c8518fce6)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:41.186466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.202283 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.209886 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for b8942d74-9850-47eb-b0f5-9b71b1e66422 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:41.227959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b826ecd4-7039-46e0-a69a-be9f41515462 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.229028 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b826ecd4-7039-46e0-a69a-be9f41515462 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.303166 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b826ecd4-7039-46e0-a69a-be9f41515462 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.309253 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-431fcc13-469e-4c32-a6ce-871d7de5f198 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 409 len: 389 time: 1.0924110 Dec 10 14:29:41.311641 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57910) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:41.338926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57912) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:41.379993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5070f0b8-1716-4b23-939d-5bd64157b86b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:41.386799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5070f0b8-1716-4b23-939d-5bd64157b86b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:41.388846 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5070f0b8-1716-4b23-939d-5bd64157b86b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1607 time: 0.0777340 Dec 10 14:29:41.392901 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57914) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:41.402952 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b826ecd4-7039-46e0-a69a-be9f41515462 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.426440 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] For port b8942d74-9850-47eb-b0f5-9b71b1e66422, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b8942d74-9850-47eb-b0f5-9b71b1e66422,segment=NetworkSegment(11eecb57-fb6d-4bc2-b732-a14c8518fce6),segment_id=11eecb57-fb6d-4bc2-b732-a14c8518fce6)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:41.429021 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-5dc6676b-2ea0-4f66-8344-f1b50cefe135', 'network_id': '5dc6676b-2ea0-4f66-8344-f1b50cefe135', 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'fixed_ips': [{'subnet_id': 'c9398767-cec9-48fd-bdd3-815a3b0bab44'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:41.430568 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.468968 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.514420 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.530153 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b826ecd4-7039-46e0-a69a-be9f41515462 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.534117 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b826ecd4-7039-46e0-a69a-be9f41515462 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 698 time: 0.4340141 Dec 10 14:29:41.535958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57916) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:41.548044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.607933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e138636-81dc-400a-8c58-c7b3effae241 None None] DHCP port deletion for 3d97021c-8887-4ba8-9c45-2423b0852bc5 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:41.620720 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.623122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.666424 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:41.670740 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Could not find standard attr ID for object b8942d74-9850-47eb-b0f5-9b71b1e66422. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:41.709090 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0e138636-81dc-400a-8c58-c7b3effae241 None None] The port 'b8942d74-9850-47eb-b0f5-9b71b1e66422' was deleted {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 10 14:29:41.713075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-ea033113-8c5e-41a0-8ae0-57514f7c3c0f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 23fa6c92-49fd-413d-80d1-47d83bdfcfb9 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:41.716746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ea033113-8c5e-41a0-8ae0-57514f7c3c0f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.720981 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:41.731242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:41.752135 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2c214ff-5ff7-4095-b69a-78ee5634aa93 None None] Pushing event updated for resources: {'Port': ['ID=b8942d74-9850-47eb-b0f5-9b71b1e66422,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:41.869310 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Provisioning complete for port a82c384c-f726-438d-a897-56a72f312f4a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:41.869944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.889388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Attempting to bind port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:41.889789 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Attempting to bind port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '32df60c7-bd5d-4255-99ac-f954bb095ea6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:41.890873 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Attempting to bind port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 on network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:41.892414 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 968ad944-9269-4599-a638-73d9c25aedbf no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:41.952734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.955782 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:41.956203 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Checking segment: {'id': '32df60c7-bd5d-4255-99ac-f954bb095ea6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:41.956615 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.957022 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Bound using segment: {'id': '32df60c7-bd5d-4255-99ac-f954bb095ea6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:41.957542 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Bound port: 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '32df60c7-bd5d-4255-99ac-f954bb095ea6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:41.958020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:41.970703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 968ad944-9269-4599-a638-73d9c25aedbf {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:41.970703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 968ad944-9269-4599-a638-73d9c25aedbf not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:41.973046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Allocated IP 172.21.0.2 (5dc6676b-2ea0-4f66-8344-f1b50cefe135/c9398767-cec9-48fd-bdd3-815a3b0bab44/8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:41.997912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.018532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=8c0ec7f3-de0e-4f34-a74d-075932c3f070,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:42.019382 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No DVR routers for this DVR port b8942d74-9850-47eb-b0f5-9b71b1e66422 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:42.024128 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Pushing event updated for resources: {'Port': ['ID=4fb240d1-b7b1-4215-bb8c-7e0a4ba97718,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:42.123754 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=b8942d74-9850-47eb-b0f5-9b71b1e66422,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:42.193122 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ea033113-8c5e-41a0-8ae0-57514f7c3c0f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.246927 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7e2c0168-99c0-451f-b813-4d00d9e18c39 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:42.260922 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-ea033113-8c5e-41a0-8ae0-57514f7c3c0f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 23fa6c92-49fd-413d-80d1-47d83bdfcfb9 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:42.346607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.350094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.365055 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Deleting port 38e260e9-807c-4880-8a64-0f9cfc851c73 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:42.365395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.405898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] For port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:42.455277 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] For port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=4fb240d1-b7b1-4215-bb8c-7e0a4ba97718,segment=NetworkSegment(32df60c7-bd5d-4255-99ac-f954bb095ea6),segment_id=32df60c7-bd5d-4255-99ac-f954bb095ea6)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:42.467353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3d97021c-8887-4ba8-9c45-2423b0852bc5']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:42.478302 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Provisioning complete for port 23fa6c92-49fd-413d-80d1-47d83bdfcfb9 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:42.478680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.481156 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.486319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '11eecb57-fb6d-4bc2-b732-a14c8518fce6') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:42.486592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '11eecb57-fb6d-4bc2-b732-a14c8518fce6') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:42.526297 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.584533 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 7e2c0168-99c0-451f-b813-4d00d9e18c39 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:42.584929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.590173 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.592779 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.593088 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.600560 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.20.0.1 (96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5/57c9ba11-01e5-45c5-9332-cfdfee1d754c/f55da04d-5c9e-4189-9d05-bc4cd78af281) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:42.614858 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Calling delete_port for 38e260e9-807c-4880-8a64-0f9cfc851c73 owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:42.639849 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.644880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Port 23fa6c92-49fd-413d-80d1-47d83bdfcfb9 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:42.685444 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Could not find standard attr ID for object 5275a0b6-ac28-4845-829d-0c28ba93c2ad. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:42.703464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:42.707836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90953606-2172-4c30-9b6e-4371742ee51c None None] Pushing event updated for resources: {'Port': ['ID=4fb240d1-b7b1-4215-bb8c-7e0a4ba97718,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:42.713855 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ea033113-8c5e-41a0-8ae0-57514f7c3c0f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.719037 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.722620 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:42.724214 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:42.767775 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Provisioning complete for port 7e2c0168-99c0-451f-b813-4d00d9e18c39 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:42.768159 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.774618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:42.775542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Releasing vlan 379 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:42.775954 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:42.779343 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:42.781864 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea033113-8c5e-41a0-8ae0-57514f7c3c0f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=23fa6c92-49fd-413d-80d1-47d83bdfcfb9,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:42.788070 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ea033113-8c5e-41a0-8ae0-57514f7c3c0f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.795066 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ea033113-8c5e-41a0-8ae0-57514f7c3c0f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/23fa6c92-49fd-413d-80d1-47d83bdfcfb9 HTTP/1.1" status: 204 len: 168 time: 1.3993785 Dec 10 14:29:42.799340 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57918) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:42.926554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7976ef9-c932-4cb3-b9df-60b6b996ce6e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:42.929454 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7976ef9-c932-4cb3-b9df-60b6b996ce6e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:42.929962 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e7976ef9-c932-4cb3-b9df-60b6b996ce6e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1286683 Dec 10 14:29:42.933147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:42.934534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57922) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:43.025002 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e42ac50-8b42-48fb-92c2-5ec11ae9454b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet aa8f6eca-77cd-4b2a-abe0-47af4532c196 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:43.033854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7e42ac50-8b42-48fb-92c2-5ec11ae9454b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.061040 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:43.075029 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57924) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:43.081706 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8ba97b18-2275-48ee-a1a0-cf44ee4077f7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5153480 Dec 10 14:29:43.090960 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.097032 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.102498 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/networks/3d97021c-8887-4ba8-9c45-2423b0852bc5 HTTP/1.1" status: 204 len: 168 time: 2.3378778 Dec 10 14:29:43.112242 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57926) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:43.112846 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:43.118036 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-2130462082'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:43.136769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7e42ac50-8b42-48fb-92c2-5ec11ae9454b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.156400 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-790c7715-bc0e-4094-959c-0495f4f87197 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Network': ['ID=3d97021c-8887-4ba8-9c45-2423b0852bc5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:43.219905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:43.220537 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:43.224586 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Pushing event updated for resources: {'Port': ['ID=8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:43.245400 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-6d82ae16-2d7a-4c97-b099-4bad9cf012b8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting subnet a6cd01ad-5324-4b95-8569-d765ef925d22 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:43.249892 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d82ae16-2d7a-4c97-b099-4bad9cf012b8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.255309 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:43.257763 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7e42ac50-8b42-48fb-92c2-5ec11ae9454b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.259131 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.289650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] vlan segment allocate from pool success with {'vlan_id': 377, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:29:43.291289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.300244 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.300862 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Added segment 3ba2753c-a063-4477-be40-7f77ed730510 of type vlan for network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 Dec 10 14:29:43.314695 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.348182 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:43.352632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.360796 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.381311 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d82ae16-2d7a-4c97-b099-4bad9cf012b8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.401703 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event deleted for resources: {'Port': ['ID=38e260e9-807c-4880-8a64-0f9cfc851c73,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:43.406747 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Attempting to bind port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:43.406747 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Attempting to bind port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '97a96e15-5d5f-4994-a371-e42623166e47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '5dc6676b-2ea0-4f66-8344-f1b50cefe135'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:43.407062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Attempting to bind port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db on network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:43.417617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:43.419246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:41Z', 'revision_number': 11, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:43.421925 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=f55da04d-5c9e-4189-9d05-bc4cd78af281,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:43.431005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:43.439929 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:43.449930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:43.463665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:43.463665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Checking segment: {'id': '97a96e15-5d5f-4994-a371-e42623166e47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '5dc6676b-2ea0-4f66-8344-f1b50cefe135'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:43.463665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.463665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Bound using segment: {'id': '97a96e15-5d5f-4994-a371-e42623166e47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '5dc6676b-2ea0-4f66-8344-f1b50cefe135'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:43.463665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Bound port: 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '97a96e15-5d5f-4994-a371-e42623166e47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': '5dc6676b-2ea0-4f66-8344-f1b50cefe135'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:43.463665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.481704 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.482210 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Floating IP c31794c0-9085-409e-a56d-0bcda9bb0856 disassociated (deleted). External IP: 172.26.2.28, port: 2648b8af-c0bf-4811-b353-779f2426f8b8. Dec 10 14:29:43.486313 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 7e2c0168-99c0-451f-b813-4d00d9e18c39, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7e2c0168-99c0-451f-b813-4d00d9e18c39,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:43.487807 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:43.488429 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:43.529137 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.538507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.545986 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:43.547440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.573770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7e42ac50-8b42-48fb-92c2-5ec11ae9454b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.584655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d82ae16-2d7a-4c97-b099-4bad9cf012b8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.599835 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.616196 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:43.667022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e42ac50-8b42-48fb-92c2-5ec11ae9454b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=aa8f6eca-77cd-4b2a-abe0-47af4532c196,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:43.671026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7e42ac50-8b42-48fb-92c2-5ec11ae9454b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.674603 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7e42ac50-8b42-48fb-92c2-5ec11ae9454b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/aa8f6eca-77cd-4b2a-abe0-47af4532c196 HTTP/1.1" status: 204 len: 168 time: 0.7387989 Dec 10 14:29:43.678130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57928) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:43.708753 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Network': ['ID=6982e3bb-2870-47ed-a8be-b1e2c31f4490,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:43.719388 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f674e94f-dab7-434a-bd6f-969d5ddadf68 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6034150 Dec 10 14:29:43.720744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57930) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:43.729274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '6982e3bb-2870-47ed-a8be-b1e2c31f4490', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:43.731828 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f7fd64b6-8a35-4c75-89f0-776df64ee4ff tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0511141 Dec 10 14:29:43.737021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57932) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:43.747006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:43.761650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27988757-a1aa-4999-bed3-9a108472e538 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:43.761650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 131d1bed-da3a-4c72-b20d-dee3f741a0e2 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:43.797611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:29:43.800330 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.810553 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 131d1bed-da3a-4c72-b20d-dee3f741a0e2 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:43.810896 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 131d1bed-da3a-4c72-b20d-dee3f741a0e2 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:43.811308 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b8942d74-9850-47eb-b0f5-9b71b1e66422 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:43.813039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:41Z', 'revision_number': 11, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:43.865412 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d82ae16-2d7a-4c97-b099-4bad9cf012b8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.912890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.917786 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d82ae16-2d7a-4c97-b099-4bad9cf012b8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Subnet': ['ID=a6cd01ad-5324-4b95-8569-d765ef925d22,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:43.938192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6d82ae16-2d7a-4c97-b099-4bad9cf012b8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:43.941317 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] For port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:43.944836 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6d82ae16-2d7a-4c97-b099-4bad9cf012b8 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/a6cd01ad-5324-4b95-8569-d765ef925d22 HTTP/1.1" status: 204 len: 168 time: 0.8673606 Dec 10 14:29:43.954097 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23d59c45-d244-4c45-a43f-e36d02eaac4f None None] Network 5fd1a66e-713e-4c71-b668-f7e44677057e requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:43.954097 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-937f1320-ca3a-439c-8539-1e4074f375fc None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:41Z', 'revision_number': 11, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:43.957931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: b8942d74-9850-47eb-b0f5-9b71b1e66422 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:43.957931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b8942d74-9850-47eb-b0f5-9b71b1e66422 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:43.958174 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57934) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:44.027354 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] For port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db,segment=NetworkSegment(97a96e15-5d5f-4994-a371-e42623166e47),segment_id=97a96e15-5d5f-4994-a371-e42623166e47)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:44.038989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:44.047177 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.109585 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=7e2c0168-99c0-451f-b813-4d00d9e18c39,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:44.161150 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Router bd5934f5-df99-4165-8014-b21160f71cfb has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:44.163483 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.164478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.170125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:44.174148 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.215779 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ff1fd8a-9ab1-4a8e-b90e-402a5868dcbd None None] Network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:44.285778 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:29:44.286106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-9c9fbed2-0d20-45d3-a2e1-263e0a9c51f7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:29:44.350028 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85bf603c-404c-4993-b616-6c4fa4345e84 None None] Pushing event updated for resources: {'Port': ['ID=8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:44.408031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Deleting port 802469f5-fbdb-410b-a9f9-5fd999bc15ad {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:44.408831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.455889 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd89c13b-eb5a-4af6-866b-d791fd5ed60d None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:44.548899 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:44.563827 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] Sync routers for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:44.569630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.593316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] DHCP port deletion for 5fd1a66e-713e-4c71-b668-f7e44677057e request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:44.603479 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:44.604135 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:44.606540 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1d7846f1-1e4e-46fd-b2d6-ff617eae1d43 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "DELETE /v2.0/floatingips/c31794c0-9085-409e-a56d-0bcda9bb0856 HTTP/1.1" status: 204 len: 168 time: 3.2633488 Dec 10 14:29:44.611021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:29:44.614013 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b0981163-f390-41a9-a1f2-e610aedda10e" -d '{"events": [{"name": "network-changed", "server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:29:44.667018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] For port 802469f5-fbdb-410b-a9f9-5fd999bc15ad, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=802469f5-fbdb-410b-a9f9-5fd999bc15ad,segment=NetworkSegment(d736d6f7-8b9d-47f6-8b67-dc23f9e2f057),segment_id=d736d6f7-8b9d-47f6-8b67-dc23f9e2f057)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:44.672540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.790638 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:44.791511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.793497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Calling delete_port for 802469f5-fbdb-410b-a9f9-5fd999bc15ad owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:44.859982 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:44.896512 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.944033 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.959965 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:44.969632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:44.974308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:44.975047 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:44.992796 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=c083f621-b958-4f89-91b9-35eb3797afdf,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:45.032911 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:45.081719 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-bd89c13b-eb5a-4af6-866b-d791fd5ed60d None None] Deleting port a82c384c-f726-438d-a897-56a72f312f4a {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:45.082100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bd89c13b-eb5a-4af6-866b-d791fd5ed60d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:45.109529 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:45.109908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:45.117848 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-981c00d3-fcd4-4ad3-bd09-01f7744cd3a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.3733029 Dec 10 14:29:45.141036 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57944) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:45.170536 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c5648c1b-53d1-4f8a-870c-95475c4c0287 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': 'c083f621-b958-4f89-91b9-35eb3797afdf', 'ip_address': '2001:db8:0:1::5'}], 'name': 'tempest-NetworksTestDHCPv6-1405933057'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:45.189079 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:45.193913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=f55da04d-5c9e-4189-9d05-bc4cd78af281,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:45.223655 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:35Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '1aa93550-1de5-47ad-9798-720589f428cb', 'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'mac_address': 'fa:16:3e:ad:c9:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 746, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:31Z', 'updated_at': '2021-12-10T14:27:42Z', 'revision_number': 5, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'subnets': [{'id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:45.261259 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] Checking router: bd5934f5-df99-4165-8014-b21160f71cfb for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:45.283945 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:45.286134 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:45.452494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:45.457140 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:45.460955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:45.544710 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:45.574236 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] Deleting port 802469f5-fbdb-410b-a9f9-5fd999bc15ad {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:45.574843 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:45.609284 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Provisioning complete for port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:45.609682 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:45.639365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Port': ['ID=802469f5-fbdb-410b-a9f9-5fd999bc15ad,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:45.659738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0981163-f390-41a9-a1f2-e610aedda10e req-5996595c-360d-4369-851a-caeff11e364a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:45.661857 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b0981163-f390-41a9-a1f2-e610aedda10e req-5996595c-360d-4369-851a-caeff11e364a service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=37199cbe89a04c3096fd8e1d31a3df63&device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 1099 time: 0.2489181 Dec 10 14:29:45.670978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No DVR routers for this DVR port 802469f5-fbdb-410b-a9f9-5fd999bc15ad on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:45.885363 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:35Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '1aa93550-1de5-47ad-9798-720589f428cb', 'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'mac_address': 'fa:16:3e:ad:c9:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 746, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:31Z', 'updated_at': '2021-12-10T14:27:42Z', 'revision_number': 5, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'subnets': [{'id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:45.898426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-bd89c13b-eb5a-4af6-866b-d791fd5ed60d None None] For port a82c384c-f726-438d-a897-56a72f312f4a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a82c384c-f726-438d-a897-56a72f312f4a,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:45.899582 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:29:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb112839-aef2-4855-b532-dc4883782730 x-openstack-request-id: req-fb112839-aef2-4855-b532-dc4883782730 {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:29:45.900057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:29:45.900297 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-fb112839-aef2-4855-b532-dc4883782730 {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:29:45.901836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bd89c13b-eb5a-4af6-866b-d791fd5ed60d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:45.905065 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'status': 'completed', 'code': 200} Dec 10 14:29:45.907816 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] For port 802469f5-fbdb-410b-a9f9-5fd999bc15ad, host dv-neutron-821401-2-hyperv, got binding levels [] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:45.909890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:45.929904 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f810eb8f-7824-4559-a303-27361b2e7700 None None] The sync data for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv is: [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:27:35Z', 'revision_number': 4, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '1aa93550-1de5-47ad-9798-720589f428cb', 'name': '', 'network_id': '6ba405b9-cdef-4b06-9661-6ad5871b3c6b', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'mac_address': 'fa:16:3e:ad:c9:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 746, 'fixed_ips': [{'subnet_id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:31Z', 'updated_at': '2021-12-10T14:27:42Z', 'revision_number': 5, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'subnets': [{'id': '0f3ba970-7746-4f0a-8fc3-e64be22456c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:45.944299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] Calling delete_port for 802469f5-fbdb-410b-a9f9-5fd999bc15ad owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:45.948314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.ipam_backend_mixin [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] Port 802469f5-fbdb-410b-a9f9-5fd999bc15ad was not found and therefore no delete operation was performed {{(pid=103812) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 10 14:29:45.962887 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-bd89c13b-eb5a-4af6-866b-d791fd5ed60d None None] Calling delete_port for a82c384c-f726-438d-a897-56a72f312f4a owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:45.999860 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Checking segment: {'id': '3ba2753c-a063-4477-be40-7f77ed730510', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': '6982e3bb-2870-47ed-a8be-b1e2c31f4490'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:46.000227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network hostable DHCP agents. Network: 6982e3bb-2870-47ed-a8be-b1e2c31f4490, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:29:46.003438 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=d6c1a1b5-c637-472c-8aa6-1c82a185f10f,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:46.046161 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.048739 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.110212 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-577a9191-73e7-4a14-ae9b-ea2accde6e1a None None] Network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:46.116605 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] No DVR routers for this DVR port 802469f5-fbdb-410b-a9f9-5fd999bc15ad on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:46.158950 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bd89c13b-eb5a-4af6-866b-d791fd5ed60d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.163642 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d18581-b8c4-4441-a505-2f949081706e None None] Pushing event deleted for resources: {'Port': ['ID=802469f5-fbdb-410b-a9f9-5fd999bc15ad,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:46.169878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb3deb2b-75f3-4df2-832b-3d98906abcd5 req-7eb90d33-5018-404f-a7e8-4f160ceae139 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:46.171490 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cb3deb2b-75f3-4df2-832b-3d98906abcd5 req-7eb90d33-5018-404f-a7e8-4f160ceae139 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.2598763 Dec 10 14:29:46.192648 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.204346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.219684 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=4fb240d1-b7b1-4215-bb8c-7e0a4ba97718,segment=NetworkSegment(32df60c7-bd5d-4255-99ac-f954bb095ea6),segment_id=32df60c7-bd5d-4255-99ac-f954bb095ea6)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:46.243454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:29:46.252860 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cb3deb2b-75f3-4df2-832b-3d98906abcd5 req-eb976ddc-2c2e-468a-afd5-415a3b6cac98 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0692441 Dec 10 14:29:46.268257 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5648c1b-53d1-4f8a-870c-95475c4c0287 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:46.275901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd89c13b-eb5a-4af6-866b-d791fd5ed60d None None] No DVR routers for this DVR port a82c384c-f726-438d-a897-56a72f312f4a on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:46.275901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd89c13b-eb5a-4af6-866b-d791fd5ed60d None None] Pushing event deleted for resources: {'Port': ['ID=a82c384c-f726-438d-a897-56a72f312f4a,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:46.306635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5fd1a66e-713e-4c71-b668-f7e44677057e']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:46.321534 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8eb553d-4b6b-4369-b2f0-3b44fdc76d6f None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:46.345903 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:46.346284 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd736d6f7-8b9d-47f6-8b67-dc23f9e2f057') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:46.368874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.374537 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.381410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c5648c1b-53d1-4f8a-870c-95475c4c0287 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.385653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 6982e3bb-2870-47ed-a8be-b1e2c31f4490) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:46.399953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:46.400864 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.403015 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0981163-f390-41a9-a1f2-e610aedda10e req-d9fa28be-54b7-40d5-9c17-e9afea461e1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:46.405149 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b0981163-f390-41a9-a1f2-e610aedda10e req-d9fa28be-54b7-40d5-9c17-e9afea461e1d service neutron] 10.222.0.39 "GET /v2.0/networks?id=6ba405b9-cdef-4b06-9661-6ad5871b3c6b HTTP/1.1" status: 200 len: 897 time: 0.7291100 Dec 10 14:29:46.407093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.414814 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Releasing vlan 362 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:29:46.415240 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.417318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-c5648c1b-53d1-4f8a-870c-95475c4c0287 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port c1a05b8c-2035-40cb-8bc1-32682845ba31 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:29:46.419782 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:29:46.460764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=4fb240d1-b7b1-4215-bb8c-7e0a4ba97718,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:46.460901 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b0981163-f390-41a9-a1f2-e610aedda10e req-1585cd8d-93e9-4454-9db9-1b2356e4ce2d service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2648b8af-c0bf-4811-b353-779f2426f8b8 HTTP/1.1" status: 200 len: 217 time: 0.0400839 Dec 10 14:29:46.463886 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ad1be54-390c-4757-98fd-c1f8798cf94a None None] Network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:46.468379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eebd73cd-625d-494f-b862-87b73b5bdab1 None None] New status for floating IP c31794c0-9085-409e-a56d-0bcda9bb0856: DOWN {{(pid=103812) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:29:46.482143 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router d18cfd99-e8a8-404e-ba1d-7e6297383bb5 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:29:46.548198 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f74590f2-6208-4bb2-ac29-f6678905b59c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.8261251 Dec 10 14:29:46.552113 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57948) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:46.556478 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-b56b167e-44aa-4339-80a6-c46132e5c235 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'router': {'name': 'tempest-PortsIpV6TestJSON-router-35318482', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:46.605021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0981163-f390-41a9-a1f2-e610aedda10e req-78e98adf-342f-4aca-b238-a3786ba3f0a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:46.606755 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b0981163-f390-41a9-a1f2-e610aedda10e req-78e98adf-342f-4aca-b238-a3786ba3f0a2 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=0f3ba970-7746-4f0a-8fc3-e64be22456c1 HTTP/1.1" status: 200 len: 834 time: 0.1331542 Dec 10 14:29:46.648512 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-c5648c1b-53d1-4f8a-870c-95475c4c0287 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:29:46.649185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c5648c1b-53d1-4f8a-870c-95475c4c0287 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:46.652344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7e2c0168-99c0-451f-b813-4d00d9e18c39 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:46.656837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:29:46.656837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:29:46.679083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b56b167e-44aa-4339-80a6-c46132e5c235 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.681437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b56b167e-44aa-4339-80a6-c46132e5c235 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.724214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.730838 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': 'c083f621-b958-4f89-91b9-35eb3797afdf'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:46.731770 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.737074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.743750 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/networks/5fd1a66e-713e-4c71-b668-f7e44677057e HTTP/1.1" status: 204 len: 168 time: 2.7856774 Dec 10 14:29:46.750955 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57950) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:46.757103 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'routes': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:46.765277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5ff178f-2760-49be-a512-e49b894348b2 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Pushing event deleted for resources: {'Network': ['ID=5fd1a66e-713e-4c71-b668-f7e44677057e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:46.776750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:46.786041 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cf4e9eb7-f3a1-4d97-a12f-fcb024cb3ad6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/d18cfd99-e8a8-404e-ba1d-7e6297383bb5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2489574 Dec 10 14:29:46.788743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57952) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:46.792751 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7b9f22c-7a53-438b-b67e-07b357e9606d None None] Sync routers for ids ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:46.804924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0981163-f390-41a9-a1f2-e610aedda10e req-59cb688c-541b-49c3-a4db-c178b8c06b6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:46.804924 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b0981163-f390-41a9-a1f2-e610aedda10e req-59cb688c-541b-49c3-a4db-c178b8c06b6e service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=6ba405b9-cdef-4b06-9661-6ad5871b3c6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1374075 Dec 10 14:29:46.808830 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7b9f22c-7a53-438b-b67e-07b357e9606d None None] Routers {'d18cfd99-e8a8-404e-ba1d-7e6297383bb5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:46.809519 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a7b9f22c-7a53-438b-b67e-07b357e9606d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:46.849707 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b56b167e-44aa-4339-80a6-c46132e5c235 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.851086 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a7b9f22c-7a53-438b-b67e-07b357e9606d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:46.858318 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c5648c1b-53d1-4f8a-870c-95475c4c0287 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 400 len: 350 time: 1.7080722 Dec 10 14:29:46.861013 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57954) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:46.872652 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7b9f22c-7a53-438b-b67e-07b357e9606d None None] Routers {'d18cfd99-e8a8-404e-ba1d-7e6297383bb5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:46.873274 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a7b9f22c-7a53-438b-b67e-07b357e9606d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:46.879085 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-9c29de53-0c92-48f3-9b5d-8cd271bafa76 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:46.880075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-6982e3bb-2870-47ed-a8be-b1e2c31f4490', 'network_id': '6982e3bb-2870-47ed-a8be-b1e2c31f4490', 'project_id': 'cc793beea85f4cf887a3485aad20d8e7', 'fixed_ips': [{'subnet_id': 'd6c1a1b5-c637-472c-8aa6-1c82a185f10f'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:29:46.880939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.881677 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-9c29de53-0c92-48f3-9b5d-8cd271bafa76 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.39 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.1949229 Dec 10 14:29:46.915409 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 7e2c0168-99c0-451f-b813-4d00d9e18c39 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:46.915784 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:46.938657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c38b7932-3599-4a3e-a773-48dab73f948f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:46.945479 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c38b7932-3599-4a3e-a773-48dab73f948f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports/f55da04d-5c9e-4189-9d05-bc4cd78af281 HTTP/1.1" status: 200 len: 910 time: 0.1508493 Dec 10 14:29:46.945913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57956) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:46.968477 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-a7b9f22c-7a53-438b-b67e-07b357e9606d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:46.969161 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7b9f22c-7a53-438b-b67e-07b357e9606d None None] The sync data for ids ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:46.986493 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bdd5207b-013d-47c8-880c-abb6dd59fd88 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.1249657 Dec 10 14:29:46.988412 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b56b167e-44aa-4339-80a6-c46132e5c235 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.001521 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57958) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:47.033171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/c083f621-b958-4f89-91b9-35eb3797afdf/ff2510f2-1fbc-421d-9e12-5288c583fecd) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:47.076754 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b0981163-f390-41a9-a1f2-e610aedda10e req-c0c82d0e-1830-4c22-ac6d-3ff22e852ea2 service neutron] 10.222.0.39 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2424657 Dec 10 14:29:47.172593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Added routes are [] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 10 14:29:47.172946 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Removed routes are [] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 10 14:29:47.173311 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.179351 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b56b167e-44aa-4339-80a6-c46132e5c235 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.183388 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b56b167e-44aa-4339-80a6-c46132e5c235 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.6278210 Dec 10 14:29:47.186214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57960) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:47.198274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78f187d9-8286-4992-ae1b-65334f8f102b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:47.200052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78f187d9-8286-4992-ae1b-65334f8f102b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:47.204465 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-78f187d9-8286-4992-ae1b-65334f8f102b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1974554 Dec 10 14:29:47.218831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:47.223472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'network_id': '6982e3bb-2870-47ed-a8be-b1e2c31f4490', 'name': 'tempest-PortsIpV6TestJSON-638938902'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:47.234945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57962) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:47.326135 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Could not find standard attr ID for object 23fa6c92-49fd-413d-80d1-47d83bdfcfb9. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:47.345256 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Deleting port 2648b8af-c0bf-4811-b353-779f2426f8b8 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:47.345732 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.371303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Provisioning complete for port f55da04d-5c9e-4189-9d05-bc4cd78af281 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:47.371680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.388352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.394831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Allocated IP 2001:db8::2 (6982e3bb-2870-47ed-a8be-b1e2c31f4490/d6c1a1b5-c637-472c-8aa6-1c82a185f10f/86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:47.404267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-1835639f-94f0-4e5b-abd7-44069767e7b4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet c083f621-b958-4f89-91b9-35eb3797afdf {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:47.433452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.472160 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b0981163-f390-41a9-a1f2-e610aedda10e req-8272b414-9af9-4b30-9358-8aee5ad7273b service neutron] 10.222.0.39 "GET /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3848822 Dec 10 14:29:47.493573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:47.494050 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.530815 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Port f55da04d-5c9e-4189-9d05-bc4cd78af281 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:47.597194 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d5be32-47a0-49a8-bc7e-433d0634337b req-6229976a-c826-4bef-a259-c699576d43f1 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:47.598826 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-50d5be32-47a0-49a8-bc7e-433d0634337b req-6229976a-c826-4bef-a259-c699576d43f1 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 946 time: 0.1768734 Dec 10 14:29:47.600865 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 84410bb0-960a-4ef0-a5c1-72cde49aba0f has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:47.608588 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] For port 2648b8af-c0bf-4811-b353-779f2426f8b8, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=2648b8af-c0bf-4811-b353-779f2426f8b8,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:47.608957 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.643424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Calling delete_port for 2648b8af-c0bf-4811-b353-779f2426f8b8 owned by compute:nova {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:47.650312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.664090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:47.668566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.723394 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 34d16eef-e5fa-493b-9888-8144de93f8d3 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:29:47.746270 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ea36e8b8-09e9-4c74-be4f-1fa874d31c7e None None] Could not find standard attr ID for object e55e62e8-cc60-4757-af52-ffb7a7428ba1. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:29:47.754369 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.783411 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-50d5be32-47a0-49a8-bc7e-433d0634337b req-5ee7ab54-615b-4181-82c0-35c0e8b2e5fd tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/security-groups?id=3c07f7e7-ccab-408a-a625-67551419384e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1779447 Dec 10 14:29:47.787637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:47.797437 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.803961 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0152ead3-2c99-4e15-a8f1-77294d41eb72 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f HTTP/1.1" status: 200 len: 703 time: 1.0507157 Dec 10 14:29:47.804656 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57968) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:47.823522 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1835639f-94f0-4e5b-abd7-44069767e7b4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.826209 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] Sync routers for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:47.850171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.850466 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f05a6d5b-f12d-496b-b48e-92eff0ebd86d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=84410bb0-960a-4ef0-a5c1-72cde49aba0f HTTP/1.1" status: 200 len: 205 time: 0.0406423 Dec 10 14:29:47.850466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57970) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:47.885893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1835639f-94f0-4e5b-abd7-44069767e7b4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.904452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] Routers {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:47.905109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:47.917268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:47.951018 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-896fe53b-39eb-481c-9acd-82bcca546eac tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:47.979238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:47.981615 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:47.991460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.060719 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] Set router 84410bb0-960a-4ef0-a5c1-72cde49aba0f gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:48.101764 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1835639f-94f0-4e5b-abd7-44069767e7b4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.104658 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Pushing event updated for resources: {'Port': ['ID=ff2510f2-1fbc-421d-9e12-5288c583fecd,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:48.149610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2aba7727-a6f7-4a0c-8861-af1b583d8634 None None] Provisioning complete for port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:48.149610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2aba7727-a6f7-4a0c-8861-af1b583d8634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.151822 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.158041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-896fe53b-39eb-481c-9acd-82bcca546eac tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.162501 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-896fe53b-39eb-481c-9acd-82bcca546eac tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.169960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.21.0.1 (5dc6676b-2ea0-4f66-8344-f1b50cefe135/c9398767-cec9-48fd-bdd3-815a3b0bab44/2335d3fd-898d-47ad-a539-3d3ef14c50ea) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:48.188612 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84410bb0-960a-4ef0-a5c1-72cde49aba0f', 'name': 'tempest-RoutersIpV6Test-router-34013149', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:28:32Z', 'updated_at': '2021-12-10T14:29:41Z', 'revision_number': 11, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:48.246157 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] Checking router: 84410bb0-960a-4ef0-a5c1-72cde49aba0f for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:48.256180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.258018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Attempting to bind port ff2510f2-1fbc-421d-9e12-5288c583fecd on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:48.258385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Attempting to bind port ff2510f2-1fbc-421d-9e12-5288c583fecd by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:48.258747 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Attempting to bind port ff2510f2-1fbc-421d-9e12-5288c583fecd on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:48.261820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db,segment=NetworkSegment(97a96e15-5d5f-4994-a371-e42623166e47),segment_id=97a96e15-5d5f-4994-a371-e42623166e47)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:48.275627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.282363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-896fe53b-39eb-481c-9acd-82bcca546eac tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.285185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-896fe53b-39eb-481c-9acd-82bcca546eac tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Fanout notify agent at l3_agent the message router_deleted on router 84410bb0-960a-4ef0-a5c1-72cde49aba0f {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:29:48.285316 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1835639f-94f0-4e5b-abd7-44069767e7b4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.292097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-896fe53b-39eb-481c-9acd-82bcca546eac tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.297924 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-896fe53b-39eb-481c-9acd-82bcca546eac tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f HTTP/1.1" status: 204 len: 168 time: 0.4435678 Dec 10 14:29:48.303700 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57972) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:48.311376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:48.316443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:48.316443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.316443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:48.316443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Bound port: ff2510f2-1fbc-421d-9e12-5288c583fecd, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:48.316443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.316974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b642aa94-80bf-4f6c-8b14-c834215f3592 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-626047888', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:48.326919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event deleted for resources: {'Port': ['ID=2648b8af-c0bf-4811-b353-779f2426f8b8,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:48.342156 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] Routers set() bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:48.342156 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] Router IDs set() for agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 10 14:29:48.342377 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1835639f-94f0-4e5b-abd7-44069767e7b4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.342476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_agentschedulers_db [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'84410bb0-960a-4ef0-a5c1-72cde49aba0f'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent'). {{(pid=103812) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 10 14:29:48.342476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0be543a5-6b33-4794-b270-5fd053daa19c None None] The sync data for ids ['84410bb0-960a-4ef0-a5c1-72cde49aba0f'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:48.344597 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1835639f-94f0-4e5b-abd7-44069767e7b4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/c083f621-b958-4f89-91b9-35eb3797afdf HTTP/1.1" status: 204 len: 168 time: 1.1086774 Dec 10 14:29:48.349552 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:48.351984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57974) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:48.355840 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:48.364227 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1835639f-94f0-4e5b-abd7-44069767e7b4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=c083f621-b958-4f89-91b9-35eb3797afdf,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:48.402067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.402249 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:48.408742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] No DVR routers for this DVR port 2648b8af-c0bf-4811-b353-779f2426f8b8 on host hv-neutron-8214 {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:48.412474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.416412 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c96b2073-3d54-48f1-a6f6-224deed2c904 req-94a84ed3-22ac-40fa-9e38-2e7d6f0cbdca tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.39 "DELETE /v2.0/ports/2648b8af-c0bf-4811-b353-779f2426f8b8 HTTP/1.1" status: 204 len: 173 time: 1.4922009 Dec 10 14:29:48.417364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'name': 'network-vif-deleted', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:29:48.419854 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2a01a08f-ce08-4a9c-a50e-f24b188bad5a" -d '{"events": [{"server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "name": "network-vif-deleted", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:29:48.427216 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Pushing event updated for resources: {'Port': ['ID=86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:48.463208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::32f (6982e3bb-2870-47ed-a8be-b1e2c31f4490/d6c1a1b5-c637-472c-8aa6-1c82a185f10f/34d16eef-e5fa-493b-9888-8144de93f8d3) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:48.482040 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ea751dd5-8263-4e57-9ab8-f03c2b571de5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1231010 Dec 10 14:29:48.488016 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:29:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-220e01a1-2753-4bdc-b336-dc987bb04d72 x-openstack-request-id: req-220e01a1-2753-4bdc-b336-dc987bb04d72 {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:29:48.488321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b14e48a8-a7b7-4234-a1ef-653a56547a10", "name": "network-vif-deleted", "tag": "2648b8af-c0bf-4811-b353-779f2426f8b8", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:29:48.488574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-220e01a1-2753-4bdc-b336-dc987bb04d72 {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:29:48.488984 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b14e48a8-a7b7-4234-a1ef-653a56547a10', 'name': 'network-vif-deleted', 'tag': '2648b8af-c0bf-4811-b353-779f2426f8b8', 'status': 'completed', 'code': 200} Dec 10 14:29:48.489406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57978) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:48.499823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:48.542543 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:48.552252 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a82c384c-f726-438d-a897-56a72f312f4a no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:48.574360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2aba7727-a6f7-4a0c-8861-af1b583d8634 None None] Provisioning complete for port f55da04d-5c9e-4189-9d05-bc4cd78af281 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:48.574630 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2aba7727-a6f7-4a0c-8861-af1b583d8634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.584370 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: a82c384c-f726-438d-a897-56a72f312f4a {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:48.584717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a82c384c-f726-438d-a897-56a72f312f4a not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:48.585147 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8c0ec7f3-de0e-4f34-a74d-075932c3f070 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:48.596160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b642aa94-80bf-4f6c-8b14-c834215f3592 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.597226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b642aa94-80bf-4f6c-8b14-c834215f3592 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.669806 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:29:48.673471 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.675665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 8c0ec7f3-de0e-4f34-a74d-075932c3f070 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:48.679676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8c0ec7f3-de0e-4f34-a74d-075932c3f070 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:48.679676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 802469f5-fbdb-410b-a9f9-5fd999bc15ad no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:48.691838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.715299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 802469f5-fbdb-410b-a9f9-5fd999bc15ad {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:48.716307 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 802469f5-fbdb-410b-a9f9-5fd999bc15ad not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:48.717335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2aba7727-a6f7-4a0c-8861-af1b583d8634 None None] Port f55da04d-5c9e-4189-9d05-bc4cd78af281 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:48.729060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] For port ff2510f2-1fbc-421d-9e12-5288c583fecd, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:48.734138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Attempting to bind port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:48.734519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Attempting to bind port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '3ba2753c-a063-4477-be40-7f77ed730510', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': '6982e3bb-2870-47ed-a8be-b1e2c31f4490'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:48.734893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Attempting to bind port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c on network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:48.744865 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b642aa94-80bf-4f6c-8b14-c834215f3592 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.755255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] For port ff2510f2-1fbc-421d-9e12-5288c583fecd, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ff2510f2-1fbc-421d-9e12-5288c583fecd,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:48.756682 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:48.757110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Checking segment: {'id': '3ba2753c-a063-4477-be40-7f77ed730510', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': '6982e3bb-2870-47ed-a8be-b1e2c31f4490'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:48.757549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.757938 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Bound using segment: {'id': '3ba2753c-a063-4477-be40-7f77ed730510', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': '6982e3bb-2870-47ed-a8be-b1e2c31f4490'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:48.758433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Bound port: 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3ba2753c-a063-4477-be40-7f77ed730510', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': '6982e3bb-2870-47ed-a8be-b1e2c31f4490'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:48.758804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.819696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.833105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b642aa94-80bf-4f6c-8b14-c834215f3592 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.884421 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.913248 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:48.937854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:48.976842 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] For port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:49.008628 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:49.009772 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2fd441d4-a238-4593-9d86-0e265b267244 req-7a13cdc0-7438-4452-8400-a95e07cd9c22 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "GET /v2.0/ports?device_id=b14e48a8-a7b7-4234-a1ef-653a56547a10 HTTP/1.1" status: 200 len: 210 time: 0.0915589 Dec 10 14:29:49.010260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] For port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c,segment=NetworkSegment(3ba2753c-a063-4477-be40-7f77ed730510),segment_id=3ba2753c-a063-4477-be40-7f77ed730510)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:49.015410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.034105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:49.037300 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:49.055289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ace771-9947-4c99-9269-b29166da3b66 None None] Pushing event updated for resources: {'Port': ['ID=ff2510f2-1fbc-421d-9e12-5288c583fecd,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:49.071655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b642aa94-80bf-4f6c-8b14-c834215f3592 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.073877 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b642aa94-80bf-4f6c-8b14-c834215f3592 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.7648921 Dec 10 14:29:49.075712 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57982) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:49.075899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:49.081502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-b6ffdc73-f31a-4597-bb98-77b4f740deae tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Request body: {'router': {'admin_state_up': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:49.083994 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:49.084377 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.087886 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.088117 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=2335d3fd-898d-47ad-a539-3d3ef14c50ea,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:49.118401 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.128441 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:49.130935 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:49.137021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:49.137691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.178139 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.183099 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78138e8-2f72-4c4a-bca6-5933c472e78c None None] Pushing event updated for resources: {'Port': ['ID=86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:49.207555 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:49.228704 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:49.234031 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:49.234640 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.236537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=34d16eef-e5fa-493b-9888-8144de93f8d3,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:49.245170 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2ffadfcc-572d-4cec-8be7-17e3348fc287 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.0564413 Dec 10 14:29:49.251432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57984) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:49.285353 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eeee9440-0fd5-4538-891c-0c8e75ee1808 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:49.305117 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=0d48bc55-e0ba-4d31-986a-e5327256a5c6,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:49.390324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:49.443207 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-466cfd9a-b220-4723-9636-6f15cf7fd5d2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9496856 Dec 10 14:29:49.465227 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57988) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:49.470060 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d8e50482-ad4f-4f72-85d2-79fb84ceb70c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-528474408', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:49.477287 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b6ffdc73-f31a-4597-bb98-77b4f740deae tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.506279 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:49.506655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.509120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0fcaf156-3a96-4ba9-8d29-3a83a9076dee None None] Provisioning complete for port 2335d3fd-898d-47ad-a539-3d3ef14c50ea triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:49.509473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0fcaf156-3a96-4ba9-8d29-3a83a9076dee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.565928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b6ffdc73-f31a-4597-bb98-77b4f740deae tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.623061 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0fcaf156-3a96-4ba9-8d29-3a83a9076dee None None] Port 2335d3fd-898d-47ad-a539-3d3ef14c50ea cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:49.651172 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.680520 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d8e50482-ad4f-4f72-85d2-79fb84ceb70c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.681593 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d8e50482-ad4f-4f72-85d2-79fb84ceb70c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.722400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5c36d58-2f7a-4c4e-a51b-5a57a9ea7c17 None None] Update dhcp port {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': '0d48bc55-e0ba-4d31-986a-e5327256a5c6'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'ff2510f2-1fbc-421d-9e12-5288c583fecd'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:29:49.763993 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c5c36d58-2f7a-4c4e-a51b-5a57a9ea7c17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.810085 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b6ffdc73-f31a-4597-bb98-77b4f740deae tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Router 8ec127bf-0984-4885-8ea9-c25e02156e75 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:29:49.896828 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57990) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:49.948019 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6ffdc73-f31a-4597-bb98-77b4f740deae tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:49.957262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b6ffdc73-f31a-4597-bb98-77b4f740deae tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:49.958601 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b6ffdc73-f31a-4597-bb98-77b4f740deae tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "PUT /v2.0/routers/8ec127bf-0984-4885-8ea9-c25e02156e75 HTTP/1.1" status: 200 len: 697 time: 0.8816960 Dec 10 14:29:49.961526 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57992) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:49.966777 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] Sync routers for ids ['8ec127bf-0984-4885-8ea9-c25e02156e75'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:49.983483 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] Routers {'8ec127bf-0984-4885-8ea9-c25e02156e75'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:49.984520 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['8ec127bf-0984-4885-8ea9-c25e02156e75'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:50.117554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 57996) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:50.144127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-c5c36d58-2f7a-4c4e-a51b-5a57a9ea7c17 None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/0d48bc55-e0ba-4d31-986a-e5327256a5c6/ff2510f2-1fbc-421d-9e12-5288c583fecd) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:50.187966 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] Set router 8ec127bf-0984-4885-8ea9-c25e02156e75 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:50.232052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d8e50482-ad4f-4f72-85d2-79fb84ceb70c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:50.267851 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec127bf-0984-4885-8ea9-c25e02156e75', 'name': 'tempest-RoutersIpV6Test-router-626047888', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:29:48Z', 'updated_at': '2021-12-10T14:29:49Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:50.308591 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c5c36d58-2f7a-4c4e-a51b-5a57a9ea7c17 None None] For port ff2510f2-1fbc-421d-9e12-5288c583fecd, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ff2510f2-1fbc-421d-9e12-5288c583fecd,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:50.332950 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] Checking router: 8ec127bf-0984-4885-8ea9-c25e02156e75 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:50.343671 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] Routers {'8ec127bf-0984-4885-8ea9-c25e02156e75'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:50.344559 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['8ec127bf-0984-4885-8ea9-c25e02156e75'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:50.355321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d8e50482-ad4f-4f72-85d2-79fb84ceb70c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:50.388103 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c5c36d58-2f7a-4c4e-a51b-5a57a9ea7c17 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:50.429178 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] Set router 8ec127bf-0984-4885-8ea9-c25e02156e75 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:50.441852 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:50.446889 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c5c36d58-2f7a-4c4e-a51b-5a57a9ea7c17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:50.519579 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec127bf-0984-4885-8ea9-c25e02156e75', 'name': 'tempest-RoutersIpV6Test-router-626047888', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:29:48Z', 'updated_at': '2021-12-10T14:29:49Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:50.545040 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c36d58-2f7a-4c4e-a51b-5a57a9ea7c17 None None] Pushing event updated for resources: {'Port': ['ID=ff2510f2-1fbc-421d-9e12-5288c583fecd,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:50.547484 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d3358a73-ff90-46e6-b763-f3cda0d82520 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/routers/8ec127bf-0984-4885-8ea9-c25e02156e75 HTTP/1.1" status: 200 len: 703 time: 0.5851345 Dec 10 14:29:50.551045 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 57998) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:50.579897 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55b61d3-2ab1-4ef8-b761-2e288c0eab18 None None] The sync data for ids ['8ec127bf-0984-4885-8ea9-c25e02156e75'] in dv-neutron-821401-2-hyperv is: [{'id': '8ec127bf-0984-4885-8ea9-c25e02156e75', 'name': 'tempest-RoutersIpV6Test-router-626047888', 'tenant_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:29:48Z', 'updated_at': '2021-12-10T14:29:49Z', 'revision_number': 2, 'project_id': 'e0ad36cdee2c48fba74cb6486de7c888', 'gw_port_host': None}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:50.586993 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3bc3caba-e1d1-471d-a122-7603097ce5b7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=8ec127bf-0984-4885-8ea9-c25e02156e75 HTTP/1.1" status: 200 len: 205 time: 0.0312078 Dec 10 14:29:50.586993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58000) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:50.671081 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d8e50482-ad4f-4f72-85d2-79fb84ceb70c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:50.675778 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d8e50482-ad4f-4f72-85d2-79fb84ceb70c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 1.2065444 Dec 10 14:29:50.689025 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58002) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:50.718149 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-45a35016-4520-46b9-94b0-9317c6f67697 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:50.785253 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30285edc-bce8-479e-9c34-ae76329f26f3 None None] Network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:50.917814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-cd5ec873-5505-44ef-93f3-91f0f541fd2f None None] Provisioning complete for port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:50.918191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cd5ec873-5505-44ef-93f3-91f0f541fd2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.003808 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:51.126045 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-45a35016-4520-46b9-94b0-9317c6f67697 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.126721 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cd5ec873-5505-44ef-93f3-91f0f541fd2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.131068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-45a35016-4520-46b9-94b0-9317c6f67697 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.159011 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:51.159389 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.216950 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-cd5ec873-5505-44ef-93f3-91f0f541fd2f None None] For port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c,segment=NetworkSegment(3ba2753c-a063-4477-be40-7f77ed730510),segment_id=3ba2753c-a063-4477-be40-7f77ed730510)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:51.271365 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-45a35016-4520-46b9-94b0-9317c6f67697 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.272222 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-45a35016-4520-46b9-94b0-9317c6f67697 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Fanout notify agent at l3_agent the message router_deleted on router 8ec127bf-0984-4885-8ea9-c25e02156e75 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:29:51.281681 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-45a35016-4520-46b9-94b0-9317c6f67697 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.284182 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-45a35016-4520-46b9-94b0-9317c6f67697 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/8ec127bf-0984-4885-8ea9-c25e02156e75 HTTP/1.1" status: 204 len: 168 time: 0.6948836 Dec 10 14:29:51.294162 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58004) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.295047 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cd5ec873-5505-44ef-93f3-91f0f541fd2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.341172 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.350165 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f835ad83-39f6-4dd8-b3da-6e9c0fc87382 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=8ec127bf-0984-4885-8ea9-c25e02156e75 HTTP/1.1" status: 200 len: 205 time: 0.0516930 Dec 10 14:29:51.351334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58006) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.357981 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.399508 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-70efd60c-c50e-43b1-ba9a-8f25977f2696 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] delete failed (client error): The resource could not be found. Dec 10 14:29:51.402840 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-70efd60c-c50e-43b1-ba9a-8f25977f2696 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/8ec127bf-0984-4885-8ea9-c25e02156e75 HTTP/1.1" status: 404 len: 336 time: 0.0443666 Dec 10 14:29:51.403771 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58008) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.418664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd5ec873-5505-44ef-93f3-91f0f541fd2f None None] Pushing event updated for resources: {'Port': ['ID=86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:51.443427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.446076 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-b70674c5-96ce-41e1-baf2-949eafb71221 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:51.446548 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b70674c5-96ce-41e1-baf2-949eafb71221 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:51.446814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:29:51.447197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:29:51.452151 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b70674c5-96ce-41e1-baf2-949eafb71221 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/c0a6adbb-fcb5-45e3-859f-c62d695f545d HTTP/1.1" status: 404 len: 337 time: 0.0468888 Dec 10 14:29:51.456765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58010) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.474804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 2648b8af-c0bf-4811-b353-779f2426f8b8 no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:51.499427 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: 2648b8af-c0bf-4811-b353-779f2426f8b8 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:51.500268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 2648b8af-c0bf-4811-b353-779f2426f8b8 not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:51.505754 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-de0dae37-74a2-4aab-a676-ab4c02ac8e8d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:51.506285 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-de0dae37-74a2-4aab-a676-ab4c02ac8e8d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:51.510205 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-de0dae37-74a2-4aab-a676-ab4c02ac8e8d tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/26e3d43e-96a1-4cc9-a6a1-d9e609028ad8 HTTP/1.1" status: 404 len: 337 time: 0.0522997 Dec 10 14:29:51.512776 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58012) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.527954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-70ce2ceb-b836-4cdc-9fd0-46c4b0cc4df1 None None] Provisioning complete for port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:51.528617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70ce2ceb-b836-4cdc-9fd0-46c4b0cc4df1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.562597 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f0f2dcc-32f9-4929-ab28-30785cb14db7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:51.563163 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5f0f2dcc-32f9-4929-ab28-30785cb14db7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:51.571968 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5f0f2dcc-32f9-4929-ab28-30785cb14db7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/d0bc12cf-44cd-4620-98df-8ce2c544d13c HTTP/1.1" status: 404 len: 337 time: 0.0559742 Dec 10 14:29:51.574501 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.577612 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58014) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.603279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=2335d3fd-898d-47ad-a539-3d3ef14c50ea,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:51.606876 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.611550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.652948 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-1798ccf0-902d-4dbb-a577-3cae3e946ae9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:51.653514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1798ccf0-902d-4dbb-a577-3cae3e946ae9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:51.659289 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1798ccf0-902d-4dbb-a577-3cae3e946ae9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/a6cd01ad-5324-4b95-8569-d765ef925d22 HTTP/1.1" status: 404 len: 337 time: 0.0768604 Dec 10 14:29:51.665654 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58016) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.677811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-70ce2ceb-b836-4cdc-9fd0-46c4b0cc4df1 None None] Provisioning complete for port 34d16eef-e5fa-493b-9888-8144de93f8d3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:51.678343 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-70ce2ceb-b836-4cdc-9fd0-46c4b0cc4df1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.693203 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.699225 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d384187c-481c-49a6-8c50-7f53134020a9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=84410bb0-960a-4ef0-a5c1-72cde49aba0f HTTP/1.1" status: 200 len: 205 time: 0.0369308 Dec 10 14:29:51.701729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58018) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.720074 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-70ce2ceb-b836-4cdc-9fd0-46c4b0cc4df1 None None] Port 34d16eef-e5fa-493b-9888-8144de93f8d3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:51.750021 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-2bc431d4-bf9f-42db-ba8a-67c4fd33f43b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] delete failed (client error): The resource could not be found. Dec 10 14:29:51.759196 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2bc431d4-bf9f-42db-ba8a-67c4fd33f43b tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/84410bb0-960a-4ef0-a5c1-72cde49aba0f HTTP/1.1" status: 404 len: 336 time: 0.0473051 Dec 10 14:29:51.759196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.760907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58020) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.848441 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7df96cda-bd01-4308-85a6-ada577670420 None None] Provisioning complete for port 34d16eef-e5fa-493b-9888-8144de93f8d3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:51.852887 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7df96cda-bd01-4308-85a6-ada577670420 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:51.865795 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e778960a-4029-42db-bd18-c777958f8df3 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=18508f49-2944-40b4-a289-d08025865b04 HTTP/1.1" status: 200 len: 205 time: 0.0976107 Dec 10 14:29:51.868262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58022) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:51.897293 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7df96cda-bd01-4308-85a6-ada577670420 None None] Port 34d16eef-e5fa-493b-9888-8144de93f8d3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:51.919534 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-6a69ac4c-c7a3-4da9-b1b5-4555929b5fdc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] delete failed (client error): The resource could not be found. Dec 10 14:29:51.923007 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6a69ac4c-c7a3-4da9-b1b5-4555929b5fdc tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/18508f49-2944-40b4-a289-d08025865b04 HTTP/1.1" status: 404 len: 336 time: 0.0511284 Dec 10 14:29:51.923983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58024) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.011877 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-329917b8-e2da-4d36-9723-a2e3f306eff9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:52.012350 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-329917b8-e2da-4d36-9723-a2e3f306eff9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:52.018007 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-329917b8-e2da-4d36-9723-a2e3f306eff9 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/8adbea61-9b0b-429b-8140-84baa0565864 HTTP/1.1" status: 404 len: 337 time: 0.0930104 Dec 10 14:29:52.019111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58026) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.074401 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-64ea0adc-6ced-4e3e-bdf6-c282a110c211 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=0c82fa2b-580a-432c-ad5f-ab33414ea831 HTTP/1.1" status: 200 len: 205 time: 0.0453763 Dec 10 14:29:52.078498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58028) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.135258 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-16918b18-d4e9-495d-b14f-fe59536e5db6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] delete failed (client error): The resource could not be found. Dec 10 14:29:52.136377 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-16918b18-d4e9-495d-b14f-fe59536e5db6 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/0c82fa2b-580a-432c-ad5f-ab33414ea831 HTTP/1.1" status: 404 len: 336 time: 0.0570037 Dec 10 14:29:52.139523 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58030) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.204996 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f62f1188-a131-4329-b928-621bf887dda7 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b850feb-581a-47dc-bffc-30078cf4d321 HTTP/1.1" status: 200 len: 205 time: 0.0612845 Dec 10 14:29:52.206839 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58032) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.223410 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-32498616-a288-4a9a-b274-a62ae492eaca None None] Provisioning complete for port 34d16eef-e5fa-493b-9888-8144de93f8d3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:52.227142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-32498616-a288-4a9a-b274-a62ae492eaca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:52.244936 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-571e4402-3ab1-4cd1-a53e-141fe2ac6359 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] delete failed (client error): The resource could not be found. Dec 10 14:29:52.248573 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-571e4402-3ab1-4cd1-a53e-141fe2ac6359 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/1b850feb-581a-47dc-bffc-30078cf4d321 HTTP/1.1" status: 404 len: 336 time: 0.0384052 Dec 10 14:29:52.249556 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58034) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.285094 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a59f531-d246-443d-b143-95d28a32c044 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:52.285743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2a59f531-d246-443d-b143-95d28a32c044 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:52.286208 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-32498616-a288-4a9a-b274-a62ae492eaca None None] Port 34d16eef-e5fa-493b-9888-8144de93f8d3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:52.289023 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2a59f531-d246-443d-b143-95d28a32c044 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/16d8bf94-466d-415d-a96c-b139907b0409 HTTP/1.1" status: 404 len: 337 time: 0.0384271 Dec 10 14:29:52.292407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58036) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.321558 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e683c520-cb62-4267-a23b-6f56db96d5ee tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=8a0ff370-ce59-491a-bb3e-3757f0043789 HTTP/1.1" status: 200 len: 205 time: 0.0279722 Dec 10 14:29:52.323886 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58038) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.365134 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-b237261f-ebab-4251-a574-c1768eed2e80 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] delete failed (client error): The resource could not be found. Dec 10 14:29:52.368017 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b237261f-ebab-4251-a574-c1768eed2e80 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/8a0ff370-ce59-491a-bb3e-3757f0043789 HTTP/1.1" status: 404 len: 336 time: 0.0414939 Dec 10 14:29:52.370125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58040) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.389278 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=34d16eef-e5fa-493b-9888-8144de93f8d3,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:52.404202 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-3d28a39f-dea0-463c-8071-d4735f47adb0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:52.404757 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3d28a39f-dea0-463c-8071-d4735f47adb0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:52.411639 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3d28a39f-dea0-463c-8071-d4735f47adb0 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/d6900cec-6324-4f02-95fb-5736fd986d4b HTTP/1.1" status: 404 len: 337 time: 0.0374918 Dec 10 14:29:52.414862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58042) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.449728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3309ee6a-d6d3-48f1-91f3-fd99fb8c7016 None None] get_active_networks_info from dv-neutron-821401-2-hyperv {{(pid=103812) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 10 14:29:52.467737 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1260c91d-9c2c-4ec1-a298-d1984b495f22 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "GET /v2.0/ports?device_id=52009993-772b-48ae-81fe-d159369269c5 HTTP/1.1" status: 200 len: 205 time: 0.0485907 Dec 10 14:29:52.468743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58044) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.512039 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-160f8ca7-aff4-4834-ab0e-846a45c47982 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] delete failed (client error): The resource could not be found. Dec 10 14:29:52.512213 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-160f8ca7-aff4-4834-ab0e-846a45c47982 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/routers/52009993-772b-48ae-81fe-d159369269c5 HTTP/1.1" status: 404 len: 336 time: 0.0424998 Dec 10 14:29:52.516042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58046) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.532517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:52.564530 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-64da5f67-c85c-443a-a85d-5d500a7551a4 None None] Provisioning complete for port ff2510f2-1fbc-421d-9e12-5288c583fecd triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:52.564791 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:52.564905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-64da5f67-c85c-443a-a85d-5d500a7551a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:52.572076 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 7e2c0168-99c0-451f-b813-4d00d9e18c39 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:52.572663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:52.630958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:52.633010 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-e9611379-518d-4b06-bb0b-d10edf60913a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:52.633554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e9611379-518d-4b06-bb0b-d10edf60913a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:52.638994 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e9611379-518d-4b06-bb0b-d10edf60913a tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/095b94f4-22e7-4e8c-b916-8569ce0ad1d7 HTTP/1.1" status: 404 len: 337 time: 0.1139131 Dec 10 14:29:52.643796 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58048) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:52.668990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3309ee6a-d6d3-48f1-91f3-fd99fb8c7016 None None] Resources bound (agent type, host, resource id): {{(pid=103812) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 10 14:29:52.680042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:52.686805 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-9046bd1d-1145-4535-bac2-01d47e4c1635 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] DELETE failed (client error): The resource could not be found. Dec 10 14:29:52.687036 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9046bd1d-1145-4535-bac2-01d47e4c1635 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:29:52.693089 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9046bd1d-1145-4535-bac2-01d47e4c1635 tempest-RoutersIpV6Test-1665235465 tempest-RoutersIpV6Test-1665235465-project] 10.222.0.57 "DELETE /v2.0/subnets/b4a4ac9a-ad53-4dee-8792-1cd9c66ab275 HTTP/1.1" status: 404 len: 337 time: 0.0452929 Dec 10 14:29:52.699403 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port 7e2c0168-99c0-451f-b813-4d00d9e18c39, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7e2c0168-99c0-451f-b813-4d00d9e18c39,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:52.699781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:52.716154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 7e2c0168-99c0-451f-b813-4d00d9e18c39 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:52.802070 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::1 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/0d48bc55-e0ba-4d31-986a-e5327256a5c6/30a7dd75-40a3-4217-b865-3e2c1a7d91c9) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:29:52.814875 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-64da5f67-c85c-443a-a85d-5d500a7551a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:52.897222 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-64da5f67-c85c-443a-a85d-5d500a7551a4 None None] For port ff2510f2-1fbc-421d-9e12-5288c583fecd, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ff2510f2-1fbc-421d-9e12-5288c583fecd,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:52.963796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router d18cfd99-e8a8-404e-ba1d-7e6297383bb5 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:53.015392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:53.080952 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:53.081325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.084182 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-64da5f67-c85c-443a-a85d-5d500a7551a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.145823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.155878 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.212766 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ff2510f2-1fbc-421d-9e12-5288c583fecd up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:53.220625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=7e2c0168-99c0-451f-b813-4d00d9e18c39,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:53.226028 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:53.227519 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.242487 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0ae93e2c-05b5-4fca-be39-c1d6de9d3a34 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/d18cfd99-e8a8-404e-ba1d-7e6297383bb5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2776897 Dec 10 14:29:53.245242 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58054) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:53.262004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64da5f67-c85c-443a-a85d-5d500a7551a4 None None] Pushing event updated for resources: {'Port': ['ID=ff2510f2-1fbc-421d-9e12-5288c583fecd,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:53.269020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af322270-f67e-4036-87d6-1657541750e0 None None] Sync routers for ids ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:53.287520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af322270-f67e-4036-87d6-1657541750e0 None None] Routers {'d18cfd99-e8a8-404e-ba1d-7e6297383bb5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:53.288163 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-af322270-f67e-4036-87d6-1657541750e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:53.340185 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-af322270-f67e-4036-87d6-1657541750e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:53.353749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58056) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:53.354327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port ff2510f2-1fbc-421d-9e12-5288c583fecd triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:53.354708 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.359300 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af322270-f67e-4036-87d6-1657541750e0 None None] Routers {'d18cfd99-e8a8-404e-ba1d-7e6297383bb5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:53.359523 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-af322270-f67e-4036-87d6-1657541750e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:53.384876 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.422001 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-af322270-f67e-4036-87d6-1657541750e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:53.422676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af322270-f67e-4036-87d6-1657541750e0 None None] The sync data for ids ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:53.442537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea6ba6c8-60a2-4161-93d2-ece080cc16fb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:53.447089 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ea6ba6c8-60a2-4161-93d2-ece080cc16fb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports/2335d3fd-898d-47ad-a539-3d3ef14c50ea HTTP/1.1" status: 200 len: 910 time: 0.1979630 Dec 10 14:29:53.456274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58060) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:53.512818 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=30a7dd75-40a3-4217-b865-3e2c1a7d91c9,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:53.566888 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:53.573252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:53.579483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:29:53.580040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.617101 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8218414a-c398-4adf-af95-fa013f302718 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=e0ad36cdee2c48fba74cb6486de7c888&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2388136 Dec 10 14:29:53.624940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58062) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:53.720731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Deleting port 1aa93550-1de5-47ad-9798-720589f428cb {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:53.721111 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.827225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-47cbd5fa-4465-4112-8d1d-f8df0ea045d3 None None] Provisioning complete for port ff2510f2-1fbc-421d-9e12-5288c583fecd triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:53.827602 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-47cbd5fa-4465-4112-8d1d-f8df0ea045d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.873124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13d6a3cb-ea32-44bc-892e-1df3d0107a40 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.884083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.927993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13d6a3cb-ea32-44bc-892e-1df3d0107a40 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:53.974530 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] For port 1aa93550-1de5-47ad-9798-720589f428cb, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1aa93550-1de5-47ad-9798-720589f428cb,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:53.975111 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.016454 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.031780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.036870 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Calling delete_port for 1aa93550-1de5-47ad-9798-720589f428cb owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:54.232391 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-5abeae24-399a-4e5b-b638-ddc9b9d4b0c9 None None] Provisioning complete for port 2335d3fd-898d-47ad-a539-3d3ef14c50ea triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:54.232935 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5abeae24-399a-4e5b-b638-ddc9b9d4b0c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.270894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-5abeae24-399a-4e5b-b638-ddc9b9d4b0c9 None None] Port 2335d3fd-898d-47ad-a539-3d3ef14c50ea cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:54.358702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.359497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.394245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9f60eb90-3bfc-4ea8-ab1e-27b4a9f00150 None None] Provisioning complete for port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:54.394962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9f60eb90-3bfc-4ea8-ab1e-27b4a9f00150 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.436149 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-9f60eb90-3bfc-4ea8-ab1e-27b4a9f00150 None None] Port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:54.468274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13d6a3cb-ea32-44bc-892e-1df3d0107a40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.470805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-13d6a3cb-ea32-44bc-892e-1df3d0107a40 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.471995 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-13d6a3cb-ea32-44bc-892e-1df3d0107a40 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/a0e30f60-2598-4f87-8a94-0fe3189b4960 HTTP/1.1" status: 204 len: 168 time: 0.8460844 Dec 10 14:29:54.509752 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=34d16eef-e5fa-493b-9888-8144de93f8d3,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:54.517286 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d6a3cb-ea32-44bc-892e-1df3d0107a40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0e30f60-2598-4f87-8a94-0fe3189b4960,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:54.589346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.599179 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:54.600525 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:54.646434 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.691310 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9d7899bb-a9e2-467f-bfc6-02634a8598ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:54.693723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.712649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event deleted for resources: {'Port': ['ID=1aa93550-1de5-47ad-9798-720589f428cb,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:54.718993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.719822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:54.994679 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:55.003135 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a512bdba-c3a3-45b2-bc85-38ff9093b1d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/routers/9d7899bb-a9e2-467f-bfc6-02634a8598ca/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1028600 Dec 10 14:29:55.010196 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] Sync routers for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:55.026218 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:55.033020 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:55.046669 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ff2510f2-1fbc-421d-9e12-5288c583fecd up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:29:55.168012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port 2335d3fd-898d-47ad-a539-3d3ef14c50ea {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:55.168481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:55.169332 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-37da7786-8462-4a8e-9ecb-42e3e23ea3e0 None None] Provisioning complete for port 34d16eef-e5fa-493b-9888-8144de93f8d3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:55.170180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-37da7786-8462-4a8e-9ecb-42e3e23ea3e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:55.214259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port ff2510f2-1fbc-421d-9e12-5288c583fecd triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:55.214631 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:55.260705 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:55.293890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-37da7786-8462-4a8e-9ecb-42e3e23ea3e0 None None] Port 34d16eef-e5fa-493b-9888-8144de93f8d3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:55.316637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:55.352243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for 2335d3fd-898d-47ad-a539-3d3ef14c50ea owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:55.383798 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=30a7dd75-40a3-4217-b865-3e2c1a7d91c9,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:55.530813 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:29:52Z', 'revision_number': 6, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '17a6f7a3-9b53-4a18-b1cf-56e4db4be95c', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.24', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 842, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:16Z', 'updated_at': '2021-12-10T14:28:21Z', 'revision_number': 1, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:55.558562 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:29:55.562897 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:29:55.571708 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] Checking router: 9d7899bb-a9e2-467f-bfc6-02634a8598ca for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:55.583930 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:55.584819 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:55.655113 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa446636-80ae-4d53-beeb-8c8c5b5790f5 req-e4f01731-7ef8-4546-b796-f3f676908001 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:55.656712 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-aa446636-80ae-4d53-beeb-8c8c5b5790f5 req-e4f01731-7ef8-4546-b796-f3f676908001 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 946 time: 0.0796685 Dec 10 14:29:55.682020 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Router aedcf7fb-bcb3-431e-95dd-dd181ee65daf is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:29:55.690973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:55.704361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:55.750820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=2335d3fd-898d-47ad-a539-3d3ef14c50ea,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:55.759244 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-aa446636-80ae-4d53-beeb-8c8c5b5790f5 req-040d264d-85a6-40c8-ba78-7a2046540239 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0939543 Dec 10 14:29:55.799017 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:55.949576 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:55.956617 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-394c64a2-97d2-4a0b-a8f2-bfc86123d83c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "PUT /v2.0/routers/aedcf7fb-bcb3-431e-95dd-dd181ee65daf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7041862 Dec 10 14:29:55.960293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58086) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:55.962812 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82e37a3e-76de-4e5f-b16b-6e853c913bff None None] Sync routers for ids ['aedcf7fb-bcb3-431e-95dd-dd181ee65daf'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:55.974628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82e37a3e-76de-4e5f-b16b-6e853c913bff None None] Routers {'aedcf7fb-bcb3-431e-95dd-dd181ee65daf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:55.975260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-82e37a3e-76de-4e5f-b16b-6e853c913bff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['aedcf7fb-bcb3-431e-95dd-dd181ee65daf'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:55.986213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:56.041482 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-82e37a3e-76de-4e5f-b16b-6e853c913bff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:56.078287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b470f366-30d7-4f77-b8b0-c81500dff0c3 None None] Provisioning complete for port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:56.078657 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b470f366-30d7-4f77-b8b0-c81500dff0c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:56.084085 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82e37a3e-76de-4e5f-b16b-6e853c913bff None None] Routers {'aedcf7fb-bcb3-431e-95dd-dd181ee65daf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:56.084719 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-82e37a3e-76de-4e5f-b16b-6e853c913bff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['aedcf7fb-bcb3-431e-95dd-dd181ee65daf'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:56.155598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-82e37a3e-76de-4e5f-b16b-6e853c913bff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:56.156276 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82e37a3e-76de-4e5f-b16b-6e853c913bff None None] The sync data for ids ['aedcf7fb-bcb3-431e-95dd-dd181ee65daf'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:56.168420 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a94d75f1-794e-4e38-a5d8-9e6da1e3d6c2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:56.170052 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a94d75f1-794e-4e38-a5d8-9e6da1e3d6c2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports?device_id=aedcf7fb-bcb3-431e-95dd-dd181ee65daf HTTP/1.1" status: 200 len: 988 time: 0.1771390 Dec 10 14:29:56.175711 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58090) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:56.176335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Router 6f770f17-285d-418a-814b-c2e1570f3be5 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:29:56.181331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b470f366-30d7-4f77-b8b0-c81500dff0c3 None None] Port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:29:56.228510 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58092) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:56.278579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router d18cfd99-e8a8-404e-ba1d-7e6297383bb5 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:56.303217 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:29:52Z', 'revision_number': 6, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '17a6f7a3-9b53-4a18-b1cf-56e4db4be95c', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.24', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 842, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:16Z', 'updated_at': '2021-12-10T14:28:21Z', 'revision_number': 1, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:56.332981 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b22511d-7a6b-469b-9826-733bba49c81c None None] The sync data for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv is: [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:29:52Z', 'revision_number': 6, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '17a6f7a3-9b53-4a18-b1cf-56e4db4be95c', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.24', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'port_id': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 842, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'mac_address': 'fa:16:3e:d4:87:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:28:16Z', 'updated_at': '2021-12-10T14:28:21Z', 'revision_number': 1, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:56.391256 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:56.398797 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6e63f0b8-1f2c-48fd-974d-379753972139 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/d18cfd99-e8a8-404e-ba1d-7e6297383bb5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9377568 Dec 10 14:29:56.399252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-96ad6e6c-084f-41c3-81fd-d0a95b59993e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:56.399252 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-96ad6e6c-084f-41c3-81fd-d0a95b59993e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 10 14:29:56.399252 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-96ad6e6c-084f-41c3-81fd-d0a95b59993e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): There was a conflict when trying to complete your request. Dec 10 14:29:56.400421 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3c647bd-d51e-4f1e-859c-c55545705914 None None] Sync routers for ids ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:56.400617 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-96ad6e6c-084f-41c3-81fd-d0a95b59993e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.1708906 Dec 10 14:29:56.401450 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58096) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:56.405388 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58098) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:56.412076 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3c647bd-d51e-4f1e-859c-c55545705914 None None] Routers {'d18cfd99-e8a8-404e-ba1d-7e6297383bb5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:56.413559 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d3c647bd-d51e-4f1e-859c-c55545705914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:56.414040 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'tempest-secgroup--1695022713'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:56.448247 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d3c647bd-d51e-4f1e-859c-c55545705914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:56.457313 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3c647bd-d51e-4f1e-859c-c55545705914 None None] Routers {'d18cfd99-e8a8-404e-ba1d-7e6297383bb5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:56.457943 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d3c647bd-d51e-4f1e-859c-c55545705914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:56.493856 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d3c647bd-d51e-4f1e-859c-c55545705914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:56.494511 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3c647bd-d51e-4f1e-859c-c55545705914 None None] The sync data for ids ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:56.507669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Router bd5934f5-df99-4165-8014-b21160f71cfb has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:29:56.509821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:56.518716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Sync routers for ids ['6f770f17-285d-418a-814b-c2e1570f3be5'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:56.528246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Routers {'6f770f17-285d-418a-814b-c2e1570f3be5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:56.529046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6f770f17-285d-418a-814b-c2e1570f3be5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:56.543565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:56.550197 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4b48d0b9-27e4-456a-8075-ad2f77d520c2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "PUT /v2.0/routers/6f770f17-285d-418a-814b-c2e1570f3be5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.8554206 Dec 10 14:29:56.555973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58100) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:56.558222 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:56.641123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:56.664372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46508457-3531-4951-8698-782549b9440c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:56.666217 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-46508457-3531-4951-8698-782549b9440c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports/30a7dd75-40a3-4217-b865-3e2c1a7d91c9 HTTP/1.1" status: 200 len: 911 time: 0.1063180 Dec 10 14:29:56.668869 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58102) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:56.708349 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:56.808442 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7e2c0168-99c0-451f-b813-4d00d9e18c39 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:56.817457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11b12569-0364-499d-b652-3e7cd4b55c45 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:56.829602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11b12569-0364-499d-b652-3e7cd4b55c45 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:56.832687 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-11b12569-0364-499d-b652-3e7cd4b55c45 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.1616442 Dec 10 14:29:56.833554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d103e06f-55fb-4114-800f-027f62c80cc8,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:56.836855 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58106) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:56.852070 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 7e2c0168-99c0-451f-b813-4d00d9e18c39 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:56.852496 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7e2c0168-99c0-451f-b813-4d00d9e18c39 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:56.854717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Set router 6f770f17-285d-418a-814b-c2e1570f3be5 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:56.869923 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:29:57.032486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.073816 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc9bc64-301f-41ac-af3e-6bd6f4a5efb3 req-02dfddea-b1fa-4ce4-8586-972e635c654d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:57.075309 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4bc9bc64-301f-41ac-af3e-6bd6f4a5efb3 req-02dfddea-b1fa-4ce4-8586-972e635c654d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 946 time: 0.2031026 Dec 10 14:29:57.115967 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f770f17-285d-418a-814b-c2e1570f3be5', 'name': 'tempest-NetworksTestDHCPv6-router-528474408', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:29:49Z', 'updated_at': '2021-12-10T14:29:53Z', 'revision_number': 2, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None, '_interfaces': [{'id': '30a7dd75-40a3-4217-b865-3e2c1a7d91c9', 'name': '', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'mac_address': 'fa:16:3e:e9:99:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f770f17-285d-418a-814b-c2e1570f3be5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1082, 'fixed_ips': [{'subnet_id': '0d48bc55-e0ba-4d31-986a-e5327256a5c6', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:51Z', 'updated_at': '2021-12-10T14:29:54Z', 'revision_number': 2, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'subnets': [{'id': '0d48bc55-e0ba-4d31-986a-e5327256a5c6', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:57.125244 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-9bb91831-6a6d-481f-bafd-ada7ed7747f8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:57.126867 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-9bb91831-6a6d-481f-bafd-ada7ed7747f8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 946 time: 0.2082839 Dec 10 14:29:57.144993 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Checking router: 6f770f17-285d-418a-814b-c2e1570f3be5 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:57.145345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Updating router 6f770f17-285d-418a-814b-c2e1570f3be5 port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:29:57.164567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.172580 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.269368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a0e02ed9-0d46-4a91-9069-4e0065ac90cd,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:57.317154 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4bc9bc64-301f-41ac-af3e-6bd6f4a5efb3 req-2bf0df66-0825-4cc9-a2e7-d6b4f6b519c5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2066526 Dec 10 14:29:57.329927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:29:57.338627 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-21a348d4-a96d-444d-920a-d51239efae15 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "PUT /v2.0/routers/bd5934f5-df99-4165-8014-b21160f71cfb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2172341 Dec 10 14:29:57.339971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58108) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:57.350248 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.351471 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bff4b3de-9241-446c-b1e7-28249aa1245b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.9412694 Dec 10 14:29:57.355322 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58110) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:57.357711 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] Sync routers for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:29:57.362218 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7fed69ac-8479-47bf-a235-4965420fb058 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': 'a0e02ed9-0d46-4a91-9069-4e0065ac90cd', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:57.380479 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:57.381663 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:57.411441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port bac35f63-cb95-4d03-a0bc-4595f7bec69c {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:57.415338 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.496957 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:57.502317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7fed69ac-8479-47bf-a235-4965420fb058 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.511721 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.576632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port bac35f63-cb95-4d03-a0bc-4595f7bec69c, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=bac35f63-cb95-4d03-a0bc-4595f7bec69c,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:57.577094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.586795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-d3857f3a-629e-4069-9a72-f059860e4639 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Deleting subnet 0f3ba970-7746-4f0a-8fc3-e64be22456c1 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:29:57.590859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d3857f3a-629e-4069-9a72-f059860e4639 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.619815 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.622216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for bac35f63-cb95-4d03-a0bc-4595f7bec69c owned by compute:nova {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:57.657653 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.659222 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d3857f3a-629e-4069-9a72-f059860e4639 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.666604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7fed69ac-8479-47bf-a235-4965420fb058 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.702966 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a6e9f33-14e6-4950-86cb-3a7a836a19d1 None None] Pushing event updated for resources: {'Port': ['ID=30a7dd75-40a3-4217-b865-3e2c1a7d91c9,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:57.768820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Attempting to bind port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:29:57.769192 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Attempting to bind port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:29:57.769577 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Attempting to bind port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:29:57.777864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:29:57.778274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:29:57.778637 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.779039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:29:57.779524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Bound port: 30a7dd75-40a3-4217-b865-3e2c1a7d91c9, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:29:57.780239 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.785255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7fed69ac-8479-47bf-a235-4965420fb058 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.789298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d3857f3a-629e-4069-9a72-f059860e4639 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:57.864420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fed69ac-8479-47bf-a235-4965420fb058 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a1b02be9-2f0a-4611-bd42-24993231ff72,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:57.925390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] For port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:29:57.931664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] For port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=30a7dd75-40a3-4217-b865-3e2c1a7d91c9,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:29:57.945712 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:29:54Z', 'revision_number': 5, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:57.979242 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] Checking router: bd5934f5-df99-4165-8014-b21160f71cfb for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:29:57.989919 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] Routers {'bd5934f5-df99-4165-8014-b21160f71cfb'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:57.990647 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['bd5934f5-df99-4165-8014-b21160f71cfb'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:57.997498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d3857f3a-629e-4069-9a72-f059860e4639 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.044435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.072575 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3857f3a-629e-4069-9a72-f059860e4639 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event deleted for resources: {'Subnet': ['ID=0f3ba970-7746-4f0a-8fc3-e64be22456c1,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:58.087915 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d3857f3a-629e-4069-9a72-f059860e4639 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.094483 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d3857f3a-629e-4069-9a72-f059860e4639 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "DELETE /v2.0/subnets/0f3ba970-7746-4f0a-8fc3-e64be22456c1 HTTP/1.1" status: 204 len: 168 time: 0.7534351 Dec 10 14:29:58.096482 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58112) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:58.099936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.101088 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94dd785c-eec1-46f3-ac1b-3ea2702d1fdb None None] Network 6ba405b9-cdef-4b06-9661-6ad5871b3c6b requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:29:58.139516 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] Set router bd5934f5-df99-4165-8014-b21160f71cfb gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:58.264993 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a6e9f33-14e6-4950-86cb-3a7a836a19d1 None None] Pushing event updated for resources: {'Port': ['ID=30a7dd75-40a3-4217-b865-3e2c1a7d91c9,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:58.292235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.303141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Routers {'6f770f17-285d-418a-814b-c2e1570f3be5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:29:58.303794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6f770f17-285d-418a-814b-c2e1570f3be5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:58.358171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7fed69ac-8479-47bf-a235-4965420fb058 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.359870 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7fed69ac-8479-47bf-a235-4965420fb058 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.0013373 Dec 10 14:29:58.368408 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58114) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:58.369277 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:29:54Z', 'revision_number': 5, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:58.402657 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c623b208-ac2e-4f07-b5b2-c7e10bbe839c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': 'a0e02ed9-0d46-4a91-9069-4e0065ac90cd', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:58.404403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] Set router 6f770f17-285d-418a-814b-c2e1570f3be5 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:29:58.469454 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4157deb0-77ea-4f90-8975-5d36c3786732 None None] The sync data for ids ['bd5934f5-df99-4165-8014-b21160f71cfb'] in dv-neutron-821401-2-hyperv is: [{'id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2126543738', 'tenant_id': '37199cbe89a04c3096fd8e1d31a3df63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191'}], 'enable_snat': True}, 'gw_port_id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:21Z', 'updated_at': '2021-12-10T14:29:54Z', 'revision_number': 5, 'project_id': '37199cbe89a04c3096fd8e1d31a3df63', 'gw_port': {'id': 'af294fd1-c085-4a25-98af-b92ec5593a0f', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:bf:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd5934f5-df99-4165-8014-b21160f71cfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:22Z', 'updated_at': '2021-12-10T14:27:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:58.574272 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.578688 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.582110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c623b208-ac2e-4f07-b5b2-c7e10bbe839c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.584095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-34ac5a7f-c663-4ed7-9491-2189a4a0e320 None None] Provisioning complete for port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:58.584372 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-34ac5a7f-c663-4ed7-9491-2189a4a0e320 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.645546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=bac35f63-cb95-4d03-a0bc-4595f7bec69c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:58.710881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d27df97-841d-423b-8000-086e21397b19 req-6cd64eda-64e6-4e21-8bd5-2116e840bb6d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:29:58.712585 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6d27df97-841d-423b-8000-086e21397b19 req-6cd64eda-64e6-4e21-8bd5-2116e840bb6d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 867 time: 0.1956158 Dec 10 14:29:58.734441 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-34ac5a7f-c663-4ed7-9491-2189a4a0e320 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.735597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] No DVR routers for this DVR port bac35f63-cb95-4d03-a0bc-4595f7bec69c on host hv-neutron-8214 {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:58.745045 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.749194 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4545bef4-ade5-49a6-9244-fc700d438cd5 req-d8a5b257-665f-468c-b69b-1bb0728d18f6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "DELETE /v2.0/ports/bac35f63-cb95-4d03-a0bc-4595f7bec69c HTTP/1.1" status: 204 len: 173 time: 1.5854244 Dec 10 14:29:58.767182 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '42f13496-e928-4712-aca5-df46dbe9b53b', 'name': 'network-vif-deleted', 'tag': 'bac35f63-cb95-4d03-a0bc-4595f7bec69c'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:29:58.773301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac26e6ba-6ff4-4062-b23f-98b89afa16ae" -d '{"events": [{"server_uuid": "42f13496-e928-4712-aca5-df46dbe9b53b", "name": "network-vif-deleted", "tag": "bac35f63-cb95-4d03-a0bc-4595f7bec69c"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:29:58.779181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:58.779620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.789293 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-34ac5a7f-c663-4ed7-9491-2189a4a0e320 None None] For port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=30a7dd75-40a3-4217-b865-3e2c1a7d91c9,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:58.791132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f770f17-285d-418a-814b-c2e1570f3be5', 'name': 'tempest-NetworksTestDHCPv6-router-528474408', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:29:49Z', 'updated_at': '2021-12-10T14:29:53Z', 'revision_number': 2, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None, '_interfaces': [{'id': '30a7dd75-40a3-4217-b865-3e2c1a7d91c9', 'name': '', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'mac_address': 'fa:16:3e:e9:99:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f770f17-285d-418a-814b-c2e1570f3be5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1082, 'fixed_ips': [{'subnet_id': '0d48bc55-e0ba-4d31-986a-e5327256a5c6', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:51Z', 'updated_at': '2021-12-10T14:29:57Z', 'revision_number': 4, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'subnets': [{'id': '0d48bc55-e0ba-4d31-986a-e5327256a5c6', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:29:58.837236 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4edae754-5f37-4564-b8f4-2b72f0adf519 None None] The sync data for ids ['6f770f17-285d-418a-814b-c2e1570f3be5'] in dv-neutron-821401-2-hyperv is: [{'id': '6f770f17-285d-418a-814b-c2e1570f3be5', 'name': 'tempest-NetworksTestDHCPv6-router-528474408', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:29:49Z', 'updated_at': '2021-12-10T14:29:53Z', 'revision_number': 2, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None, '_interfaces': [{'id': '30a7dd75-40a3-4217-b865-3e2c1a7d91c9', 'name': '', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'mac_address': 'fa:16:3e:e9:99:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f770f17-285d-418a-814b-c2e1570f3be5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1082, 'fixed_ips': [{'subnet_id': '0d48bc55-e0ba-4d31-986a-e5327256a5c6', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:29:51Z', 'updated_at': '2021-12-10T14:29:57Z', 'revision_number': 4, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'subnets': [{'id': '0d48bc55-e0ba-4d31-986a-e5327256a5c6', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:29:58.863276 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dd63557-5da6-447b-9698-d300c5759f2e None None] DHCP port deletion for 6ba405b9-cdef-4b06-9661-6ad5871b3c6b request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:29:58.880702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:29:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86de0a49-7945-4615-9462-2cea351ed5b5 x-openstack-request-id: req-86de0a49-7945-4615-9462-2cea351ed5b5 {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:29:58.881868 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.882410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "42f13496-e928-4712-aca5-df46dbe9b53b", "name": "network-vif-deleted", "tag": "bac35f63-cb95-4d03-a0bc-4595f7bec69c", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:29:58.882410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-86de0a49-7945-4615-9462-2cea351ed5b5 {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:29:58.882410 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '42f13496-e928-4712-aca5-df46dbe9b53b', 'name': 'network-vif-deleted', 'tag': 'bac35f63-cb95-4d03-a0bc-4595f7bec69c', 'status': 'completed', 'code': 200} Dec 10 14:29:58.899109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-34ac5a7f-c663-4ed7-9491-2189a4a0e320 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:58.929575 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6d27df97-841d-423b-8000-086e21397b19 req-a12c2ca2-e76d-4147-bd16-763fb427ad91 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=a7754821-56c9-4342-8d14-0e36a6c62482&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1965590 Dec 10 14:29:58.946926 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-c623b208-ac2e-4f07-b5b2-c7e10bbe839c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): There was a conflict when trying to complete your request. Dec 10 14:29:58.946926 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c623b208-ac2e-4f07-b5b2-c7e10bbe839c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.5728269 Dec 10 14:29:58.946926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58120) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:58.979945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ac5a7f-c663-4ed7-9491-2189a4a0e320 None None] Pushing event updated for resources: {'Port': ['ID=30a7dd75-40a3-4217-b865-3e2c1a7d91c9,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:59.021242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8dd63557-5da6-447b-9698-d300c5759f2e None None] Deleting port ca8d956f-a9bd-41fb-8601-a45a40775705 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:59.021816 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dd63557-5da6-447b-9698-d300c5759f2e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.093515 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] For port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=30a7dd75-40a3-4217-b865-3e2c1a7d91c9,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:59.093897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.102761 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 34d16eef-e5fa-493b-9888-8144de93f8d3 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:59.103114 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.119431 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:59.124550 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8dd63557-5da6-447b-9698-d300c5759f2e None None] For port ca8d956f-a9bd-41fb-8601-a45a40775705, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ca8d956f-a9bd-41fb-8601-a45a40775705,segment=NetworkSegment(aaba56c6-c9a2-4aa8-9651-0a759874ef75),segment_id=aaba56c6-c9a2-4aa8-9651-0a759874ef75)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:59.125135 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dd63557-5da6-447b-9698-d300c5759f2e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.142299 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-57d6f080-f7cf-4a99-8d73-2fc7f9583197 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.149677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8dd63557-5da6-447b-9698-d300c5759f2e None None] Calling delete_port for ca8d956f-a9bd-41fb-8601-a45a40775705 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:59.170640 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1aa93550-1de5-47ad-9798-720589f428cb no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:59.275142 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-57d6f080-f7cf-4a99-8d73-2fc7f9583197 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.319049 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Deleting port af294fd1-c085-4a25-98af-b92ec5593a0f {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:59.319361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.326463 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 1aa93550-1de5-47ad-9798-720589f428cb {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:29:59.326814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1aa93550-1de5-47ad-9798-720589f428cb not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:29:59.327541 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ca8d956f-a9bd-41fb-8601-a45a40775705 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:29:59.331795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port f55da04d-5c9e-4189-9d05-bc4cd78af281 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:29:59.334384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.357376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.396864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-47536f0d-251b-46a1-9dbf-8c9b4f21fdf7 None None] Provisioning complete for port 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:29:59.397546 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-47536f0d-251b-46a1-9dbf-8c9b4f21fdf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.446089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 34d16eef-e5fa-493b-9888-8144de93f8d3 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:59.523715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-57d6f080-f7cf-4a99-8d73-2fc7f9583197 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.528264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-57d6f080-f7cf-4a99-8d73-2fc7f9583197 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.530450 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-57d6f080-f7cf-4a99-8d73-2fc7f9583197 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/a0e02ed9-0d46-4a91-9069-4e0065ac90cd HTTP/1.1" status: 204 len: 168 time: 0.5816529 Dec 10 14:29:59.534970 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58122) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:59.539716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8dd63557-5da6-447b-9698-d300c5759f2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.548460 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d6f080-f7cf-4a99-8d73-2fc7f9583197 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0e02ed9-0d46-4a91-9069-4e0065ac90cd,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:59.575141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dd63557-5da6-447b-9698-d300c5759f2e None None] No DVR routers for this DVR port ca8d956f-a9bd-41fb-8601-a45a40775705 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:29:59.578076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.601252 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dd63557-5da6-447b-9698-d300c5759f2e None None] Pushing event deleted for resources: {'Port': ['ID=ca8d956f-a9bd-41fb-8601-a45a40775705,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:59.623644 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.633262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.644165 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] For port af294fd1-c085-4a25-98af-b92ec5593a0f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=af294fd1-c085-4a25-98af-b92ec5593a0f,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:29:59.644615 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.694971 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for f55da04d-5c9e-4189-9d05-bc4cd78af281 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:59.697025 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Calling delete_port for af294fd1-c085-4a25-98af-b92ec5593a0f owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:29:59.788512 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-219ad329-ef04-4088-8a8b-8d4a16f34316 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.2466481 Dec 10 14:29:59.797161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:29:59.806813 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=30a7dd75-40a3-4217-b865-3e2c1a7d91c9,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:29:59.812860 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58124) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:29:59.815951 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a9321dec-103b-45fe-970b-de7da0a93e6c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'tempest-secgroup--710298831'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:29:59.995673 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9321dec-103b-45fe-970b-de7da0a93e6c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.011597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Router 6f770f17-285d-418a-814b-c2e1570f3be5 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:00.075289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.098888 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-83fc0226-e7d0-43e5-96c7-40f8b9ffeead req-502b7a0b-ee52-4b15-b849-b38278d77dbc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=42f13496-e928-4712-aca5-df46dbe9b53b HTTP/1.1" status: 200 len: 210 time: 0.0707798 Dec 10 14:30:00.127243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=34d16eef-e5fa-493b-9888-8144de93f8d3,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:00.147522 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:00.153206 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fb1376d1-dff1-4f3d-8317-83ed33c2e7ef tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "PUT /v2.0/routers/6f770f17-285d-418a-814b-c2e1570f3be5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2994003 Dec 10 14:30:00.157237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58128) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:00.206542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9321dec-103b-45fe-970b-de7da0a93e6c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.228068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e3dc3bb-e584-47f6-9188-803e7136bd41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:00.229740 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e3dc3bb-e584-47f6-9188-803e7136bd41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:00.231246 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8e3dc3bb-e584-47f6-9188-803e7136bd41 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0717914 Dec 10 14:30:00.233982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58130) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:00.289067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-68e47b45-4d01-4140-8573-bf9e4edc1bdb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 0d48bc55-e0ba-4d31-986a-e5327256a5c6 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:00.292867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68e47b45-4d01-4140-8573-bf9e4edc1bdb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.296001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9321dec-103b-45fe-970b-de7da0a93e6c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.376723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9321dec-103b-45fe-970b-de7da0a93e6c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8c9860e9-458f-431d-988e-3f1ef4666d65,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:00.383186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68e47b45-4d01-4140-8573-bf9e4edc1bdb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.456095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9321dec-103b-45fe-970b-de7da0a93e6c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.457578 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a9321dec-103b-45fe-970b-de7da0a93e6c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.6461451 Dec 10 14:30:00.462139 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58132) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:00.466647 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7c841f9f-4249-40c9-bc2f-57705c2b7140 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '8c9860e9-458f-431d-988e-3f1ef4666d65', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:00.467148 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-7c841f9f-4249-40c9-bc2f-57705c2b7140 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Dec 10 14:30:00.468275 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-7c841f9f-4249-40c9-bc2f-57705c2b7140 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:00.469268 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7c841f9f-4249-40c9-bc2f-57705c2b7140 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0061600 Dec 10 14:30:00.472825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58134) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:00.506185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68e47b45-4d01-4140-8573-bf9e4edc1bdb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.579385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c243c54-0a5b-4ccb-8858-2a13d66201e3 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.606977 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c243c54-0a5b-4ccb-8858-2a13d66201e3 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.657028 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.687175 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68e47b45-4d01-4140-8573-bf9e4edc1bdb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.717817 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68e47b45-4d01-4140-8573-bf9e4edc1bdb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=0d48bc55-e0ba-4d31-986a-e5327256a5c6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:00.720165 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68e47b45-4d01-4140-8573-bf9e4edc1bdb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.726699 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-68e47b45-4d01-4140-8573-bf9e4edc1bdb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/0d48bc55-e0ba-4d31-986a-e5327256a5c6 HTTP/1.1" status: 204 len: 168 time: 0.4893184 Dec 10 14:30:00.727045 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58136) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:00.731188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d134e4a-dea3-4484-83f3-15df4330f9e1 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:00.769458 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c243c54-0a5b-4ccb-8858-2a13d66201e3 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.772100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c243c54-0a5b-4ccb-8858-2a13d66201e3 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.776090 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2c243c54-0a5b-4ccb-8858-2a13d66201e3 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/8c9860e9-458f-431d-988e-3f1ef4666d65 HTTP/1.1" status: 204 len: 168 time: 0.3023152 Dec 10 14:30:00.780132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58138) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:00.811899 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c243c54-0a5b-4ccb-8858-2a13d66201e3 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c9860e9-458f-431d-988e-3f1ef4666d65,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:00.825660 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.827428 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:00.828621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] Sync routers for ids ['6f770f17-285d-418a-814b-c2e1570f3be5'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:00.842112 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Router aedcf7fb-bcb3-431e-95dd-dd181ee65daf has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:00.849145 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] Routers {'6f770f17-285d-418a-814b-c2e1570f3be5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:00.849923 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6f770f17-285d-418a-814b-c2e1570f3be5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:00.884115 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ad15f892-204b-4d3a-95b6-b4cc36bb5500 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0907223 Dec 10 14:30:00.884739 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=f55da04d-5c9e-4189-9d05-bc4cd78af281,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:00.884739 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58140) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:00.896233 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2be34246-f9a4-41bc-a633-eb71dec6d739 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 709 time: 0.1651313 Dec 10 14:30:00.898375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58142) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:00.967230 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c059aae7-cb14-4cbb-bae4-d9a40163dd3f tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'tempest-secgroup--658139535'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:00.981745 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ffc9c0ef-7f06-43e7-8cc7-f6e51947bbb2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.064453 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24627b15-908e-463c-9ac8-29cbb3497024 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:01.107707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:01.120556 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] Set router 6f770f17-285d-418a-814b-c2e1570f3be5 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:01.123402 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99052f2d-0878-417b-a863-63f94f61a6a8 None None] Sync routers for ids ['aedcf7fb-bcb3-431e-95dd-dd181ee65daf'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:01.147364 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3eb73cea-4317-462f-8628-ff1db921706c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "PUT /v2.0/routers/aedcf7fb-bcb3-431e-95dd-dd181ee65daf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.9687464 Dec 10 14:30:01.150590 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c059aae7-cb14-4cbb-bae4-d9a40163dd3f tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.156495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58146) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:01.160963 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99052f2d-0878-417b-a863-63f94f61a6a8 None None] Routers {'aedcf7fb-bcb3-431e-95dd-dd181ee65daf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:01.165200 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-99052f2d-0878-417b-a863-63f94f61a6a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['aedcf7fb-bcb3-431e-95dd-dd181ee65daf'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:01.193585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58148) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:01.209497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f770f17-285d-418a-814b-c2e1570f3be5', 'name': 'tempest-NetworksTestDHCPv6-router-528474408', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:29:49Z', 'updated_at': '2021-12-10T14:29:59Z', 'revision_number': 3, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:01.217299 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ffc9c0ef-7f06-43e7-8cc7-f6e51947bbb2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.233126 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ffc9c0ef-7f06-43e7-8cc7-f6e51947bbb2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.237405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.251749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event deleted for resources: {'Port': ['ID=af294fd1-c085-4a25-98af-b92ec5593a0f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:01.258617 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-503197b3-5763-4731-b9d7-602126987490 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:30:01.268996 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58150) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:01.269597 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-503197b3-5763-4731-b9d7-602126987490 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/34d16eef-e5fa-493b-9888-8144de93f8d3 HTTP/1.1" status: 404 len: 333 time: 0.1087358 Dec 10 14:30:01.273006 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.292963 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-99052f2d-0878-417b-a863-63f94f61a6a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:01.307339 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5583b91a-7bca-4b50-ae97-0f2686de66ff None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:01.310980 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99052f2d-0878-417b-a863-63f94f61a6a8 None None] Routers {'aedcf7fb-bcb3-431e-95dd-dd181ee65daf'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:01.311223 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] Checking router: 6f770f17-285d-418a-814b-c2e1570f3be5 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:01.312083 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-99052f2d-0878-417b-a863-63f94f61a6a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['aedcf7fb-bcb3-431e-95dd-dd181ee65daf'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:01.353507 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-99052f2d-0878-417b-a863-63f94f61a6a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:01.354403 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99052f2d-0878-417b-a863-63f94f61a6a8 None None] The sync data for ids ['aedcf7fb-bcb3-431e-95dd-dd181ee65daf'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:01.364762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] Routers {'6f770f17-285d-418a-814b-c2e1570f3be5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:01.365539 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6f770f17-285d-418a-814b-c2e1570f3be5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:01.420195 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.426390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.430775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ab63019f-5cd7-4898-8600-2a4b8eaf921b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.447100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] Set router 6f770f17-285d-418a-814b-c2e1570f3be5 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:01.479368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b2de16b-90b8-4720-aa6c-2089b042396a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.515204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ffc9c0ef-7f06-43e7-8cc7-f6e51947bbb2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.515615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffc9c0ef-7f06-43e7-8cc7-f6e51947bbb2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Fanout notify agent at l3_agent the message router_deleted on router 6f770f17-285d-418a-814b-c2e1570f3be5 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:30:01.516281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f770f17-285d-418a-814b-c2e1570f3be5', 'name': 'tempest-NetworksTestDHCPv6-router-528474408', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:29:49Z', 'updated_at': '2021-12-10T14:29:59Z', 'revision_number': 3, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:01.528714 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ffc9c0ef-7f06-43e7-8cc7-f6e51947bbb2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.529939 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ffc9c0ef-7f06-43e7-8cc7-f6e51947bbb2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/routers/6f770f17-285d-418a-814b-c2e1570f3be5 HTTP/1.1" status: 204 len: 168 time: 0.6305494 Dec 10 14:30:01.535163 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58152) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:01.543560 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:01.560477 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device bac35f63-cb95-4d03-a0bc-4595f7bec69c no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:01.571814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-182e48db-d317-4e76-ba4e-b83be8366ab4 None None] The sync data for ids ['6f770f17-285d-418a-814b-c2e1570f3be5'] in dv-neutron-821401-2-hyperv is: [{'id': '6f770f17-285d-418a-814b-c2e1570f3be5', 'name': 'tempest-NetworksTestDHCPv6-router-528474408', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:29:49Z', 'updated_at': '2021-12-10T14:29:59Z', 'revision_number': 3, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:01.577847 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.597578 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-5583b91a-7bca-4b50-ae97-0f2686de66ff None None] Deleting port ff2510f2-1fbc-421d-9e12-5288c583fecd {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:01.597744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5583b91a-7bca-4b50-ae97-0f2686de66ff None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.601375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: bac35f63-cb95-4d03-a0bc-4595f7bec69c {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:01.601791 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device bac35f63-cb95-4d03-a0bc-4595f7bec69c not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:01.602899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.603474 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Fanout notify agent at l3_agent the message router_deleted on router bd5934f5-df99-4165-8014-b21160f71cfb {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:30:01.635806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.637888 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d122b0f4-8713-47bb-af5a-df0bdb9c2c03 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "DELETE /v2.0/routers/bd5934f5-df99-4165-8014-b21160f71cfb HTTP/1.1" status: 204 len: 168 time: 3.5392032 Dec 10 14:30:01.640558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c059aae7-cb14-4cbb-bae4-d9a40163dd3f tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.685202 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5583b91a-7bca-4b50-ae97-0f2686de66ff None None] For port ff2510f2-1fbc-421d-9e12-5288c583fecd, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ff2510f2-1fbc-421d-9e12-5288c583fecd,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:01.686073 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5583b91a-7bca-4b50-ae97-0f2686de66ff None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.702383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-5583b91a-7bca-4b50-ae97-0f2686de66ff None None] Calling delete_port for ff2510f2-1fbc-421d-9e12-5288c583fecd owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:01.732131 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ab63019f-5cd7-4898-8600-2a4b8eaf921b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.733647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58154) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:01.734989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ab63019f-5cd7-4898-8600-2a4b8eaf921b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.749979 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c059aae7-cb14-4cbb-bae4-d9a40163dd3f tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.825871 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b2de16b-90b8-4720-aa6c-2089b042396a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.915772 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ab63019f-5cd7-4898-8600-2a4b8eaf921b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.915772 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab63019f-5cd7-4898-8600-2a4b8eaf921b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Fanout notify agent at l3_agent the message router_deleted on router aedcf7fb-bcb3-431e-95dd-dd181ee65daf {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:30:01.926765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ab63019f-5cd7-4898-8600-2a4b8eaf921b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.927471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5583b91a-7bca-4b50-ae97-0f2686de66ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:01.930718 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ab63019f-5cd7-4898-8600-2a4b8eaf921b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/routers/aedcf7fb-bcb3-431e-95dd-dd181ee65daf HTTP/1.1" status: 204 len: 168 time: 0.6301351 Dec 10 14:30:01.936120 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58156) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:01.957121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5583b91a-7bca-4b50-ae97-0f2686de66ff None None] Pushing event deleted for resources: {'Port': ['ID=ff2510f2-1fbc-421d-9e12-5288c583fecd,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:01.964651 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c059aae7-cb14-4cbb-bae4-d9a40163dd3f tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=532a05e9-7905-45c8-b4f6-c1985b47060d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:01.973819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5583b91a-7bca-4b50-ae97-0f2686de66ff None None] No DVR routers for this DVR port ff2510f2-1fbc-421d-9e12-5288c583fecd on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:01.998763 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router d18cfd99-e8a8-404e-ba1d-7e6297383bb5 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:02.007662 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-347c0aa1-e937-4d8f-a414-aaf9cad69730 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet d6c1a1b5-c637-472c-8aa6-1c82a185f10f {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:02.007830 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.014417 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c059aae7-cb14-4cbb-bae4-d9a40163dd3f tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.015416 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c059aae7-cb14-4cbb-bae4-d9a40163dd3f tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 1.1127269 Dec 10 14:30:02.020615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-347c0aa1-e937-4d8f-a414-aaf9cad69730 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.021835 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58158) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:02.030469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-274095ca-88be-4c47-bfef-510435e6ef59 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '532a05e9-7905-45c8-b4f6-c1985b47060d', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:02.031291 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-274095ca-88be-4c47-bfef-510435e6ef59 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Dec 10 14:30:02.031799 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-274095ca-88be-4c47-bfef-510435e6ef59 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:02.032802 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-274095ca-88be-4c47-bfef-510435e6ef59 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0106065 Dec 10 14:30:02.037339 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58160) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:02.078269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-347c0aa1-e937-4d8f-a414-aaf9cad69730 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.166044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:02.170395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-347c0aa1-e937-4d8f-a414-aaf9cad69730 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.177839 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-342d9108-bf53-480d-9053-923c098065ee None None] Sync routers for ids ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:02.184672 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9f651af4-3abe-46b4-a574-a5fe9ee1c67e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/d18cfd99-e8a8-404e-ba1d-7e6297383bb5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7769644 Dec 10 14:30:02.188315 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58162) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:02.195110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-342d9108-bf53-480d-9053-923c098065ee None None] Routers {'d18cfd99-e8a8-404e-ba1d-7e6297383bb5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:02.195110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-342d9108-bf53-480d-9053-923c098065ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:02.197143 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:02.201123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.240291 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b2de16b-90b8-4720-aa6c-2089b042396a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.245098 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b2de16b-90b8-4720-aa6c-2089b042396a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.245098 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2b2de16b-90b8-4720-aa6c-2089b042396a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/security-groups/a7754821-56c9-4342-8d14-0e36a6c62482 HTTP/1.1" status: 204 len: 168 time: 1.0489962 Dec 10 14:30:02.269025 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-342d9108-bf53-480d-9053-923c098065ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:02.280674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-342d9108-bf53-480d-9053-923c098065ee None None] Routers {'d18cfd99-e8a8-404e-ba1d-7e6297383bb5'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:02.281545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-342d9108-bf53-480d-9053-923c098065ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:29:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:02.283428 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-023ee6c6-05e4-45fa-9eb7-863c1e903d8b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=d18cfd99-e8a8-404e-ba1d-7e6297383bb5 HTTP/1.1" status: 200 len: 205 time: 0.0931604 Dec 10 14:30:02.285064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58166) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:02.308343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.313619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db53a09b-9421-4520-bd09-3666799964c9 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.333814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-342d9108-bf53-480d-9053-923c098065ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:02.333814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-342d9108-bf53-480d-9053-923c098065ee None None] The sync data for ids ['d18cfd99-e8a8-404e-ba1d-7e6297383bb5'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:02.336002 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6ba405b9-cdef-4b06-9661-6ad5871b3c6b']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:02.354778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aaba56c6-c9a2-4aa8-9651-0a759874ef75') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:02.355088 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aaba56c6-c9a2-4aa8-9651-0a759874ef75') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:02.358494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58168) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:02.360431 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b2de16b-90b8-4720-aa6c-2089b042396a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a7754821-56c9-4342-8d14-0e36a6c62482,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:02.372972 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db53a09b-9421-4520-bd09-3666799964c9 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.379083 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.431943 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.454552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Releasing vlan 353 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:30:02.455260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:30:02.458286 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:30:02.480316 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-f73b504d-4b52-44f4-90b2-ca9c24e330a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting subnet 8bcb9694-fbbf-4a44-b94d-96729fcd88cb {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:02.513645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f73b504d-4b52-44f4-90b2-ca9c24e330a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.567186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f73b504d-4b52-44f4-90b2-ca9c24e330a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.601107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db53a09b-9421-4520-bd09-3666799964c9 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.603777 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db53a09b-9421-4520-bd09-3666799964c9 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.607324 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-db53a09b-9421-4520-bd09-3666799964c9 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/532a05e9-7905-45c8-b4f6-c1985b47060d HTTP/1.1" status: 204 len: 168 time: 0.5666032 Dec 10 14:30:02.613689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58170) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:02.636329 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.638067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db53a09b-9421-4520-bd09-3666799964c9 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=532a05e9-7905-45c8-b4f6-c1985b47060d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:02.659563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.662873 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "DELETE /v2.0/networks/6ba405b9-cdef-4b06-9661-6ad5871b3c6b HTTP/1.1" status: 204 len: 168 time: 0.9282200 Dec 10 14:30:02.675815 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58172) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:02.687638 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2df5d78-bf2c-4d9a-afdf-730775833ea8 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event deleted for resources: {'Network': ['ID=6ba405b9-cdef-4b06-9661-6ad5871b3c6b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:02.760802 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-270e1a4d-57f7-4b61-ab3a-61f5c2e464f0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.767614 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-781c3bbe-1cc8-4372-b803-3cdee8455de4 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1491930 Dec 10 14:30:02.768807 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58174) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:02.774168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-60beb17e-873b-43b6-834d-e7d785838169 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'tempest-secgroup--661706511'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:02.778507 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f73b504d-4b52-44f4-90b2-ca9c24e330a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.839019 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-898ff0f2-4929-449d-95e3-74e983f1b447 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.867512 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-39bffdb7-c913-4b17-8f29-4f8ad707dd96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.881777 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:02.882915 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-898ff0f2-4929-449d-95e3-74e983f1b447 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.892329 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-347c0aa1-e937-4d8f-a414-aaf9cad69730 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.910808 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-60beb17e-873b-43b6-834d-e7d785838169 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.914739 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:02.920949 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 30a7dd75-40a3-4217-b865-3e2c1a7d91c9 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:02.920949 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device af294fd1-c085-4a25-98af-b92ec5593a0f no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:02.946003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: af294fd1-c085-4a25-98af-b92ec5593a0f {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:02.948823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device af294fd1-c085-4a25-98af-b92ec5593a0f not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:02.949470 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ff2510f2-1fbc-421d-9e12-5288c583fecd no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:02.957824 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-270e1a4d-57f7-4b61-ab3a-61f5c2e464f0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.960874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347c0aa1-e937-4d8f-a414-aaf9cad69730 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=d6c1a1b5-c637-472c-8aa6-1c82a185f10f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:02.963393 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-270e1a4d-57f7-4b61-ab3a-61f5c2e464f0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.966267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f73b504d-4b52-44f4-90b2-ca9c24e330a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.973664 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-347c0aa1-e937-4d8f-a414-aaf9cad69730 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:02.977397 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-347c0aa1-e937-4d8f-a414-aaf9cad69730 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/d6c1a1b5-c637-472c-8aa6-1c82a185f10f HTTP/1.1" status: 204 len: 168 time: 1.0361745 Dec 10 14:30:02.982978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58176) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:02.993544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95421f25-0a1d-4d41-9325-b9d6b547032e None None] Network 6982e3bb-2870-47ed-a8be-b1e2c31f4490 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:02.996075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: ff2510f2-1fbc-421d-9e12-5288c583fecd {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:02.996508 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ff2510f2-1fbc-421d-9e12-5288c583fecd not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:03.004157 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f73b504d-4b52-44f4-90b2-ca9c24e330a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.011215 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f73b504d-4b52-44f4-90b2-ca9c24e330a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/subnets/8bcb9694-fbbf-4a44-b94d-96729fcd88cb HTTP/1.1" status: 204 len: 168 time: 0.6513584 Dec 10 14:30:03.023292 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58178) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:03.032498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f73b504d-4b52-44f4-90b2-ca9c24e330a4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Subnet': ['ID=8bcb9694-fbbf-4a44-b94d-96729fcd88cb,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:03.049294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-932f49ff-b477-4d88-97c2-e2c6224d0cdc None None] Network b44c5886-b77e-456d-b9b8-db5350758724 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:03.051793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-898ff0f2-4929-449d-95e3-74e983f1b447 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.054707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-898ff0f2-4929-449d-95e3-74e983f1b447 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.055920 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-898ff0f2-4929-449d-95e3-74e983f1b447 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] 10.222.0.57 "DELETE /v2.0/security-groups/3c07f7e7-ccab-408a-a625-67551419384e HTTP/1.1" status: 204 len: 168 time: 0.3770647 Dec 10 14:30:03.115174 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-898ff0f2-4929-449d-95e3-74e983f1b447 tempest-TestNetworkAdvancedServerOps-2039379578 tempest-TestNetworkAdvancedServerOps-2039379578-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c07f7e7-ccab-408a-a625-67551419384e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:03.135979 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.146976 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-60beb17e-873b-43b6-834d-e7d785838169 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.155169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.234734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:03.235411 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.265497 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-270e1a4d-57f7-4b61-ab3a-61f5c2e464f0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.266199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-270e1a4d-57f7-4b61-ab3a-61f5c2e464f0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Fanout notify agent at l3_agent the message router_deleted on router d18cfd99-e8a8-404e-ba1d-7e6297383bb5 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:30:03.283355 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-270e1a4d-57f7-4b61-ab3a-61f5c2e464f0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.284613 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-270e1a4d-57f7-4b61-ab3a-61f5c2e464f0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/d18cfd99-e8a8-404e-ba1d-7e6297383bb5 HTTP/1.1" status: 204 len: 168 time: 0.9941225 Dec 10 14:30:03.287648 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58184) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:03.288661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-60beb17e-873b-43b6-834d-e7d785838169 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.301592 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3fa3b7e-acd1-4cee-ab5c-e0affd96b86d None None] DHCP port deletion for 6982e3bb-2870-47ed-a8be-b1e2c31f4490 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:03.352764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64874f5a-b998-4548-98a6-3f01a57cdd42 None None] DHCP port deletion for b44c5886-b77e-456d-b9b8-db5350758724 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:03.365919 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] For port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c,segment=NetworkSegment(3ba2753c-a063-4477-be40-7f77ed730510),segment_id=3ba2753c-a063-4477-be40-7f77ed730510)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:03.366306 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.368881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60beb17e-873b-43b6-834d-e7d785838169 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=52c2c8f5-c4fa-46cb-a2e8-d8c97b17fcc5,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:03.391738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:03.417822 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e3fa3b7e-acd1-4cee-ab5c-e0affd96b86d None None] Deleting port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:03.418205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e3fa3b7e-acd1-4cee-ab5c-e0affd96b86d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.431001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-f05e9a05-3547-4cee-a70f-fec0b8403d43 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting subnet c9398767-cec9-48fd-bdd3-815a3b0bab44 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:03.432243 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-64874f5a-b998-4548-98a6-3f01a57cdd42 None None] Deleting port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:03.432623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-64874f5a-b998-4548-98a6-3f01a57cdd42 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.439057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f05e9a05-3547-4cee-a70f-fec0b8403d43 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.449469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-60beb17e-873b-43b6-834d-e7d785838169 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.453545 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-60beb17e-873b-43b6-834d-e7d785838169 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.6814544 Dec 10 14:30:03.453698 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58186) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:03.458089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f4dfe028-f44c-415e-b377-fcd5b780b32a tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '52c2c8f5-c4fa-46cb-a2e8-d8c97b17fcc5', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:03.458940 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-f4dfe028-f44c-415e-b377-fcd5b780b32a tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Dec 10 14:30:03.459440 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-f4dfe028-f44c-415e-b377-fcd5b780b32a tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:03.463133 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f4dfe028-f44c-415e-b377-fcd5b780b32a tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0058346 Dec 10 14:30:03.463133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58188) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:03.468716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-64eaf0bb-197c-4794-b0d5-d5eb445505a1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '52c2c8f5-c4fa-46cb-a2e8-d8c97b17fcc5', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:03.469377 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-64eaf0bb-197c-4794-b0d5-d5eb445505a1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Dec 10 14:30:03.469882 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-64eaf0bb-197c-4794-b0d5-d5eb445505a1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:03.470881 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-64eaf0bb-197c-4794-b0d5-d5eb445505a1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0069346 Dec 10 14:30:03.473619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58190) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:03.479379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f3412d11-8c02-404f-bbe3-221341241f8b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '52c2c8f5-c4fa-46cb-a2e8-d8c97b17fcc5', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:03.480425 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-f3412d11-8c02-404f-bbe3-221341241f8b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Dec 10 14:30:03.480906 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-f3412d11-8c02-404f-bbe3-221341241f8b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:03.482037 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f3412d11-8c02-404f-bbe3-221341241f8b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0073566 Dec 10 14:30:03.488572 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58192) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:03.492282 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:03.492624 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.493396 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-770da93d-26f2-413d-aaae-68fb053d0737 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '52c2c8f5-c4fa-46cb-a2e8-d8c97b17fcc5', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '256'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:03.494715 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-770da93d-26f2-413d-aaae-68fb053d0737 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Dec 10 14:30:03.495317 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-770da93d-26f2-413d-aaae-68fb053d0737 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:03.495689 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f05e9a05-3547-4cee-a70f-fec0b8403d43 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.499045 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-770da93d-26f2-413d-aaae-68fb053d0737 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0070870 Dec 10 14:30:03.499298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58194) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:03.540291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e3fa3b7e-acd1-4cee-ab5c-e0affd96b86d None None] For port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c,segment=NetworkSegment(3ba2753c-a063-4477-be40-7f77ed730510),segment_id=3ba2753c-a063-4477-be40-7f77ed730510)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:03.540618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e3fa3b7e-acd1-4cee-ab5c-e0affd96b86d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.551244 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-64874f5a-b998-4548-98a6-3f01a57cdd42 None None] For port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ea1ccf81-23a5-41dd-8e9b-8ee0568b069e,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:03.551639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-64874f5a-b998-4548-98a6-3f01a57cdd42 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.564576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-e3fa3b7e-acd1-4cee-ab5c-e0affd96b86d None None] Calling delete_port for 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:03.571225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-64874f5a-b998-4548-98a6-3f01a57cdd42 None None] Calling delete_port for ea1ccf81-23a5-41dd-8e9b-8ee0568b069e owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:03.575342 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.618138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.657012 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:03.665029 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No DVR routers for this DVR port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:03.676991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:03.684667 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=ea1ccf81-23a5-41dd-8e9b-8ee0568b069e,segment=NetworkSegment(3298319f-ed8b-45f9-8ce9-abfd3a6af445),segment_id=3298319f-ed8b-45f9-8ce9-abfd3a6af445)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:03.685344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.700265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:03.710706 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:03.711306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.711557 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e3fa3b7e-acd1-4cee-ab5c-e0affd96b86d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.716333 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for ea1ccf81-23a5-41dd-8e9b-8ee0568b069e owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:03.726435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3fa3b7e-acd1-4cee-ab5c-e0affd96b86d None None] No DVR routers for this DVR port 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:03.739063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=3f1b52c4-4951-4b16-bcdc-430200350dcd,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:03.766570 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8203e625-f182-4957-8cb0-c261a08fee8a None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:03.770593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3fa3b7e-acd1-4cee-ab5c-e0affd96b86d None None] Pushing event deleted for resources: {'Port': ['ID=86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:03.780807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.781160 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.782114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.782931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.784074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.784396 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.784724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.785026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.785808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.786156 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.789723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.789723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.789723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.789723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:03.810164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6982e3bb-2870-47ed-a8be-b1e2c31f4490']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:03.815395 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-64874f5a-b998-4548-98a6-3f01a57cdd42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.822540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3ba2753c-a063-4477-be40-7f77ed730510') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:03.822847 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3ba2753c-a063-4477-be40-7f77ed730510') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:03.834033 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.842476 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e46e417d-c8d2-4e23-b344-81da416f95e1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.850105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.855507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64874f5a-b998-4548-98a6-3f01a57cdd42 None None] Pushing event deleted for resources: {'Port': ['ID=ea1ccf81-23a5-41dd-8e9b-8ee0568b069e,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:03.856539 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64874f5a-b998-4548-98a6-3f01a57cdd42 None None] No DVR routers for this DVR port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:03.867848 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Releasing vlan 377 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:30:03.867848 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.870374 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f05e9a05-3547-4cee-a70f-fec0b8403d43 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:30:03.871723 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:30:03.921542 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f57c57e1-e6b9-471a-a9f3-439d27dda220 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 2.3789451 Dec 10 14:30:03.921542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58198) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:03.929516 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '3f1b52c4-4951-4b16-bcdc-430200350dcd'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:03.930737 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.934940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58200) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:03.937137 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e46e417d-c8d2-4e23-b344-81da416f95e1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:03.943911 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a12b6637-bf4c-443e-b380-c7313eb6b3b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-1629308865', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:04.027971 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.034452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.054595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.058103 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/networks/6982e3bb-2870-47ed-a8be-b1e2c31f4490 HTTP/1.1" status: 204 len: 168 time: 1.0709970 Dec 10 14:30:04.059021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5633781a-f777-415c-a9a5-c6089357bcc8 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Network': ['ID=6982e3bb-2870-47ed-a8be-b1e2c31f4490,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:04.062578 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58204) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:04.064966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=ea1ccf81-23a5-41dd-8e9b-8ee0568b069e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:04.067170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] No DVR routers for this DVR port ea1ccf81-23a5-41dd-8e9b-8ee0568b069e on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:04.120296 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f87a4a4-916a-41d5-9cf2-6124a2f6743a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:04.121724 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2f87a4a4-916a-41d5-9cf2-6124a2f6743a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/c93cdb3c-f190-4d12-85d0-6fafb9086b92 HTTP/1.1" status: 200 len: 845 time: 0.0578475 Dec 10 14:30:04.125366 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58206) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:04.133763 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/3f1b52c4-4951-4b16-bcdc-430200350dcd/d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:04.160462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a12b6637-bf4c-443e-b380-c7313eb6b3b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.161503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a12b6637-bf4c-443e-b380-c7313eb6b3b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.171348 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0efd4fea-186d-448a-85af-71b943331f63 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/c93cdb3c-f190-4d12-85d0-6fafb9086b92?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0447702 Dec 10 14:30:04.175555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58208) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:04.183032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:04.187432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.189833 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e46e417d-c8d2-4e23-b344-81da416f95e1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.192355 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e46e417d-c8d2-4e23-b344-81da416f95e1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.195874 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e46e417d-c8d2-4e23-b344-81da416f95e1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/52c2c8f5-c4fa-46cb-a2e8-d8c97b17fcc5 HTTP/1.1" status: 204 len: 168 time: 0.6932685 Dec 10 14:30:04.195874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f05e9a05-3547-4cee-a70f-fec0b8403d43 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.200868 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58210) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:04.278225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f05e9a05-3547-4cee-a70f-fec0b8403d43 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Subnet': ['ID=c9398767-cec9-48fd-bdd3-815a3b0bab44,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:04.281097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e46e417d-c8d2-4e23-b344-81da416f95e1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=52c2c8f5-c4fa-46cb-a2e8-d8c97b17fcc5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:04.283475 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f05e9a05-3547-4cee-a70f-fec0b8403d43 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.287052 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f05e9a05-3547-4cee-a70f-fec0b8403d43 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/c9398767-cec9-48fd-bdd3-815a3b0bab44 HTTP/1.1" status: 204 len: 168 time: 0.9931929 Dec 10 14:30:04.292107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cea1d39d-ff7e-43b3-911c-ea3b72c1f7c7 None None] Network 5dc6676b-2ea0-4f66-8344-f1b50cefe135 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:04.294656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58212) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:04.296291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.302680 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3a4d030e-bdb7-412f-9a5f-31584442a2b6 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=37199cbe89a04c3096fd8e1d31a3df63&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3780124 Dec 10 14:30:04.302680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b44c5886-b77e-456d-b9b8-db5350758724']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:04.311637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58214) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:04.351080 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3298319f-ed8b-45f9-8ce9-abfd3a6af445') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:04.351379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3298319f-ed8b-45f9-8ce9-abfd3a6af445') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:04.360593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a12b6637-bf4c-443e-b380-c7313eb6b3b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.362883 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:04.366567 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.378706 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.396607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.415800 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e323130f-9d6e-456e-9941-ef0ed3f9bd42 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.2002945 Dec 10 14:30:04.418610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58216) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:04.420340 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.423604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-27ddd30e-82ca-4963-a789-692f7534da90 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'tempest-secgroup--612477490'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:04.426416 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a12b6637-bf4c-443e-b380-c7313eb6b3b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.437310 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Releasing vlan 356 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:30:04.437713 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:30:04.440918 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:30:04.450192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-85c1cc77-0f38-428d-9af8-5613ebad5218 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting subnet 57c9ba11-01e5-45c5-9332-cfdfee1d754c {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:04.450395 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:04.457873 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:04.464296 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:04.466907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85c1cc77-0f38-428d-9af8-5613ebad5218 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.478540 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Pushing event updated for resources: {'Port': ['ID=d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:04.515547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1b8471ba-0a66-4ee4-9688-cedf82f0aece admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.540299 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1b8471ba-0a66-4ee4-9688-cedf82f0aece admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.541774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85c1cc77-0f38-428d-9af8-5613ebad5218 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.549087 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Attempting to bind port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:04.549980 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Attempting to bind port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:04.550393 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Attempting to bind port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:04.557037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:04.557999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:04.558426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.558972 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:04.560051 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Bound port: d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:04.560306 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.585486 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f79fd1b-e436-41d3-86d7-cd5ade557b88 None None] DHCP port deletion for 5dc6676b-2ea0-4f66-8344-f1b50cefe135 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:04.585710 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-27ddd30e-82ca-4963-a789-692f7534da90 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.612204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.623131 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.628459 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/networks/b44c5886-b77e-456d-b9b8-db5350758724 HTTP/1.1" status: 204 len: 168 time: 1.6003556 Dec 10 14:30:04.632497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58218) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:04.639350 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39276f14-d353-482e-98e1-a763891f1439 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Network': ['ID=b44c5886-b77e-456d-b9b8-db5350758724,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:04.661256 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a12b6637-bf4c-443e-b380-c7313eb6b3b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.664762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] For port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:04.665901 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a12b6637-bf4c-443e-b380-c7313eb6b3b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.7254643 Dec 10 14:30:04.669199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58220) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:04.669334 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] For port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:04.679825 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1f79fd1b-e436-41d3-86d7-cd5ade557b88 None None] Deleting port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:04.680192 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1f79fd1b-e436-41d3-86d7-cd5ade557b88 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.717826 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1b8471ba-0a66-4ee4-9688-cedf82f0aece admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.720734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1b8471ba-0a66-4ee4-9688-cedf82f0aece admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.724601 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1b8471ba-0a66-4ee4-9688-cedf82f0aece admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/268d619f-a8f5-4162-9742-e85ecde84026 HTTP/1.1" status: 204 len: 168 time: 0.4095001 Dec 10 14:30:04.747389 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.763089 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b8471ba-0a66-4ee4-9688-cedf82f0aece admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=268d619f-a8f5-4162-9742-e85ecde84026,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:04.805412 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85c1cc77-0f38-428d-9af8-5613ebad5218 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.870399 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1f79fd1b-e436-41d3-86d7-cd5ade557b88 None None] For port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db,segment=NetworkSegment(97a96e15-5d5f-4994-a371-e42623166e47),segment_id=97a96e15-5d5f-4994-a371-e42623166e47)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:04.871050 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1f79fd1b-e436-41d3-86d7-cd5ade557b88 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.907575 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ea1ccf81-23a5-41dd-8e9b-8ee0568b069e no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:04.945852 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: ea1ccf81-23a5-41dd-8e9b-8ee0568b069e {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:04.946996 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device ea1ccf81-23a5-41dd-8e9b-8ee0568b069e not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:04.947629 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:04.950862 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1f79fd1b-e436-41d3-86d7-cd5ade557b88 None None] Calling delete_port for 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:04.958974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-27ddd30e-82ca-4963-a789-692f7534da90 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:04.996729 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:04.997256 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 86bfd0e3-fc3d-4ca6-9edf-c8f19472df7c not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:04.997897 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:05.001898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb436dbf-154d-4fa5-b85c-0eb9d6dca55b None None] Pushing event updated for resources: {'Port': ['ID=d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:05.007223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.040315 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-27ddd30e-82ca-4963-a789-692f7534da90 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.090795 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.134638 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:05.146405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:05.148438 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85c1cc77-0f38-428d-9af8-5613ebad5218 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.153657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:05.154265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.163868 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72d8a5bd-e903-490e-b14c-172c2b5a803f None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:05.181325 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-27ddd30e-82ca-4963-a789-692f7534da90 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.184428 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-27ddd30e-82ca-4963-a789-692f7534da90 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.7628200 Dec 10 14:30:05.190249 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-001f80ef-b55a-4348-99db-c824d23472e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.194494 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58226) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:05.200181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 59d5a417-7a75-46c3-bc8b-07e55522cde2 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:05.200536 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.201519 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a5afcec5-e7d9-4ffa-8d4a-66eab452506b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '473a2d9c-5033-4047-8fef-b78aea011649', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:05.202160 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-a5afcec5-e7d9-4ffa-8d4a-66eab452506b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 10 14:30:05.202803 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-a5afcec5-e7d9-4ffa-8d4a-66eab452506b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:05.204331 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a5afcec5-e7d9-4ffa-8d4a-66eab452506b tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0082932 Dec 10 14:30:05.207481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58228) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:05.217374 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-998ddfeb-6f6d-4cf2-8793-bd922a8a0751 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '473a2d9c-5033-4047-8fef-b78aea011649', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:05.220508 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85c1cc77-0f38-428d-9af8-5613ebad5218 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.229927 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-85c1cc77-0f38-428d-9af8-5613ebad5218 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/57c9ba11-01e5-45c5-9332-cfdfee1d754c HTTP/1.1" status: 204 len: 168 time: 0.9310257 Dec 10 14:30:05.239969 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27ddd30e-82ca-4963-a789-692f7534da90 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=473a2d9c-5033-4047-8fef-b78aea011649,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:05.242074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58230) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:05.250586 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=841961b3-9ee9-4d7d-b2cb-7813b58c2992,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:05.320281 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f28e15ce-a233-4be5-86c7-adb2d3449841 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1410465 Dec 10 14:30:05.320281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c1cc77-0f38-428d-9af8-5613ebad5218 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Subnet': ['ID=57c9ba11-01e5-45c5-9332-cfdfee1d754c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:05.345164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58232) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:05.424839 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8120887-5ad6-43c8-8166-ba504980822c None None] Network 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:05.449241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1f79fd1b-e436-41d3-86d7-cd5ade557b88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.473345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db update to DOWN by agent not found {{(pid=103812) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 10 14:30:05.523798 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::1 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/3f1b52c4-4951-4b16-bcdc-430200350dcd/fe4bc503-ed57-4abe-9148-349563a6b76d) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:05.530999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f79fd1b-e436-41d3-86d7-cd5ade557b88 None None] Pushing event deleted for resources: {'Port': ['ID=8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:05.536438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f79fd1b-e436-41d3-86d7-cd5ade557b88 None None] No DVR routers for this DVR port 8bbf3e86-ebc8-4dc9-9d91-8fa8ca41b4db on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:05.553046 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-998ddfeb-6f6d-4cf2-8793-bd922a8a0751 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:05.553046 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-998ddfeb-6f6d-4cf2-8793-bd922a8a0751 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.3429747 Dec 10 14:30:05.557124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58234) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:05.570061 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-5ec9e327-e8eb-43bc-85e9-0bc7d2f30bf6 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '473a2d9c-5033-4047-8fef-b78aea011649', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:05.570553 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-5ec9e327-e8eb-43bc-85e9-0bc7d2f30bf6 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Dec 10 14:30:05.571215 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-5ec9e327-e8eb-43bc-85e9-0bc7d2f30bf6 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:05.572230 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5ec9e327-e8eb-43bc-85e9-0bc7d2f30bf6 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0140910 Dec 10 14:30:05.576226 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58236) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:05.592851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c7b0254f-4077-45dc-8355-50c5c8846dd1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '473a2d9c-5033-4047-8fef-b78aea011649', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:05.670146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-62f6936a-4052-4c55-a4da-5b8b8be326f4', 'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'project_id': 'cc793beea85f4cf887a3485aad20d8e7', 'fixed_ips': [{'subnet_id': '841961b3-9ee9-4d7d-b2cb-7813b58c2992'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:05.671283 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.700247 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58238) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:05.716478 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-35a82be6-cb3b-4492-88e7-be268c11bca9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.742230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.774545 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-212a962c-5048-4603-84aa-b5ce5833c7da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'security_group': {'name': 'tempest-secgroup-1959650403'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:05.803179 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.809101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-755149b7-789f-40eb-874d-c2de57cf49de None None] DHCP port deletion for 96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:05.836462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.836784 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.849245 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-35a82be6-cb3b-4492-88e7-be268c11bca9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.870058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 59d5a417-7a75-46c3-bc8b-07e55522cde2 owned by network:floatingip {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:05.875034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.898769 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:05.921200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Allocated IP 2001:db8::2 (62f6936a-4052-4c55-a4da-5b8b8be326f4/841961b3-9ee9-4d7d-b2cb-7813b58c2992/a9806abc-452a-4508-9309-5d82a1b98504) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:05.921472 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:05.928205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:05.928406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.930655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-35a82be6-cb3b-4492-88e7-be268c11bca9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.930945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-212a962c-5048-4603-84aa-b5ce5833c7da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:05.931083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-755149b7-789f-40eb-874d-c2de57cf49de None None] Deleting port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:05.931434 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-755149b7-789f-40eb-874d-c2de57cf49de None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.006430 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35a82be6-cb3b-4492-88e7-be268c11bca9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7eeb12d-694d-4760-b714-c0353daf1666,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:06.008848 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.036165 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-c7b0254f-4077-45dc-8355-50c5c8846dd1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:06.037219 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c7b0254f-4077-45dc-8355-50c5c8846dd1 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.4600530 Dec 10 14:30:06.037989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=fe4bc503-ed57-4abe-9148-349563a6b76d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:06.047593 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58240) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:06.056301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-755149b7-789f-40eb-874d-c2de57cf49de None None] For port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=4fb240d1-b7b1-4215-bb8c-7e0a4ba97718,segment=NetworkSegment(32df60c7-bd5d-4255-99ac-f954bb095ea6),segment_id=32df60c7-bd5d-4255-99ac-f954bb095ea6)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:06.056763 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-755149b7-789f-40eb-874d-c2de57cf49de None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.065653 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f7b88bea-3e14-4dc2-b0f1-fa2d5ee97228 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '473a2d9c-5033-4047-8fef-b78aea011649', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:06.066499 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-f7b88bea-3e14-4dc2-b0f1-fa2d5ee97228 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 10 14:30:06.067222 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-f7b88bea-3e14-4dc2-b0f1-fa2d5ee97228 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:06.069032 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f7b88bea-3e14-4dc2-b0f1-fa2d5ee97228 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0076461 Dec 10 14:30:06.081237 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58242) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:06.082961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-81d8b9d5-eb8f-4db7-9abe-5f043cce3af0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '473a2d9c-5033-4047-8fef-b78aea011649', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:06.092653 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-35a82be6-cb3b-4492-88e7-be268c11bca9 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=4fbe814cf87449c2a512178d3ffad23e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3912849 Dec 10 14:30:06.095675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5dc6676b-2ea0-4f66-8344-f1b50cefe135']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:06.096628 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58244) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:06.099953 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-755149b7-789f-40eb-874d-c2de57cf49de None None] Calling delete_port for 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:06.119388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '97a96e15-5d5f-4994-a371-e42623166e47') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:06.119646 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '97a96e15-5d5f-4994-a371-e42623166e47') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:06.138967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.171584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-65bae2a2-680a-4a76-885f-d2601dbea2c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.179118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.198481 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Releasing vlan 361 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:30:06.198997 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:30:06.204098 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:30:06.212228 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-65bae2a2-680a-4a76-885f-d2601dbea2c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.261718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.263524 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-212a962c-5048-4603-84aa-b5ce5833c7da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.279501 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.280860 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.329078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-212a962c-5048-4603-84aa-b5ce5833c7da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.374104 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-212a962c-5048-4603-84aa-b5ce5833c7da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8a59bf20-1db3-4baf-93fe-81ce7aa4ae63,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:06.387190 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.389551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.395276 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.402084 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/networks/5dc6676b-2ea0-4f66-8344-f1b50cefe135 HTTP/1.1" status: 204 len: 168 time: 1.1547949 Dec 10 14:30:06.404933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58246) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:06.425324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b437886-f9c8-44da-b344-55c1fc83fda2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Network': ['ID=5dc6676b-2ea0-4f66-8344-f1b50cefe135,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:06.431382 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-755149b7-789f-40eb-874d-c2de57cf49de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.446570 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:06.453744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:06.458819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:06.471970 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-81d8b9d5-eb8f-4db7-9abe-5f043cce3af0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:06.473240 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-81d8b9d5-eb8f-4db7-9abe-5f043cce3af0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.3963375 Dec 10 14:30:06.476458 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58248) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:06.477336 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-65bae2a2-680a-4a76-885f-d2601dbea2c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.483919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-65bae2a2-680a-4a76-885f-d2601dbea2c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.484053 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.484175 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-65bae2a2-680a-4a76-885f-d2601dbea2c1 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/e7eeb12d-694d-4760-b714-c0353daf1666 HTTP/1.1" status: 204 len: 168 time: 0.3838384 Dec 10 14:30:06.487005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-212a962c-5048-4603-84aa-b5ce5833c7da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.487977 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-212a962c-5048-4603-84aa-b5ce5833c7da tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 1.1388586 Dec 10 14:30:06.488117 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0564e771-b6a4-46f1-92c8-1b97beee85ab tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '473a2d9c-5033-4047-8fef-b78aea011649', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:06.488657 dv-neutron-821401-2-hyperv neutron-server[103811]: WARNING neutron.api.v2.base [None req-0564e771-b6a4-46f1-92c8-1b97beee85ab tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Dec 10 14:30:06.489611 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-0564e771-b6a4-46f1-92c8-1b97beee85ab tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:06.492907 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0564e771-b6a4-46f1-92c8-1b97beee85ab tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0078466 Dec 10 14:30:06.492907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58252) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:06.493458 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58254) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:06.500416 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-755149b7-789f-40eb-874d-c2de57cf49de None None] No DVR routers for this DVR port 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:06.508310 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e07dad78-ff65-47ab-93c9-f93866b01071 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'security_group': {'name': 'tempest-secgroup-1169598365'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:06.509254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9ae1b7f3-ba4c-4599-893e-ae229b342229 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '473a2d9c-5033-4047-8fef-b78aea011649', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:06.529511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65bae2a2-680a-4a76-885f-d2601dbea2c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7eeb12d-694d-4760-b714-c0353daf1666,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:06.552641 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Pushing event updated for resources: {'Port': ['ID=a9806abc-452a-4508-9309-5d82a1b98504,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:06.563908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Attempting to bind port a9806abc-452a-4508-9309-5d82a1b98504 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:06.564275 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Attempting to bind port a9806abc-452a-4508-9309-5d82a1b98504 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'f87ad518-f300-4f42-a1a0-01a3d390e144', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:06.565193 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Attempting to bind port a9806abc-452a-4508-9309-5d82a1b98504 on network 62f6936a-4052-4c55-a4da-5b8b8be326f4 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:06.566751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=59d5a417-7a75-46c3-bc8b-07e55522cde2,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:06.589602 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.631232 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 29, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:06.631819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Checking segment: {'id': 'f87ad518-f300-4f42-a1a0-01a3d390e144', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:06.632167 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.632583 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Bound using segment: {'id': 'f87ad518-f300-4f42-a1a0-01a3d390e144', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:06.633334 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Bound port: a9806abc-452a-4508-9309-5d82a1b98504, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f87ad518-f300-4f42-a1a0-01a3d390e144', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:06.633917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.637399 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e07dad78-ff65-47ab-93c9-f93866b01071 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.656020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-755149b7-789f-40eb-874d-c2de57cf49de None None] Pushing event deleted for resources: {'Port': ['ID=4fb240d1-b7b1-4215-bb8c-7e0a4ba97718,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:06.698882 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.699105 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Floating IP 17a6f7a3-9b53-4a18-b1cf-56e4db4be95c disassociated (deleted). External IP: 172.26.2.24, port: a0f8cb62-50c9-49f8-bbab-6c182aabaf0e. Dec 10 14:30:06.708621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6911531c-6939-4d8f-88ed-09a279451fa3 None None] Provisioning complete for port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:06.708901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6911531c-6939-4d8f-88ed-09a279451fa3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.781063 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] For port a9806abc-452a-4508-9309-5d82a1b98504, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:06.787998 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] For port a9806abc-452a-4508-9309-5d82a1b98504, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a9806abc-452a-4508-9309-5d82a1b98504,segment=NetworkSegment(f87ad518-f300-4f42-a1a0-01a3d390e144),segment_id=f87ad518-f300-4f42-a1a0-01a3d390e144)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:06.796781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.817469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.854019 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:06.871658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '32df60c7-bd5d-4255-99ac-f954bb095ea6') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:06.874547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '32df60c7-bd5d-4255-99ac-f954bb095ea6') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:06.877348 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e07dad78-ff65-47ab-93c9-f93866b01071 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.881455 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.887974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.899006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.899803 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.901488 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-9ae1b7f3-ba4c-4599-893e-ae229b342229 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:06.902815 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9ae1b7f3-ba4c-4599-893e-ae229b342229 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.4057286 Dec 10 14:30:06.906712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58256) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:06.915574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8c006348-62ab-44fa-8dc1-1fd9aac7922e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '473a2d9c-5033-4047-8fef-b78aea011649', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:06.931440 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.932403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6911531c-6939-4d8f-88ed-09a279451fa3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.944582 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Releasing vlan 396 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:30:06.948760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:30:06.966543 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:30:06.973971 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:07.014157 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=fe4bc503-ed57-4abe-9148-349563a6b76d,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:07.042283 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e07dad78-ff65-47ab-93c9-f93866b01071 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.042412 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-284fcb47-94e1-4484-bc4a-3f3c439fdfa7 None None] Pushing event updated for resources: {'Port': ['ID=a9806abc-452a-4508-9309-5d82a1b98504,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:07.052158 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-6911531c-6939-4d8f-88ed-09a279451fa3 None None] For port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:07.100913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:07.101628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.137513 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e07dad78-ff65-47ab-93c9-f93866b01071 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b663ace5-e143-4bc5-ba5c-5c7dd4dac641,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:07.188195 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6911531c-6939-4d8f-88ed-09a279451fa3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.202942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:07.206149 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:07.298118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9d7899bb-a9e2-467f-bfc6-02634a8598ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:07.422450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6911531c-6939-4d8f-88ed-09a279451fa3 None None] Pushing event updated for resources: {'Port': ['ID=d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:07.429075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.458098 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.470053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-eb2b26ef-51cc-4cc6-9a6f-7f784a702a81 None None] Provisioning complete for port fe4bc503-ed57-4abe-9148-349563a6b76d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:07.478975 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-eb2b26ef-51cc-4cc6-9a6f-7f784a702a81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.479139 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/networks/96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5 HTTP/1.1" status: 204 len: 168 time: 1.0692873 Dec 10 14:30:07.479253 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e07dad78-ff65-47ab-93c9-f93866b01071 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.484501 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e07dad78-ff65-47ab-93c9-f93866b01071 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.9785357 Dec 10 14:30:07.489066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58258) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:07.489514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58260) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:07.503380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1881023334', 'security_groups': ['b663ace5-e143-4bc5-ba5c-5c7dd4dac641'], 'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '841961b3-9ee9-4d7d-b2cb-7813b58c2992'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:07.519167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'network': {'name': 'tempest-RoutersTest-1064372883'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:07.556292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Network': ['ID=96ea494c-3f28-4ad7-83d9-25cbfb5a4ae5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:07.569073 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-8c006348-62ab-44fa-8dc1-1fd9aac7922e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:07.570350 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8c006348-62ab-44fa-8dc1-1fd9aac7922e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.6588981 Dec 10 14:30:07.579222 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58262) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:07.601148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.601148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.601148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.601148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.601656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.605102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-eb2b26ef-51cc-4cc6-9a6f-7f784a702a81 None None] Port fe4bc503-ed57-4abe-9148-349563a6b76d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:07.605742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.606309 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.608122 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.608654 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.610103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.610615 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.613446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.613984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b01bd93a-2f4e-4673-8add-109844788b6c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:07.640226 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:07.672206 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:07.679495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.683646 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] Sync routers for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:07.705871 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:07.710225 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:07.712415 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.719101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:07.721944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 4fb240d1-b7b1-4215-bb8c-7e0a4ba97718 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:07.728699 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dcf29bb7-6286-4e74-8ed1-012b8b06d94d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/floatingips/17a6f7a3-9b53-4a18-b1cf-56e4db4be95c HTTP/1.1" status: 204 len: 168 time: 3.0946150 Dec 10 14:30:07.757404 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:30:07.759504 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:07.766787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9da131d4-cce4-4055-a2dc-d3ec47493f0f" -d '{"events": [{"name": "network-changed", "server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:30:07.776092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.779167 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4aaa2d02-84d5-46c3-9b02-ef39264b5c8e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.833064 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4aaa2d02-84d5-46c3-9b02-ef39264b5c8e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.845115 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-282a00b9-d698-450a-a15e-127e30948c7e None None] Provisioning complete for port fe4bc503-ed57-4abe-9148-349563a6b76d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:07.847755 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-282a00b9-d698-450a-a15e-127e30948c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.858922 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] vlan segment allocate from pool success with {'vlan_id': 389, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:30:07.871372 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:07.873019 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.876381 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added segment 9a435957-a659-4401-92bd-6645ad45c2ae of type vlan for network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 Dec 10 14:30:07.929333 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-282a00b9-d698-450a-a15e-127e30948c7e None None] Port fe4bc503-ed57-4abe-9148-349563a6b76d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:07.946889 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.953787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:07.995239 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4aaa2d02-84d5-46c3-9b02-ef39264b5c8e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:07.998141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4aaa2d02-84d5-46c3-9b02-ef39264b5c8e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.000165 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4aaa2d02-84d5-46c3-9b02-ef39264b5c8e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/473a2d9c-5033-4047-8fef-b78aea011649 HTTP/1.1" status: 204 len: 168 time: 0.4120119 Dec 10 14:30:08.004031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58270) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:08.040533 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Router 368ea4de-3a8a-4a6b-b781-39affd032ba1 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:30:08.050008 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aaa2d02-84d5-46c3-9b02-ef39264b5c8e tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=473a2d9c-5033-4047-8fef-b78aea011649,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:08.085258 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9f91cf48-3fab-42f7-b9f2-292b8ce8aa0f tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0788753 Dec 10 14:30:08.086310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58272) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:08.094709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d791ea64-482f-4607-9c53-63ae68469fb0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'tempest-secgroup--1385185918'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:08.144843 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:30:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3150f3f4-5df0-4c2f-9b32-443c8e770774 x-openstack-request-id: req-3150f3f4-5df0-4c2f-9b32-443c8e770774 {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:30:08.145147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:30:08.145405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-3150f3f4-5df0-4c2f-9b32-443c8e770774 {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:30:08.146863 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'status': 'completed', 'code': 200} Dec 10 14:30:08.193486 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:29:52Z', 'revision_number': 6, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:08.200965 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d791ea64-482f-4607-9c53-63ae68469fb0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.222934 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] Checking router: 9d7899bb-a9e2-467f-bfc6-02634a8598ca for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:08.235801 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:08.237106 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:08.344341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d791ea64-482f-4607-9c53-63ae68469fb0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.399422 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:08.410285 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d791ea64-482f-4607-9c53-63ae68469fb0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.448171 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d791ea64-482f-4607-9c53-63ae68469fb0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b20bb624-6c27-4bf8-ac37-1bb23ec69450,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:08.511588 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d791ea64-482f-4607-9c53-63ae68469fb0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.515650 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d791ea64-482f-4607-9c53-63ae68469fb0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4247270 Dec 10 14:30:08.515924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58276) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:08.521869 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4e071588-b849-4c0f-8ea8-af7fdfcae49c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': 'b20bb624-6c27-4bf8-ac37-1bb23ec69450', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'bad_group_id'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:08.627380 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:08.629976 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:29:52Z', 'revision_number': 6, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:08.638727 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a0fa98a6-6f15-4454-b95a-03eecf3a21d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "PUT /v2.0/routers/368ea4de-3a8a-4a6b-b781-39affd032ba1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9681976 Dec 10 14:30:08.638897 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Sync routers for ids ['368ea4de-3a8a-4a6b-b781-39affd032ba1'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:08.639974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58278) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:08.643871 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.665218 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Routers {'368ea4de-3a8a-4a6b-b781-39affd032ba1'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:08.675863 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['368ea4de-3a8a-4a6b-b781-39affd032ba1'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:08.676354 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20b21804-0c20-4b0e-ab1f-2a5682d40a0d None None] The sync data for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv is: [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:29:52Z', 'revision_number': 6, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '7099f252-8b6b-4127-8ac0-b819a3d01e75', 'name': '', 'network_id': '041ac3a9-0ca7-4449-9782-639f1235b461', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:43:73:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 741, 'fixed_ips': [{'subnet_id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:28Z', 'updated_at': '2021-12-10T14:27:39Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:08.679920 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port b9e3e083-b68e-4009-8292-0d8d6563f971 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:30:08.704937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-029b8c49-b84a-4c38-9f43-d7c8892b3a2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:08.705723 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-029b8c49-b84a-4c38-9f43-d7c8892b3a2c service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 1098 time: 0.1551280 Dec 10 14:30:08.720308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92e59709-dfa7-41bf-8218-8237409f314f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:08.725618 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-92e59709-dfa7-41bf-8218-8237409f314f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports/fe4bc503-ed57-4abe-9148-349563a6b76d HTTP/1.1" status: 200 len: 911 time: 0.0842030 Dec 10 14:30:08.726491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58280) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:08.757552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.763167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:08.763989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.782873 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab38b56f-230c-45c8-9549-ced733f97003 req-37b8b644-e692-494f-aaf4-fd9bc25629ac tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:08.785394 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ab38b56f-230c-45c8-9549-ced733f97003 req-37b8b644-e692-494f-aaf4-fd9bc25629ac tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 945 time: 0.2341433 Dec 10 14:30:08.795545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-92aab680-dfa8-4546-8999-b619484f2e1c None None] Provisioning complete for port c93cdb3c-f190-4d12-85d0-6fafb9086b92 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:08.795920 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-92aab680-dfa8-4546-8999-b619484f2e1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.814604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec52d9c5-dbf2-4d12-bb55-126cd0be3b3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:08.821269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec52d9c5-dbf2-4d12-bb55-126cd0be3b3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:08.828249 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ec52d9c5-dbf2-4d12-bb55-126cd0be3b3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.0975277 Dec 10 14:30:08.829623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58282) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:08.856743 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Set router 368ea4de-3a8a-4a6b-b781-39affd032ba1 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:08.890000 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-4e071588-b849-4c0f-8ea8-af7fdfcae49c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The resource could not be found. Dec 10 14:30:08.893131 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4e071588-b849-4c0f-8ea8-af7fdfcae49c tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.3761928 Dec 10 14:30:08.894424 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-92aab680-dfa8-4546-8999-b619484f2e1c None None] Port c93cdb3c-f190-4d12-85d0-6fafb9086b92 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:08.896972 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58284) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:08.902660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:08.903362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a89af38b-d099-4e73-ab39-13427bfe7df7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': 'b20bb624-6c27-4bf8-ac37-1bb23ec69450', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'efc767c3-313d-4df2-b100-3c3cf991f276'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:08.960319 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-92aab680-dfa8-4546-8999-b619484f2e1c None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:08.960694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-92aab680-dfa8-4546-8999-b619484f2e1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.062818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a9806abc-452a-4508-9309-5d82a1b98504 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:09.068132 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 1.5770507 Dec 10 14:30:09.077726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58286) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:09.086264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb2924d9-0595-4e24-b446-d14ae370cdea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Network': ['ID=3d5e47e8-c136-4e46-bfdd-95d74daef4e6,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:09.091444 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'subnet': {'network_id': '3d5e47e8-c136-4e46-bfdd-95d74daef4e6', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:09.096680 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5affa149-e7ae-475f-a069-1929428cb2cd None None] New status for floating IP 17a6f7a3-9b53-4a18-b1cf-56e4db4be95c: DOWN {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:30:09.119362 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:30:09.128497 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ab38b56f-230c-45c8-9549-ced733f97003 req-395a713e-87fd-45a0-9d57-17a14df615bb tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3240485 Dec 10 14:30:09.253696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-d4b191ac-b584-4f48-946a-70d071e4ad1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:09.255290 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-d4b191ac-b584-4f48-946a-70d071e4ad1d service neutron] 10.222.0.39 "GET /v2.0/networks?id=041ac3a9-0ca7-4449-9782-639f1235b461 HTTP/1.1" status: 200 len: 898 time: 0.4839582 Dec 10 14:30:09.281092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::3de (62f6936a-4052-4c55-a4da-5b8b8be326f4/841961b3-9ee9-4d7d-b2cb-7813b58c2992/b9e3e083-b68e-4009-8292-0d8d6563f971) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:09.315853 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-7c70a755-33ad-4a28-bdf5-dc50d6cfc12d service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e HTTP/1.1" status: 200 len: 217 time: 0.0430810 Dec 10 14:30:09.316110 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.364421 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-a89af38b-d099-4e73-ab39-13427bfe7df7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The resource could not be found. Dec 10 14:30:09.368792 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a89af38b-d099-4e73-ab39-13427bfe7df7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.4710784 Dec 10 14:30:09.369434 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58288) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:09.418220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-efcc349e-e838-4bee-bc53-983bd564b221 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:09.419784 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-efcc349e-e838-4bee-bc53-983bd564b221 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a HTTP/1.1" status: 200 len: 834 time: 0.0903533 Dec 10 14:30:09.493271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:09.493985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.495343 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:09.498896 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.523335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ffac52f-a6b4-461f-951a-db3262d01541 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.528980 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-92aab680-dfa8-4546-8999-b619484f2e1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.548194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ffac52f-a6b4-461f-951a-db3262d01541 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.589580 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-92aab680-dfa8-4546-8999-b619484f2e1c None None] For port a9806abc-452a-4508-9309-5d82a1b98504, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a9806abc-452a-4508-9309-5d82a1b98504,segment=NetworkSegment(f87ad518-f300-4f42-a1a0-01a3d390e144),segment_id=f87ad518-f300-4f42-a1a0-01a3d390e144)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:09.591514 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '368ea4de-3a8a-4a6b-b781-39affd032ba1', 'name': 'tempest-NetworksTestDHCPv6-router-1629308865', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:04Z', 'updated_at': '2021-12-10T14:30:06Z', 'revision_number': 2, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None, '_interfaces': [{'id': 'fe4bc503-ed57-4abe-9148-349563a6b76d', 'name': '', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'mac_address': 'fa:16:3e:54:84:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '368ea4de-3a8a-4a6b-b781-39affd032ba1', 'device_owner': 'network:router_interface', 'standard_attr_id': 1108, 'fixed_ips': [{'subnet_id': '3f1b52c4-4951-4b16-bcdc-430200350dcd', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:05Z', 'updated_at': '2021-12-10T14:30:06Z', 'revision_number': 2, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'subnets': [{'id': '3f1b52c4-4951-4b16-bcdc-430200350dcd', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:09.592035 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-22123f8e-4ee3-4912-9cca-b1d452e10250 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:09.593711 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-22123f8e-4ee3-4912-9cca-b1d452e10250 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=041ac3a9-0ca7-4449-9782-639f1235b461&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1563103 Dec 10 14:30:09.621519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Checking router: 368ea4de-3a8a-4a6b-b781-39affd032ba1 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:09.622985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Updating router 368ea4de-3a8a-4a6b-b781-39affd032ba1 port fe4bc503-ed57-4abe-9148-349563a6b76d binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:30:09.637297 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-ad5637d2-c495-4386-a585-535aa512c7d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:09.638866 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-ad5637d2-c495-4386-a585-535aa512c7d3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 945 time: 0.0875497 Dec 10 14:30:09.677694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-92aab680-dfa8-4546-8999-b619484f2e1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.684890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.701683 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.709534 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.733193 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ffac52f-a6b4-461f-951a-db3262d01541 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.735961 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5ffac52f-a6b4-461f-951a-db3262d01541 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.737954 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5ffac52f-a6b4-461f-951a-db3262d01541 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/b20bb624-6c27-4bf8-ac37-1bb23ec69450 HTTP/1.1" status: 204 len: 168 time: 0.3655505 Dec 10 14:30:09.740545 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58290) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:09.774356 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-b707d2ec-b9fd-456e-8814-c6c925e761af service neutron] 10.222.0.39 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1689150 Dec 10 14:30:09.785719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ffac52f-a6b4-461f-951a-db3262d01541 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b20bb624-6c27-4bf8-ac37-1bb23ec69450,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:09.812191 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port fe4bc503-ed57-4abe-9148-349563a6b76d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:09.812463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.831689 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92aab680-dfa8-4546-8999-b619484f2e1c None None] Pushing event updated for resources: {'Port': ['ID=a9806abc-452a-4508-9309-5d82a1b98504,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:09.868310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:09.868648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.897860 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:09.899702 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:30:09.900048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:30:09.910340 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-51f2049b-61d8-4f57-b0e1-9339f33b6ce2 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1591933 Dec 10 14:30:09.919750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58292) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:09.925468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0b503976-e946-4eab-9041-1e35f5b13bf7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '3477ead3-f551-49f1-9d37-37d9688b5802', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:09.983191 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.009187 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for fe4bc503-ed57-4abe-9148-349563a6b76d owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:10.027000 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:10.027364 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.027891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:10.043029 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:10.051111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=b9e3e083-b68e-4009-8292-0d8d6563f971,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:10.056034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:10.061832 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:10.069846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.073166 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9da131d4-cce4-4055-a2dc-d3ec47493f0f req-f02276ed-6e0c-412c-bab0-7e554e9dab8a service neutron] 10.222.0.39 "GET /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2876749 Dec 10 14:30:10.082502 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for a0f8cb62-50c9-49f8-bbab-6c182aabaf0e owned by compute:nova {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:10.118515 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.125391 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.202948 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Subnet': ['ID=73c675c1-06c8-45f2-a602-9df68c0a5ff7,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:10.221686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Checking segment: {'id': '9a435957-a659-4401-92bd-6645ad45c2ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '3d5e47e8-c136-4e46-bfdd-95d74daef4e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:10.224436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network hostable DHCP agents. Network: 3d5e47e8-c136-4e46-bfdd-95d74daef4e6, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:30:10.243923 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.279000 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e712d1c3-22a2-4da6-a2ad-61a7e5c7d43f tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.7867031 Dec 10 14:30:10.288075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58296) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:10.288075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ac286ca4-c6ff-4b4c-aeae-98a21a26ecf0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:10.386458 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-0b503976-e946-4eab-9041-1e35f5b13bf7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The resource could not be found. Dec 10 14:30:10.387627 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0b503976-e946-4eab-9041-1e35f5b13bf7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.4668119 Dec 10 14:30:10.388356 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:30:10.391266 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58298) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:10.398080 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fda0143-5157-42d5-8767-c291b7611c9a None None] Pushing event updated for resources: {'Port': ['ID=fe4bc503-ed57-4abe-9148-349563a6b76d,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:10.398333 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-252559ac-065b-4d87-bb39-7a64043abea0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'tempest-secgroup--1245013566'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:10.446275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.448944 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a334c75c-6143-4e63-a4d5-9b958ed63c10 req-254f613b-12d0-40ee-bdd1-a1c373f6dafd tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:10.450727 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a334c75c-6143-4e63-a4d5-9b958ed63c10 req-254f613b-12d0-40ee-bdd1-a1c373f6dafd tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 945 time: 0.1688044 Dec 10 14:30:10.469514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 3d5e47e8-c136-4e46-bfdd-95d74daef4e6) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:10.481616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:10.481616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.488162 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Attempting to bind port fe4bc503-ed57-4abe-9148-349563a6b76d on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:10.488736 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Attempting to bind port fe4bc503-ed57-4abe-9148-349563a6b76d by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:10.489330 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Attempting to bind port fe4bc503-ed57-4abe-9148-349563a6b76d on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:10.493653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07dc6824-c3e2-475a-acf6-96f557d36d11 None None] Network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:10.499033 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=a0f8cb62-50c9-49f8-bbab-6c182aabaf0e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:10.501133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.534572 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:10.535370 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:10.536004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.536616 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:10.537316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Bound port: fe4bc503-ed57-4abe-9148-349563a6b76d, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:10.538266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.558223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=fe4bc503-ed57-4abe-9148-349563a6b76d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:10.575631 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a334c75c-6143-4e63-a4d5-9b958ed63c10 req-b5e8ea68-dbf6-4690-bc9c-2071ffe8f54f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=75ce6861-87ca-43bd-a567-4e6d7abbcee4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1013105 Dec 10 14:30:10.625584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-252559ac-065b-4d87-bb39-7a64043abea0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.625698 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:10.643829 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac286ca4-c6ff-4b4c-aeae-98a21a26ecf0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:10.645931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Port fe4bc503-ed57-4abe-9148-349563a6b76d has been deleted concurrently {{(pid=103812) _commit_port_binding /opt/stack/neutron/neutron/plugins/ml2/plugin.py:665}} Dec 10 14:30:10.647989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac286ca4-c6ff-4b4c-aeae-98a21a26ecf0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.689660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Routers {'368ea4de-3a8a-4a6b-b781-39affd032ba1'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:10.690376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['368ea4de-3a8a-4a6b-b781-39affd032ba1'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:10.713616 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] No DVR routers for this DVR port a0f8cb62-50c9-49f8-bbab-6c182aabaf0e on host hv-neutron-8214 {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:10.772032 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.ipam_backend_mixin [None req-ac286ca4-c6ff-4b4c-aeae-98a21a26ecf0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 841961b3-9ee9-4d7d-b2cb-7813b58c2992 (CIDR: 2001:db8::/64) Dec 10 14:30:10.779041 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0b79a206-31a0-4693-8090-b024517df536 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6938019 Dec 10 14:30:10.782201 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58300) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:10.788658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1710476a-f001-48a1-952f-699f5f0d4447 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1265209490', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:10.793314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] Set router 368ea4de-3a8a-4a6b-b781-39affd032ba1 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:10.806643 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-252559ac-065b-4d87-bb39-7a64043abea0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.808384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.812119 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5a908b3f-1f51-4916-96d0-fde0956e5935 req-57dda895-607f-4b2e-88a2-8dcdb26619b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "DELETE /v2.0/ports/a0f8cb62-50c9-49f8-bbab-6c182aabaf0e HTTP/1.1" status: 204 len: 173 time: 1.1638517 Dec 10 14:30:10.815045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'name': 'network-vif-deleted', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:30:10.816091 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-ac286ca4-c6ff-4b4c-aeae-98a21a26ecf0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:10.817342 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ac286ca4-c6ff-4b4c-aeae-98a21a26ecf0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:10.817520 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d1f40a0c-415a-427c-b015-d56af4719f8e" -d '{"events": [{"server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "name": "network-vif-deleted", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:30:10.824046 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.881338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '368ea4de-3a8a-4a6b-b781-39affd032ba1', 'name': 'tempest-NetworksTestDHCPv6-router-1629308865', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:04Z', 'updated_at': '2021-12-10T14:30:10Z', 'revision_number': 3, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:10.893967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:30:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e959d1f8-925c-4071-ac3f-e9f46eb2f54f x-openstack-request-id: req-e959d1f8-925c-4071-ac3f-e9f46eb2f54f {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:30:10.894403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "20843ceb-5c32-4cea-b61f-ab5153519ade", "name": "network-vif-deleted", "tag": "a0f8cb62-50c9-49f8-bbab-6c182aabaf0e", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:30:10.897139 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-e959d1f8-925c-4071-ac3f-e9f46eb2f54f {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:30:10.897660 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '20843ceb-5c32-4cea-b61f-ab5153519ade', 'name': 'network-vif-deleted', 'tag': 'a0f8cb62-50c9-49f8-bbab-6c182aabaf0e', 'status': 'completed', 'code': 200} Dec 10 14:30:10.907788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-252559ac-065b-4d87-bb39-7a64043abea0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.933793 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d3d56207-198d-43b6-9bd2-6145a367faa9 None None] Provisioning complete for port b9e3e083-b68e-4009-8292-0d8d6563f971 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:10.934169 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d3d56207-198d-43b6-9bd2-6145a367faa9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.936689 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1710476a-f001-48a1-952f-699f5f0d4447 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.936847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec7a4f6c-9c5d-444c-bf50-bacb328f3315 None None] The sync data for ids ['368ea4de-3a8a-4a6b-b781-39affd032ba1'] in dv-neutron-821401-2-hyperv is: [{'id': '368ea4de-3a8a-4a6b-b781-39affd032ba1', 'name': 'tempest-NetworksTestDHCPv6-router-1629308865', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:04Z', 'updated_at': '2021-12-10T14:30:10Z', 'revision_number': 3, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:10.942205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1710476a-f001-48a1-952f-699f5f0d4447 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:10.971860 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-3d5e47e8-c136-4e46-bfdd-95d74daef4e6', 'network_id': '3d5e47e8-c136-4e46-bfdd-95d74daef4e6', 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'fixed_ips': [{'subnet_id': '73c675c1-06c8-45f2-a602-9df68c0a5ff7'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:10.972820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.036599 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d3d56207-198d-43b6-9bd2-6145a367faa9 None None] Port b9e3e083-b68e-4009-8292-0d8d6563f971 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:11.038864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:11.038864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.067691 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1710476a-f001-48a1-952f-699f5f0d4447 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.077451 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ac286ca4-c6ff-4b4c-aeae-98a21a26ecf0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.7958987 Dec 10 14:30:11.088138 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58304) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:11.095781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:11.135276 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d3d56207-198d-43b6-9bd2-6145a367faa9 None None] Could not find standard attr ID for object fe4bc503-ed57-4abe-9148-349563a6b76d. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:11.191774 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1710476a-f001-48a1-952f-699f5f0d4447 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.279054 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Allocated IP 172.20.0.2 (3d5e47e8-c136-4e46-bfdd-95d74daef4e6/73c675c1-06c8-45f2-a602-9df68c0a5ff7/b2ad84d1-0864-4189-9875-81b9ef82fd92) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:11.300387 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1710476a-f001-48a1-952f-699f5f0d4447 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.306160 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1710476a-f001-48a1-952f-699f5f0d4447 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.5199318 Dec 10 14:30:11.313484 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58306) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:11.324613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'port': {'network_id': '3d5e47e8-c136-4e46-bfdd-95d74daef4e6', 'name': 'tempest-RoutersTest-488632569'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:11.446465 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a9806abc-452a-4508-9309-5d82a1b98504 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:11.456948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-252559ac-065b-4d87-bb39-7a64043abea0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7337b70f-0099-4d76-bd8b-6823374a94db,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:11.501058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-252559ac-065b-4d87-bb39-7a64043abea0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.503405 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-252559ac-065b-4d87-bb39-7a64043abea0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 1.1111169 Dec 10 14:30:11.518314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58308) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:11.525210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-621b1f5a-4534-4811-91af-d338a6e072ce tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'tempest-secgroup--862037479'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:11.555868 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Router 368ea4de-3a8a-4a6b-b781-39affd032ba1 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:11.570173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:11.570558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.614690 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:11.619274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.623050 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.681713 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:11.692336 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-627d9506-722c-4c5e-85f3-28d115f13e71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "PUT /v2.0/routers/368ea4de-3a8a-4a6b-b781-39affd032ba1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8604057 Dec 10 14:30:11.693196 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58312) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:11.721909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.759416 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-53e188ae-56f4-4ef4-965a-facec8ecc83e req-0d380884-32ba-4816-b872-23cc8652a441 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=20843ceb-5c32-4cea-b61f-ab5153519ade HTTP/1.1" status: 200 len: 210 time: 0.0419438 Dec 10 14:30:11.760145 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-621b1f5a-4534-4811-91af-d338a6e072ce tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.766362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0c055a4-1d05-469c-9f39-df1e4bc5dcda tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:11.771365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0c055a4-1d05-469c-9f39-df1e4bc5dcda tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:11.775260 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c0c055a4-1d05-469c-9f39-df1e4bc5dcda tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0808148 Dec 10 14:30:11.781326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58314) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:11.797513 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:11.804486 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:11.809315 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:11.852898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Pushing event updated for resources: {'Port': ['ID=b2ad84d1-0864-4189-9875-81b9ef82fd92,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:11.885937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Attempting to bind port b2ad84d1-0864-4189-9875-81b9ef82fd92 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:11.886318 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Attempting to bind port b2ad84d1-0864-4189-9875-81b9ef82fd92 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '9a435957-a659-4401-92bd-6645ad45c2ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '3d5e47e8-c136-4e46-bfdd-95d74daef4e6'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:11.886690 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Attempting to bind port b2ad84d1-0864-4189-9875-81b9ef82fd92 on network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:11.896484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:11.897006 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Checking segment: {'id': '9a435957-a659-4401-92bd-6645ad45c2ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '3d5e47e8-c136-4e46-bfdd-95d74daef4e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:11.897513 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.898000 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Bound using segment: {'id': '9a435957-a659-4401-92bd-6645ad45c2ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '3d5e47e8-c136-4e46-bfdd-95d74daef4e6'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:11.898485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Bound port: b2ad84d1-0864-4189-9875-81b9ef82fd92, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9a435957-a659-4401-92bd-6645ad45c2ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '3d5e47e8-c136-4e46-bfdd-95d74daef4e6'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:11.898902 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.899057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-75bfbba6-f9ee-487d-9c47-adfc1cad38df tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 3f1b52c4-4951-4b16-bcdc-430200350dcd {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:11.902480 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-75bfbba6-f9ee-487d-9c47-adfc1cad38df tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.958257 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-75bfbba6-f9ee-487d-9c47-adfc1cad38df tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.962966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:11.968568 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:11.978026 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] For port b2ad84d1-0864-4189-9875-81b9ef82fd92, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:11.981333 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] For port b2ad84d1-0864-4189-9875-81b9ef82fd92, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b2ad84d1-0864-4189-9875-81b9ef82fd92,segment=NetworkSegment(9a435957-a659-4401-92bd-6645ad45c2ae),segment_id=9a435957-a659-4401-92bd-6645ad45c2ae)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:11.998503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-621b1f5a-4534-4811-91af-d338a6e072ce tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.016744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] device_id is not set on port 160df101-849a-42bd-be78-5aa7d33f7f44 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:30:12.050937 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-75bfbba6-f9ee-487d-9c47-adfc1cad38df tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.067225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.090924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-621b1f5a-4534-4811-91af-d338a6e072ce tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.199091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-621b1f5a-4534-4811-91af-d338a6e072ce tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9cd1ff2f-8c11-4c7d-b0fe-11c81da425fc,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:12.204691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-75bfbba6-f9ee-487d-9c47-adfc1cad38df tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.244803 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75bfbba6-f9ee-487d-9c47-adfc1cad38df tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=3f1b52c4-4951-4b16-bcdc-430200350dcd,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:12.245018 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-621b1f5a-4534-4811-91af-d338a6e072ce tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.251933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-75bfbba6-f9ee-487d-9c47-adfc1cad38df tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.255914 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-75bfbba6-f9ee-487d-9c47-adfc1cad38df tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/3f1b52c4-4951-4b16-bcdc-430200350dcd HTTP/1.1" status: 204 len: 168 time: 0.4735012 Dec 10 14:30:12.256674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58316) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:12.257969 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-621b1f5a-4534-4811-91af-d338a6e072ce tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.7371829 Dec 10 14:30:12.262138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5a917742-ca3a-462d-8402-a12a66e413ea tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group_rule': {'security_group_id': '7337b70f-0099-4d76-bd8b-6823374a94db', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '172.20.0.0/16', 'remote_group_id': '9cd1ff2f-8c11-4c7d-b0fe-11c81da425fc'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:12.267261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58318) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:12.280615 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] Sync routers for ids ['368ea4de-3a8a-4a6b-b781-39affd032ba1'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:12.284187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13621536-6d3e-462c-8afa-d398c52c3c0b None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:12.291993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.20.0.3 (3d5e47e8-c136-4e46-bfdd-95d74daef4e6/73c675c1-06c8-45f2-a602-9df68c0a5ff7/160df101-849a-42bd-be78-5aa7d33f7f44) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:12.311102 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.392364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6c4ffe4-04bf-427c-88f9-6b8411356ebd None None] Pushing event updated for resources: {'Port': ['ID=b2ad84d1-0864-4189-9875-81b9ef82fd92,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:12.398264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] Routers {'368ea4de-3a8a-4a6b-b781-39affd032ba1'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:12.399104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['368ea4de-3a8a-4a6b-b781-39affd032ba1'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:12.459374 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:12.469237 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-052f6f4b-1a8c-4c37-90cf-0ed35ee6e394 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 710 time: 0.1996663 Dec 10 14:30:12.475742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:12.476597 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58320) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:12.479301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:12.480116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.498735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] Set router 368ea4de-3a8a-4a6b-b781-39affd032ba1 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:12.499279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=4ed8fa39-6227-404f-b028-d7f1709e961b,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:12.565883 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '368ea4de-3a8a-4a6b-b781-39affd032ba1', 'name': 'tempest-NetworksTestDHCPv6-router-1629308865', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:04Z', 'updated_at': '2021-12-10T14:30:10Z', 'revision_number': 3, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:12.597275 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-348db2a9-540b-4929-b50b-b9bbb2f6be1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.5038130 Dec 10 14:30:12.597756 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58322) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:12.602843 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1016982128', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '4ed8fa39-6227-404f-b028-d7f1709e961b'}], 'security_groups': ['8a59bf20-1db3-4baf-93fe-81ce7aa4ae63']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:12.613189 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62322951-9313-4812-9e3f-7a85c2382bef None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:12.641758 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] Checking router: 368ea4de-3a8a-4a6b-b781-39affd032ba1 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:12.663329 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-5a917742-ca3a-462d-8402-a12a66e413ea tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:12.668398 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5a917742-ca3a-462d-8402-a12a66e413ea tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.4103196 Dec 10 14:30:12.669186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58324) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:12.744837 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.782680 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd07d032-e570-45ff-b091-a3e289b41018 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.792169 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:12.820635 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] Routers {'368ea4de-3a8a-4a6b-b781-39affd032ba1'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:12.822122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['368ea4de-3a8a-4a6b-b781-39affd032ba1'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:12.901320 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58328) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:12.996572 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-690ef416-7423-4a5a-bd57-f2dca942eb2c None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:13.003088 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] Set router 368ea4de-3a8a-4a6b-b781-39affd032ba1 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:13.061676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.093676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '368ea4de-3a8a-4a6b-b781-39affd032ba1', 'name': 'tempest-NetworksTestDHCPv6-router-1629308865', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:04Z', 'updated_at': '2021-12-10T14:30:10Z', 'revision_number': 3, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:13.133153 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:13.139003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:13.142128 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:13.150388 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea7e3b6b-8c20-4f73-9a2f-5a2aba793131 None None] The sync data for ids ['368ea4de-3a8a-4a6b-b781-39affd032ba1'] in dv-neutron-821401-2-hyperv is: [{'id': '368ea4de-3a8a-4a6b-b781-39affd032ba1', 'name': 'tempest-NetworksTestDHCPv6-router-1629308865', 'tenant_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:04Z', 'updated_at': '2021-12-10T14:30:10Z', 'revision_number': 3, 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'gw_port_host': None}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:13.166898 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd07d032-e570-45ff-b091-a3e289b41018 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.172380 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db05d2a9-2a9e-4efc-b745-5afa30c53f5d tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.178345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-690ef416-7423-4a5a-bd57-f2dca942eb2c None None] Deleting port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:13.178718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-690ef416-7423-4a5a-bd57-f2dca942eb2c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.194737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd07d032-e570-45ff-b091-a3e289b41018 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.216871 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=160df101-849a-42bd-be78-5aa7d33f7f44,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:13.292786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-690ef416-7423-4a5a-bd57-f2dca942eb2c None None] For port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:13.293191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-690ef416-7423-4a5a-bd57-f2dca942eb2c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.353448 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc5fba98-859b-4901-8398-3eaf67f892a2 None None] Update dhcp port {'port': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'fixed_ips': [{'subnet_id': '841961b3-9ee9-4d7d-b2cb-7813b58c2992', 'ip_address': '2001:db8::2'}, {'subnet_id': '4ed8fa39-6227-404f-b028-d7f1709e961b'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'a9806abc-452a-4508-9309-5d82a1b98504'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:30:13.355485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-690ef416-7423-4a5a-bd57-f2dca942eb2c None None] Calling delete_port for d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:13.411230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc5fba98-859b-4901-8398-3eaf67f892a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.463870 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b2ad84d1-0864-4189-9875-81b9ef82fd92 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:13.468351 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2f301ce-9b41-4838-9102-53f42981d232 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.481663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:13.486621 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db05d2a9-2a9e-4efc-b745-5afa30c53f5d tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.491727 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.571344 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2f301ce-9b41-4838-9102-53f42981d232 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.587036 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd07d032-e570-45ff-b091-a3e289b41018 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.587689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd07d032-e570-45ff-b091-a3e289b41018 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Fanout notify agent at l3_agent the message router_deleted on router 368ea4de-3a8a-4a6b-b781-39affd032ba1 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:30:13.591274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device a0f8cb62-50c9-49f8-bbab-6c182aabaf0e no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:13.598013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cd07d032-e570-45ff-b091-a3e289b41018 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.599546 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cd07d032-e570-45ff-b091-a3e289b41018 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/routers/368ea4de-3a8a-4a6b-b781-39affd032ba1 HTTP/1.1" status: 204 len: 168 time: 1.1120789 Dec 10 14:30:13.603608 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58330) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:13.639012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Delete allocated IP 2001:db8::3de (62f6936a-4052-4c55-a4da-5b8b8be326f4/841961b3-9ee9-4d7d-b2cb-7813b58c2992) {{(pid=103811) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 10 14:30:13.654419 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: a0f8cb62-50c9-49f8-bbab-6c182aabaf0e {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:13.654778 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device a0f8cb62-50c9-49f8-bbab-6c182aabaf0e not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:13.657092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8:0:1::7a (62f6936a-4052-4c55-a4da-5b8b8be326f4/4ed8fa39-6227-404f-b028-d7f1709e961b/b9e3e083-b68e-4009-8292-0d8d6563f971) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:13.694569 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6e232d9-f934-43f1-aebf-2a0ee5d4749d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:13.702766 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d6e232d9-f934-43f1-aebf-2a0ee5d4749d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0980191 Dec 10 14:30:13.706653 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db05d2a9-2a9e-4efc-b745-5afa30c53f5d tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.716633 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b2ad84d1-0864-4189-9875-81b9ef82fd92 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:13.717031 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.719077 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-db05d2a9-2a9e-4efc-b745-5afa30c53f5d tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.727837 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-db05d2a9-2a9e-4efc-b745-5afa30c53f5d tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/9cd1ff2f-8c11-4c7d-b0fe-11c81da425fc HTTP/1.1" status: 204 len: 168 time: 1.0551546 Dec 10 14:30:13.728651 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58332) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:13.751773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58334) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:13.770704 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-01dcf9c9-62f3-4c64-9e0c-2e2e651c5a84 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 2.4558291 Dec 10 14:30:13.772613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-690ef416-7423-4a5a-bd57-f2dca942eb2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.773821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58336) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:13.823485 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-690ef416-7423-4a5a-bd57-f2dca942eb2c None None] No DVR routers for this DVR port d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:13.828616 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-690ef416-7423-4a5a-bd57-f2dca942eb2c None None] Pushing event deleted for resources: {'Port': ['ID=d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:13.848451 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db05d2a9-2a9e-4efc-b745-5afa30c53f5d tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9cd1ff2f-8c11-4c7d-b0fe-11c81da425fc,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:13.907156 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17f28ddd-84fe-4686-816d-1898d586138a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:13.911873 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-17f28ddd-84fe-4686-816d-1898d586138a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1747160 Dec 10 14:30:13.914204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58338) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:13.926173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.968085 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port b2ad84d1-0864-4189-9875-81b9ef82fd92, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b2ad84d1-0864-4189-9875-81b9ef82fd92,segment=NetworkSegment(9a435957-a659-4401-92bd-6645ad45c2ae),segment_id=9a435957-a659-4401-92bd-6645ad45c2ae)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:13.979990 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3311ae1a-8a7f-4a97-a14f-7ad91ee307b5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0607421 Dec 10 14:30:13.979990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2f301ce-9b41-4838-9102-53f42981d232 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.979990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c2f301ce-9b41-4838-9102-53f42981d232 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:13.981020 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c2f301ce-9b41-4838-9102-53f42981d232 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/security-groups/75ce6861-87ca-43bd-a567-4e6d7abbcee4 HTTP/1.1" status: 204 len: 168 time: 1.0887234 Dec 10 14:30:13.981630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58340) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:14.005225 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:14.029900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.063526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2f301ce-9b41-4838-9102-53f42981d232 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=75ce6861-87ca-43bd-a567-4e6d7abbcee4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:14.089125 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-85f5bbc2-c341-4383-949b-8d1ae5e17728 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.3267221 Dec 10 14:30:14.103161 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58346) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:14.103456 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58344) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:14.112438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=b2ad84d1-0864-4189-9875-81b9ef82fd92,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:14.144722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7416b85b-729b-4b8d-a605-490469c1f2b3 None None] Network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:14.166176 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:14.219724 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:14.220332 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d8b0d609-42aa-44ab-b7d1-8cc5dd5b04f5 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:14.243362 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b8d9f901-0542-476c-a9d9-503d9077e3b6 None None] Provisioning complete for port b2ad84d1-0864-4189-9875-81b9ef82fd92 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:14.243936 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b8d9f901-0542-476c-a9d9-503d9077e3b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.362044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:14.365897 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.382300 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f3df24f4-68fe-4c1b-9e11-baf1c4708dd7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.468280 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.487430 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f3df24f4-68fe-4c1b-9e11-baf1c4708dd7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.517110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.532489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.598058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-fc5fba98-859b-4901-8398-3eaf67f892a2 None None] Allocated IP 2001:db8:0:1::2 (62f6936a-4052-4c55-a4da-5b8b8be326f4/4ed8fa39-6227-404f-b028-d7f1709e961b/a9806abc-452a-4508-9309-5d82a1b98504) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:14.599890 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=b9e3e083-b68e-4009-8292-0d8d6563f971,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:14.677223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] In _notify_port_updated(), no bound segment for port b9e3e083-b68e-4009-8292-0d8d6563f971 on network 62f6936a-4052-4c55-a4da-5b8b8be326f4 {{(pid=103811) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:30:14.683093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:14.683852 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.685581 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-503e3ab4-a04b-4a95-b7bd-fba7df3924a2 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "PUT /v2.0/ports/b9e3e083-b68e-4009-8292-0d8d6563f971 HTTP/1.1" status: 200 len: 930 time: 2.0868635 Dec 10 14:30:14.689455 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58348) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:14.710214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f3df24f4-68fe-4c1b-9e11-baf1c4708dd7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.712902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f3df24f4-68fe-4c1b-9e11-baf1c4708dd7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.716643 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f3df24f4-68fe-4c1b-9e11-baf1c4708dd7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/7337b70f-0099-4d76-bd8b-6823374a94db HTTP/1.1" status: 204 len: 168 time: 0.5819921 Dec 10 14:30:14.721946 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58350) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:14.734690 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3d4aa2e8-8402-4802-b946-1fde330e0062 None None] Provisioning complete for port b2ad84d1-0864-4189-9875-81b9ef82fd92 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:14.735246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3d4aa2e8-8402-4802-b946-1fde330e0062 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.772231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3df24f4-68fe-4c1b-9e11-baf1c4708dd7 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7337b70f-0099-4d76-bd8b-6823374a94db,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:14.811267 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fc5fba98-859b-4901-8398-3eaf67f892a2 None None] For port a9806abc-452a-4508-9309-5d82a1b98504, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a9806abc-452a-4508-9309-5d82a1b98504,segment=NetworkSegment(f87ad518-f300-4f42-a1a0-01a3d390e144),segment_id=f87ad518-f300-4f42-a1a0-01a3d390e144)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:14.869434 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c8884534-fa8a-4c45-8cd4-0314f25136af tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1379893 Dec 10 14:30:14.874906 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58352) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:14.880451 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-262ff3bd-b64e-460e-9f55-c69c69851524 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'tempest-secgroup--2078366121'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:14.893265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-a2b64443-d217-48be-b5b7-14fe2905bc93 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port b9e3e083-b68e-4009-8292-0d8d6563f971 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:14.899601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2b64443-d217-48be-b5b7-14fe2905bc93 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.912420 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc5fba98-859b-4901-8398-3eaf67f892a2 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.917873 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3d4aa2e8-8402-4802-b946-1fde330e0062 None None] Provisioning complete for port 160df101-849a-42bd-be78-5aa7d33f7f44 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:14.917873 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3d4aa2e8-8402-4802-b946-1fde330e0062 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:14.959361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3d4aa2e8-8402-4802-b946-1fde330e0062 None None] Port 160df101-849a-42bd-be78-5aa7d33f7f44 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:14.983593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc5fba98-859b-4901-8398-3eaf67f892a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.016524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.030441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2b64443-d217-48be-b5b7-14fe2905bc93 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.043419 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-a2b64443-d217-48be-b5b7-14fe2905bc93 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for b9e3e083-b68e-4009-8292-0d8d6563f971 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:15.081135 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.objects.ports [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103810) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:30:15.083960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-262ff3bd-b64e-460e-9f55-c69c69851524 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.089519 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.097570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.100955 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-866eab67-2d8d-40e8-875a-32236ccf30fc None None] Provisioning complete for port 160df101-849a-42bd-be78-5aa7d33f7f44 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:15.101338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-866eab67-2d8d-40e8-875a-32236ccf30fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.106483 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5fba98-859b-4901-8398-3eaf67f892a2 None None] Pushing event updated for resources: {'Port': ['ID=a9806abc-452a-4508-9309-5d82a1b98504,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:15.112938 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.144015 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-866eab67-2d8d-40e8-875a-32236ccf30fc None None] Port 160df101-849a-42bd-be78-5aa7d33f7f44 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:15.205747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:15.217835 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:15.229038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7478bfe4-32eb-42ee-a4a2-e9e11001a6d5 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:15.233208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:15.234058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.242590 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=b92e4239-8c60-49f3-82cc-fa2b69fdb4bf,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:15.401342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a9806abc-452a-4508-9309-5d82a1b98504 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:15.410331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-262ff3bd-b64e-460e-9f55-c69c69851524 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.416591 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-042c0f5a-f4d9-4534-9baf-00457a3df345 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.4194667 Dec 10 14:30:15.418681 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': 'b92e4239-8c60-49f3-82cc-fa2b69fdb4bf'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:15.419261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58354) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:15.420173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.425808 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:15.594409 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-262ff3bd-b64e-460e-9f55-c69c69851524 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.602412 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=160df101-849a-42bd-be78-5aa7d33f7f44,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:15.624060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Allocated IP 2001:db8::f816:3eff:fe05:9eb7 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/b92e4239-8c60-49f3-82cc-fa2b69fdb4bf/cecb1930-537c-4b20-b12e-a9f755f1fcf6) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:15.650976 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-262ff3bd-b64e-460e-9f55-c69c69851524 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5854fccc-dac9-43c4-88b1-2c0cdadebcb4,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:15.726040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:15.729951 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.832777 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-262ff3bd-b64e-460e-9f55-c69c69851524 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.834096 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-262ff3bd-b64e-460e-9f55-c69c69851524 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.9573421 Dec 10 14:30:15.837958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58356) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:15.844723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b3cabbfa-1ccf-4a56-bb9d-41c6736a6365 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:15.845181 dv-neutron-821401-2-hyperv neutron-server[103810]: WARNING neutron.api.v2.base [None req-b3cabbfa-1ccf-4a56-bb9d-41c6736a6365 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 10 14:30:15.846837 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-b3cabbfa-1ccf-4a56-bb9d-41c6736a6365 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] update failed (client error): There was a conflict when trying to complete your request. Dec 10 14:30:15.847302 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b3cabbfa-1ccf-4a56-bb9d-41c6736a6365 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "PUT /v2.0/security-groups/5854fccc-dac9-43c4-88b1-2c0cdadebcb4 HTTP/1.1" status: 409 len: 330 time: 0.0083644 Dec 10 14:30:15.851986 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58358) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:15.877176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 7099f252-8b6b-4127-8ac0-b819a3d01e75 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:15.881252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.949100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2b64443-d217-48be-b5b7-14fe2905bc93 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:15.985320 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cbe49b29-10dc-44b1-8f44-043c04320718 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.004575 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.007173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:16.007540 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.017133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port 7099f252-8b6b-4127-8ac0-b819a3d01e75, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=7099f252-8b6b-4127-8ac0-b819a3d01e75,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:16.025252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.036436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2b64443-d217-48be-b5b7-14fe2905bc93 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.041752 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a2b64443-d217-48be-b5b7-14fe2905bc93 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/b9e3e083-b68e-4009-8292-0d8d6563f971 HTTP/1.1" status: 204 len: 168 time: 1.3522458 Dec 10 14:30:16.046032 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d96f2988-0b39-471b-ae3b-4be423571a25 None None] Provisioning complete for port c93cdb3c-f190-4d12-85d0-6fafb9086b92 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:16.046438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d96f2988-0b39-471b-ae3b-4be423571a25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.052009 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58360) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:16.061707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 7099f252-8b6b-4127-8ac0-b819a3d01e75 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:16.087352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b64443-d217-48be-b5b7-14fe2905bc93 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=b9e3e083-b68e-4009-8292-0d8d6563f971,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:16.090400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d96f2988-0b39-471b-ae3b-4be423571a25 None None] Port c93cdb3c-f190-4d12-85d0-6fafb9086b92 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:16.096445 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d96f2988-0b39-471b-ae3b-4be423571a25 None None] Could not find standard attr ID for object b9e3e083-b68e-4009-8292-0d8d6563f971. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:16.100089 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.100275 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cbe49b29-10dc-44b1-8f44-043c04320718 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.103854 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.107301 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-2785b7fe-ed3f-4ffd-98cb-b2f28f28e683 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:30:16.111918 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2785b7fe-ed3f-4ffd-98cb-b2f28f28e683 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/b9e3e083-b68e-4009-8292-0d8d6563f971 HTTP/1.1" status: 404 len: 333 time: 0.0581310 Dec 10 14:30:16.112059 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58362) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:16.157309 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Pushing event updated for resources: {'Port': ['ID=cecb1930-537c-4b20-b12e-a9f755f1fcf6,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:16.196737 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:16.197622 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d96f2988-0b39-471b-ae3b-4be423571a25 None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:16.198000 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d96f2988-0b39-471b-ae3b-4be423571a25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.204455 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:16.229057 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:16.244398 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ff04ede-e8cf-4900-826a-d9cdb97e2371 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.245617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b2ad84d1-0864-4189-9875-81b9ef82fd92 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:16.280811 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cbe49b29-10dc-44b1-8f44-043c04320718 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.287000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cbe49b29-10dc-44b1-8f44-043c04320718 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.292546 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cbe49b29-10dc-44b1-8f44-043c04320718 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/5854fccc-dac9-43c4-88b1-2c0cdadebcb4 HTTP/1.1" status: 204 len: 168 time: 0.4341757 Dec 10 14:30:16.292546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58364) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:16.335545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Attempting to bind port cecb1930-537c-4b20-b12e-a9f755f1fcf6 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:16.335916 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Attempting to bind port cecb1930-537c-4b20-b12e-a9f755f1fcf6 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:16.336281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Attempting to bind port cecb1930-537c-4b20-b12e-a9f755f1fcf6 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:16.348033 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:16.348415 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:16.348820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.349215 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:16.349762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Bound port: cecb1930-537c-4b20-b12e-a9f755f1fcf6, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:16.350146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.355627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ff04ede-e8cf-4900-826a-d9cdb97e2371 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.362318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbe49b29-10dc-44b1-8f44-043c04320718 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5854fccc-dac9-43c4-88b1-2c0cdadebcb4,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:16.396700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.442795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b2ad84d1-0864-4189-9875-81b9ef82fd92 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:16.443669 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.445742 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3176e6f1-723f-4e4b-bbaf-e63208517e59 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1452935 Dec 10 14:30:16.447869 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58366) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:16.499931 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-e424041e-5c27-478e-9665-506f5dba05f0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] delete failed (client error): The resource could not be found. Dec 10 14:30:16.506513 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e424041e-5c27-478e-9665-506f5dba05f0 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "DELETE /v2.0/security-groups/bc265fa7-a791-4bf9-861e-e331217a6af4 HTTP/1.1" status: 404 len: 347 time: 0.0493970 Dec 10 14:30:16.507858 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58368) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:16.529267 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-94a41841-5bf1-438f-917a-fc089406a2a3 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] show failed (client error): The resource could not be found. Dec 10 14:30:16.534682 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-94a41841-5bf1-438f-917a-fc089406a2a3 tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-groups/1af5e913-078b-4a0e-a049-9672dc2a9916 HTTP/1.1" status: 404 len: 347 time: 0.0216346 Dec 10 14:30:16.542532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] For port cecb1930-537c-4b20-b12e-a9f755f1fcf6, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:16.549022 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] For port cecb1930-537c-4b20-b12e-a9f755f1fcf6, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cecb1930-537c-4b20-b12e-a9f755f1fcf6,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:16.568513 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58370) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:16.602900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7c9cdc7e-6441-4045-958f-be459da9db7d None None] Could not find standard attr ID for object b9e3e083-b68e-4009-8292-0d8d6563f971. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:16.614898 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-d1e801a7-3932-46e6-ab05-a4830423f1ea tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] show failed (client error): The resource could not be found. Dec 10 14:30:16.616064 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d1e801a7-3932-46e6-ab05-a4830423f1ea tempest-NegativeSecGroupTest-933799738 tempest-NegativeSecGroupTest-933799738-project] 10.222.0.57 "GET /v2.0/security-group-rules/19b44226-2052-4a83-b6cf-ea1c5fa64011 HTTP/1.1" status: 404 len: 356 time: 0.0464468 Dec 10 14:30:16.617640 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7c9cdc7e-6441-4045-958f-be459da9db7d None None] Provisioning complete for port 160df101-849a-42bd-be78-5aa7d33f7f44 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:16.619017 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7c9cdc7e-6441-4045-958f-be459da9db7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.656096 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.714981 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7c9cdc7e-6441-4045-958f-be459da9db7d None None] Port 160df101-849a-42bd-be78-5aa7d33f7f44 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:16.744638 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c111f826-52cd-4bc0-b57c-06bcbff20d9b None None] Pushing event updated for resources: {'Port': ['ID=cecb1930-537c-4b20-b12e-a9f755f1fcf6,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:16.832532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.880594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.961192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ff04ede-e8cf-4900-826a-d9cdb97e2371 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.964023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1ff04ede-e8cf-4900-826a-d9cdb97e2371 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:16.965232 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1ff04ede-e8cf-4900-826a-d9cdb97e2371 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/security-groups/b663ace5-e143-4bc5-ba5c-5c7dd4dac641 HTTP/1.1" status: 204 len: 168 time: 0.8497376 Dec 10 14:30:16.969490 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58374) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:16.976506 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ff04ede-e8cf-4900-826a-d9cdb97e2371 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b663ace5-e143-4bc5-ba5c-5c7dd4dac641,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:17.005621 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.008893 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=160df101-849a-42bd-be78-5aa7d33f7f44,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:17.075932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.098707 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bb0b67f-f949-4038-9e34-216a16d69dba tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.128103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:17.131683 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.136537 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bb0b67f-f949-4038-9e34-216a16d69dba tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.165359 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:17.168388 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=7099f252-8b6b-4127-8ac0-b819a3d01e75,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:17.176223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:17.177155 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.182103 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:17.183824 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:17.185476 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=48ae817e-c6a9-4f5d-9b6c-c87aab128156,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:17.293366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bb0b67f-f949-4038-9e34-216a16d69dba tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.304457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3bb0b67f-f949-4038-9e34-216a16d69dba tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.308928 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3bb0b67f-f949-4038-9e34-216a16d69dba tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/security-groups/8a59bf20-1db3-4baf-93fe-81ce7aa4ae63 HTTP/1.1" status: 204 len: 168 time: 0.3334703 Dec 10 14:30:17.311115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58378) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:17.343828 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-26f2e993-c6d5-488d-a923-41995f95c5e5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9232724 Dec 10 14:30:17.347008 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58380) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:17.352656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:4d:fa:7d', 'name': 'tempest-NetworksTestDHCPv6-1098828791'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:17.364164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58382) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:17.365021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bb0b67f-f949-4038-9e34-216a16d69dba tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a59bf20-1db3-4baf-93fe-81ce7aa4ae63,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:17.458206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-5d05c616-e885-40c3-8a58-561feae0bb44 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet 841961b3-9ee9-4d7d-b2cb-7813b58c2992 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:17.466535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5d05c616-e885-40c3-8a58-561feae0bb44 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.523789 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5d05c616-e885-40c3-8a58-561feae0bb44 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.602651 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device cecb1930-537c-4b20-b12e-a9f755f1fcf6 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:17.610888 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.654716 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5d05c616-e885-40c3-8a58-561feae0bb44 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.693810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port cecb1930-537c-4b20-b12e-a9f755f1fcf6 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:17.694347 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.726748 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-744cd796-716e-4d5c-8efb-c41c89a44ccd admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=34e2cdd389a946e58f77ce1eb4d68403&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3568282 Dec 10 14:30:17.727066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58386) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:17.801749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router d2ee67c4-432f-4d44-92f7-f652b9c8f167 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:30:17.804337 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.805403 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bd1e3e2-3ea0-4310-80b6-2fc3494791ef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.826858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b0a0883e-36ea-44dd-bacf-a9b9bc0e2d93 None None] Provisioning complete for port 160df101-849a-42bd-be78-5aa7d33f7f44 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:17.827472 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b0a0883e-36ea-44dd-bacf-a9b9bc0e2d93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.872867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bd1e3e2-3ea0-4310-80b6-2fc3494791ef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.876932 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5d05c616-e885-40c3-8a58-561feae0bb44 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.880535 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b0a0883e-36ea-44dd-bacf-a9b9bc0e2d93 None None] Port 160df101-849a-42bd-be78-5aa7d33f7f44 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:17.891815 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port cecb1930-537c-4b20-b12e-a9f755f1fcf6, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cecb1930-537c-4b20-b12e-a9f755f1fcf6,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:17.925574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:17.950427 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d05c616-e885-40c3-8a58-561feae0bb44 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=841961b3-9ee9-4d7d-b2cb-7813b58c2992,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:17.969146 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5d05c616-e885-40c3-8a58-561feae0bb44 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:17.970344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1153f3f1-2727-4ce6-95ce-6a420b8c9b52 None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:17.979409 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5d05c616-e885-40c3-8a58-561feae0bb44 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/841961b3-9ee9-4d7d-b2cb-7813b58c2992 HTTP/1.1" status: 204 len: 168 time: 0.6593943 Dec 10 14:30:17.981514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58388) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:17.984578 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:18.038896 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:18.044396 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.049110 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a14b5973-21e0-4ded-8416-997a9c036710 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/d2ee67c4-432f-4d44-92f7-f652b9c8f167/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2739651 Dec 10 14:30:18.050917 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d5146c5-fc2b-4752-89c8-84edbbd297e0 None None] Sync routers for ids ['d2ee67c4-432f-4d44-92f7-f652b9c8f167'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:18.056306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58390) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:18.082123 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d5146c5-fc2b-4752-89c8-84edbbd297e0 None None] Routers {'d2ee67c4-432f-4d44-92f7-f652b9c8f167'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:18.083061 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-9d5146c5-fc2b-4752-89c8-84edbbd297e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d2ee67c4-432f-4d44-92f7-f652b9c8f167'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:18.094315 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9d7899bb-a9e2-467f-bfc6-02634a8598ca has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:18.117943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12be9438-abea-4f36-9608-9c367bd230a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:18.123204 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-12be9438-abea-4f36-9608-9c367bd230a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports/160df101-849a-42bd-be78-5aa7d33f7f44 HTTP/1.1" status: 200 len: 976 time: 0.0638118 Dec 10 14:30:18.124015 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52e8e94b-63b7-4950-b9ad-4a5cfac0f9b4 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:18.126508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58392) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:18.139860 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.140549 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-9d5146c5-fc2b-4752-89c8-84edbbd297e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:18.151979 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d5146c5-fc2b-4752-89c8-84edbbd297e0 None None] Routers {'d2ee67c4-432f-4d44-92f7-f652b9c8f167'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:18.153027 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-9d5146c5-fc2b-4752-89c8-84edbbd297e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d2ee67c4-432f-4d44-92f7-f652b9c8f167'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:18.187676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bd1e3e2-3ea0-4310-80b6-2fc3494791ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.190787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7bd1e3e2-3ea0-4310-80b6-2fc3494791ef admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.191942 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7bd1e3e2-3ea0-4310-80b6-2fc3494791ef admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/d103e06f-55fb-4114-800f-027f62c80cc8 HTTP/1.1" status: 204 len: 168 time: 0.4638305 Dec 10 14:30:18.192656 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-9d5146c5-fc2b-4752-89c8-84edbbd297e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:18.193621 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d5146c5-fc2b-4752-89c8-84edbbd297e0 None None] The sync data for ids ['d2ee67c4-432f-4d44-92f7-f652b9c8f167'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:18.236766 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=cecb1930-537c-4b20-b12e-a9f755f1fcf6,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:18.244466 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bd1e3e2-3ea0-4310-80b6-2fc3494791ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d103e06f-55fb-4114-800f-027f62c80cc8,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:18.286185 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.287036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.287036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.287257 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.287507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.287844 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.288185 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.288490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.288820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.289797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.290426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.290736 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.291069 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:18.301132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:18.309335 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-da5c747e-b8f2-43fb-a2a0-2aab398eb8b8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/routers/9d7899bb-a9e2-467f-bfc6-02634a8598ca/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2048759 Dec 10 14:30:18.310753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port a58e708c-50a4-4135-8c1f-8d028c585717 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:30:18.315108 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-728eac26-5a29-44bd-b060-77af26f1814b None None] Provisioning complete for port cecb1930-537c-4b20-b12e-a9f755f1fcf6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:18.315686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-728eac26-5a29-44bd-b060-77af26f1814b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.315910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58396) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:18.343807 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] Sync routers for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:18.371795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:18.372426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:18.403785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:18.408750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.488646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:18.506632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-ea157b6c-a490-43bd-bf53-fc248dab531b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting subnet 0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:18.510318 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ea157b6c-a490-43bd-bf53-fc248dab531b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.570526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ea157b6c-a490-43bd-bf53-fc248dab531b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.698362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 172.20.0.6 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/48ae817e-c6a9-4f5d-9b6c-c87aab128156/a58e708c-50a4-4135-8c1f-8d028c585717) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:18.762036 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fe4d:fa7d (cdc891b5-3e75-4d62-a51b-0f84be9af82d/b92e4239-8c60-49f3-82cc-fa2b69fdb4bf/a58e708c-50a4-4135-8c1f-8d028c585717) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:18.821053 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ea157b6c-a490-43bd-bf53-fc248dab531b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.823406 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:30:16Z', 'revision_number': 7, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:18.855261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.871685 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] Checking router: 9d7899bb-a9e2-467f-bfc6-02634a8598ca for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:18.884267 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f6b417d-30b8-4497-9a3f-50f4ed6b314f None None] Update dhcp port {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': 'b92e4239-8c60-49f3-82cc-fa2b69fdb4bf', 'ip_address': '2001:db8::f816:3eff:fe05:9eb7'}, {'subnet_id': '48ae817e-c6a9-4f5d-9b6c-c87aab128156'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'cecb1930-537c-4b20-b12e-a9f755f1fcf6'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:30:18.907101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] Routers {'9d7899bb-a9e2-467f-bfc6-02634a8598ca'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:18.907981 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:18.926936 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:18.954018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2f6b417d-30b8-4497-9a3f-50f4ed6b314f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.060000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:19.067284 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:19.074118 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:19.074717 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.076620 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.113237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ea157b6c-a490-43bd-bf53-fc248dab531b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.116784 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=274eb16c-9a10-413e-860b-79094f7e365b,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:19.184604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea157b6c-a490-43bd-bf53-fc248dab531b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Subnet': ['ID=0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:19.199713 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9f2b7742-1566-42e6-ae39-349bf81a9b33 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2187643 Dec 10 14:30:19.200346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58408) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:19.207656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ea157b6c-a490-43bd-bf53-fc248dab531b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.208272 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a073a642-7f5e-49c0-b40b-f27e69f50c86 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'security_group': {'name': 'tempest-secgroup-291003910'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:19.214196 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ea157b6c-a490-43bd-bf53-fc248dab531b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/subnets/0a33d5c3-2b85-44e0-8b7d-e1fbf6f0854a HTTP/1.1" status: 204 len: 168 time: 0.8972580 Dec 10 14:30:19.217718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58410) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:19.305669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.317228 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port 160df101-849a-42bd-be78-5aa7d33f7f44 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:19.317955 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.352340 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b15adb00-7a3c-43a4-8238-691c01203cd2 None None] Network 041ac3a9-0ca7-4449-9782-639f1235b461 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:19.365369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a073a642-7f5e-49c0-b40b-f27e69f50c86 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.438893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:19.444308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:19.457442 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device cecb1930-537c-4b20-b12e-a9f755f1fcf6 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:19.457826 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:19.460054 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee065f90-4b64-4fa5-9fb9-6f4d221afb28 None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:19.492294 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=a58e708c-50a4-4135-8c1f-8d028c585717,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:19.497450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.506948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.534749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for 160df101-849a-42bd-be78-5aa7d33f7f44 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:19.537999 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a073a642-7f5e-49c0-b40b-f27e69f50c86 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.573086 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:19.573633 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.601851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a073a642-7f5e-49c0-b40b-f27e69f50c86 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.663248 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.674997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-550c8a31-aacd-4f42-a293-e6fea722cd46 None None] Provisioning complete for port c93cdb3c-f190-4d12-85d0-6fafb9086b92 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:19.675374 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-550c8a31-aacd-4f42-a293-e6fea722cd46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.681210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a073a642-7f5e-49c0-b40b-f27e69f50c86 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aa35563b-f7c7-4fc8-bd6e-3abebda57c57,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:19.697449 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b232285f-9393-42b3-a9ed-289bd4a8e084 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 2.3492963 Dec 10 14:30:19.699993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58420) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:19.723191 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a073a642-7f5e-49c0-b40b-f27e69f50c86 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.726174 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a073a642-7f5e-49c0-b40b-f27e69f50c86 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5243132 Dec 10 14:30:19.726798 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58422) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:19.730025 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] Set router 9d7899bb-a9e2-467f-bfc6-02634a8598ca gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:19.731307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9f453625-aaba-434d-bb3e-b981aaee45af tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'security_group': {'name': 'tempest-secgroup-888017560'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:19.799540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 0246a92c-5e97-4dcc-b32d-9fefc0769806 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:19.800001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.808677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58424) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:19.831812 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e8b7a7c-c592-40d0-820f-2bab4da5c686 None None] DHCP port deletion for 041ac3a9-0ca7-4449-9782-639f1235b461 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:19.855365 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe28e96b-9590-4b7c-bfe0-e2f08ff5c169 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:19.862710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe28e96b-9590-4b7c-bfe0-e2f08ff5c169 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:19.864632 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fe28e96b-9590-4b7c-bfe0-e2f08ff5c169 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1784 time: 0.1634858 Dec 10 14:30:19.872392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f453625-aaba-434d-bb3e-b981aaee45af tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.873118 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58428) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:19.895505 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port cecb1930-537c-4b20-b12e-a9f755f1fcf6 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:19.895998 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.908894 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port 0246a92c-5e97-4dcc-b32d-9fefc0769806, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0246a92c-5e97-4dcc-b32d-9fefc0769806,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:19.909308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:19.925876 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-550c8a31-aacd-4f42-a293-e6fea722cd46 None None] Port c93cdb3c-f190-4d12-85d0-6fafb9086b92 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:19.929367 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-2f6b417d-30b8-4497-9a3f-50f4ed6b314f None None] Allocated IP 172.20.0.2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/48ae817e-c6a9-4f5d-9b6c-c87aab128156/cecb1930-537c-4b20-b12e-a9f755f1fcf6) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:19.930016 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 0246a92c-5e97-4dcc-b32d-9fefc0769806 owned by network:router_gateway {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:19.958670 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.002273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-2025304854-network', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:20.010155 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=160df101-849a-42bd-be78-5aa7d33f7f44,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:20.035193 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f453625-aaba-434d-bb3e-b981aaee45af tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.103115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f453625-aaba-434d-bb3e-b981aaee45af tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.106024 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-5bd99fe0-e5dc-4e63-bc24-4d2affae5245 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port a58e708c-50a4-4135-8c1f-8d028c585717 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:20.106369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bd99fe0-e5dc-4e63-bc24-4d2affae5245 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.112823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-550c8a31-aacd-4f42-a293-e6fea722cd46 None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:20.114315 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-550c8a31-aacd-4f42-a293-e6fea722cd46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.174648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f453625-aaba-434d-bb3e-b981aaee45af tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'SecurityGroup': ['ID=92de2ae6-4508-444e-9373-8290868944c7,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:20.201319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Made reservation on behalf of a1d5a7f281834a22aee867878a76c226 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:20.207091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.223865 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.229259 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9f453625-aaba-434d-bb3e-b981aaee45af tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.234249 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9f453625-aaba-434d-bb3e-b981aaee45af tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5063035 Dec 10 14:30:20.235225 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58430) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:20.240943 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-339d7b7b-8fdd-4f9d-9744-82085f800911 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'security_group': {'name': 'tempest-secgroup-987928233'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:20.257782 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.277931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bd99fe0-e5dc-4e63-bc24-4d2affae5245 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.299717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=0246a92c-5e97-4dcc-b32d-9fefc0769806,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:20.333823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e8b7a7c-c592-40d0-820f-2bab4da5c686 None None] Deleting port 9b75e5f0-a26b-4378-a24a-22245f796466 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:20.333823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e8b7a7c-c592-40d0-820f-2bab4da5c686 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.371808 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-755ba06d-2e0e-4bd6-bfad-59271846001b None None] Update dhcp port {'port': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'fixed_ips': [{'subnet_id': '4ed8fa39-6227-404f-b028-d7f1709e961b', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': '274eb16c-9a10-413e-860b-79094f7e365b'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'a9806abc-452a-4508-9309-5d82a1b98504'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:30:20.374012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fa5c5d6-db8c-4d67-a650-27bf25098b10 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:20.387430 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.418551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-339d7b7b-8fdd-4f9d-9744-82085f800911 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.457929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-2f6b417d-30b8-4497-9a3f-50f4ed6b314f None None] For port cecb1930-537c-4b20-b12e-a9f755f1fcf6, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cecb1930-537c-4b20-b12e-a9f755f1fcf6,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:20.500908 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.506112 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.528142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-755ba06d-2e0e-4bd6-bfad-59271846001b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.564636 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e8b7a7c-c592-40d0-820f-2bab4da5c686 None None] For port 9b75e5f0-a26b-4378-a24a-22245f796466, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=9b75e5f0-a26b-4378-a24a-22245f796466,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:20.565111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e8b7a7c-c592-40d0-820f-2bab4da5c686 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.599610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-339d7b7b-8fdd-4f9d-9744-82085f800911 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.610136 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2f6b417d-30b8-4497-9a3f-50f4ed6b314f None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.619643 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e8b7a7c-c592-40d0-820f-2bab4da5c686 None None] Calling delete_port for 9b75e5f0-a26b-4378-a24a-22245f796466 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:20.649993 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:30:16Z', 'revision_number': 7, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:20.657243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.658868 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Fanout notify agent at l3_agent the message router_deleted on router 9d7899bb-a9e2-467f-bfc6-02634a8598ca {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:30:20.669804 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.674140 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-606db76b-431d-4081-9a3b-9f8de2d7240e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/routers/9d7899bb-a9e2-467f-bfc6-02634a8598ca HTTP/1.1" status: 204 len: 168 time: 1.4522526 Dec 10 14:30:20.674140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58432) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:20.675731 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.677845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-5bd99fe0-e5dc-4e63-bc24-4d2affae5245 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for a58e708c-50a4-4135-8c1f-8d028c585717 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:20.695735 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-339d7b7b-8fdd-4f9d-9744-82085f800911 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.704591 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2f6b417d-30b8-4497-9a3f-50f4ed6b314f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.742497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b3dee45-c6f5-4c80-9eba-9a59d0ac1de2 None None] The sync data for ids ['9d7899bb-a9e2-467f-bfc6-02634a8598ca'] in dv-neutron-821401-2-hyperv is: [{'id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'name': 'tempest-TestNetworkBasicOps-router-2137856858', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108'}], 'enable_snat': True}, 'gw_port_id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:27:17Z', 'updated_at': '2021-12-10T14:30:16Z', 'revision_number': 7, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '0246a92c-5e97-4dcc-b32d-9fefc0769806', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:f2:6e:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d7899bb-a9e2-467f-bfc6-02634a8598ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 713, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:27:19Z', 'updated_at': '2021-12-10T14:27:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:20.804044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339d7b7b-8fdd-4f9d-9744-82085f800911 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'SecurityGroup': ['ID=07d00b59-b5af-4433-b1dd-d4b515d901dd,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:20.818890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.865504 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-339d7b7b-8fdd-4f9d-9744-82085f800911 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.869251 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-339d7b7b-8fdd-4f9d-9744-82085f800911 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6305356 Dec 10 14:30:20.872168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58434) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:20.876784 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-836217880', 'security_groups': ['07d00b59-b5af-4433-b1dd-d4b515d901dd'], 'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '274eb16c-9a10-413e-860b-79094f7e365b'}]}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:20.934702 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f6b417d-30b8-4497-9a3f-50f4ed6b314f None None] Pushing event updated for resources: {'Port': ['ID=cecb1930-537c-4b20-b12e-a9f755f1fcf6,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:20.947601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router d2ee67c4-432f-4d44-92f7-f652b9c8f167 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:20.965670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 9b75e5f0-a26b-4378-a24a-22245f796466 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:20.966052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:20.988781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-755ba06d-2e0e-4bd6-bfad-59271846001b None None] Allocated IP 2001:db8::2 (62f6936a-4052-4c55-a4da-5b8b8be326f4/274eb16c-9a10-413e-860b-79094f7e365b/a9806abc-452a-4508-9309-5d82a1b98504) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:20.989930 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.066857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port 9b75e5f0-a26b-4378-a24a-22245f796466, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=9b75e5f0-a26b-4378-a24a-22245f796466,segment=NetworkSegment(adfc0116-69c7-41b9-a20f-0f8e0f0c5109),segment_id=adfc0116-69c7-41b9-a20f-0f8e0f0c5109)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:21.067231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.090021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 9b75e5f0-a26b-4378-a24a-22245f796466 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:21.138306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:21.144759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.151477 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f9cb70f-6972-4c45-b563-d702eca1d254 None None] Sync routers for ids ['d2ee67c4-432f-4d44-92f7-f652b9c8f167'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:21.170765 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f9cb70f-6972-4c45-b563-d702eca1d254 None None] Routers {'d2ee67c4-432f-4d44-92f7-f652b9c8f167'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:21.171556 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8f9cb70f-6972-4c45-b563-d702eca1d254 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d2ee67c4-432f-4d44-92f7-f652b9c8f167'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:21.171718 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-97818707-d802-46d8-b87b-56c28b65d6f3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/d2ee67c4-432f-4d44-92f7-f652b9c8f167/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0434623 Dec 10 14:30:21.196958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58436) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:21.204066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:21.219004 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c406e240-ef5c-4b21-b925-a403992bfc39,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:21.307681 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8f9cb70f-6972-4c45-b563-d702eca1d254 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:21.308120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.321709 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f9cb70f-6972-4c45-b563-d702eca1d254 None None] Routers {'d2ee67c4-432f-4d44-92f7-f652b9c8f167'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:21.322703 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8f9cb70f-6972-4c45-b563-d702eca1d254 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['d2ee67c4-432f-4d44-92f7-f652b9c8f167'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:21.362893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e8b7a7c-c592-40d0-820f-2bab4da5c686 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.392037 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8f9cb70f-6972-4c45-b563-d702eca1d254 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:21.393388 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f9cb70f-6972-4c45-b563-d702eca1d254 None None] The sync data for ids ['d2ee67c4-432f-4d44-92f7-f652b9c8f167'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:21.406685 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e8b7a7c-c592-40d0-820f-2bab4da5c686 None None] Pushing event deleted for resources: {'Port': ['ID=9b75e5f0-a26b-4378-a24a-22245f796466,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:21.407585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bd99fe0-e5dc-4e63-bc24-4d2affae5245 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.410366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] vlan segment allocate from pool success with {'vlan_id': 387, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:30:21.414606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e8b7a7c-c592-40d0-820f-2bab4da5c686 None None] No DVR routers for this DVR port 9b75e5f0-a26b-4378-a24a-22245f796466 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:21.462647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] No DVR routers for this DVR port 9b75e5f0-a26b-4378-a24a-22245f796466 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:21.471945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=9b75e5f0-a26b-4378-a24a-22245f796466,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:21.483686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bd99fe0-e5dc-4e63-bc24-4d2affae5245 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=a58e708c-50a4-4135-8c1f-8d028c585717,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:21.496744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.501741 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Added segment 3002d938-5fba-44ab-8087-00a333e47ca8 of type vlan for network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f Dec 10 14:30:21.510422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-755ba06d-2e0e-4bd6-bfad-59271846001b None None] For port a9806abc-452a-4508-9309-5d82a1b98504, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a9806abc-452a-4508-9309-5d82a1b98504,segment=NetworkSegment(f87ad518-f300-4f42-a1a0-01a3d390e144),segment_id=f87ad518-f300-4f42-a1a0-01a3d390e144)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:21.546055 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device cecb1930-537c-4b20-b12e-a9f755f1fcf6 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:21.611798 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-755ba06d-2e0e-4bd6-bfad-59271846001b None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.643209 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bd99fe0-e5dc-4e63-bc24-4d2affae5245 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.649582 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5bd99fe0-e5dc-4e63-bc24-4d2affae5245 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/a58e708c-50a4-4135-8c1f-8d028c585717 HTTP/1.1" status: 204 len: 168 time: 1.7751377 Dec 10 14:30:21.655070 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58438) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:21.655273 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port cecb1930-537c-4b20-b12e-a9f755f1fcf6 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:21.655654 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.665465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.668679 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-eda28630-715d-4e87-b822-3dd45312b9c4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] remove_router_interface failed (client error): The resource could not be found. Dec 10 14:30:21.669858 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-eda28630-715d-4e87-b822-3dd45312b9c4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/d2ee67c4-432f-4d44-92f7-f652b9c8f167/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.4718697 Dec 10 14:30:21.692660 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58440) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:21.698605 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-755ba06d-2e0e-4bd6-bfad-59271846001b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.764240 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5c9f92cf-3ee1-488c-8a9b-f7dd403d85e4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=d2ee67c4-432f-4d44-92f7-f652b9c8f167 HTTP/1.1" status: 200 len: 205 time: 0.0699277 Dec 10 14:30:21.767310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58442) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:21.769343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.798396 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b4ddbd6-2c33-40b0-8cf3-e1a1632ad4f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:21.800912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b4ddbd6-2c33-40b0-8cf3-e1a1632ad4f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:21.802733 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b4ddbd6-2c33-40b0-8cf3-e1a1632ad4f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:21.804958 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6b4ddbd6-2c33-40b0-8cf3-e1a1632ad4f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1414468 Dec 10 14:30:21.809877 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58444) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:21.846652 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-755ba06d-2e0e-4bd6-bfad-59271846001b None None] Pushing event updated for resources: {'Port': ['ID=a9806abc-452a-4508-9309-5d82a1b98504,revision_number=6']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:21.877806 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:21.878785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:21.879359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.000169 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-bbd0ac2c-8b10-4631-a22b-700db88d3b2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 48ae817e-c6a9-4f5d-9b6c-c87aab128156 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:22.020835 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 2.2091165 Dec 10 14:30:22.020835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd0ac2c-8b10-4631-a22b-700db88d3b2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.035260 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 9b75e5f0-a26b-4378-a24a-22245f796466 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:22.037186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58446) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:22.066495 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 9b75e5f0-a26b-4378-a24a-22245f796466 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:22.066809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 9b75e5f0-a26b-4378-a24a-22245f796466 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:22.067168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7099f252-8b6b-4127-8ac0-b819a3d01e75 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:22.071258 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Request body: {'subnet': {'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-2025304854-subnet', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'ip_version': 4}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:22.089462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7776ef5f-8d2a-47a6-918d-9ca76afa290b admin admin] Pushing event updated for resources: {'Network': ['ID=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:22.098451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 7099f252-8b6b-4127-8ac0-b819a3d01e75 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:22.098803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 7099f252-8b6b-4127-8ac0-b819a3d01e75 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:22.112481 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:30:22.118655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd0ac2c-8b10-4631-a22b-700db88d3b2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.176244 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-5b47a05d-27de-44ae-8b2c-c8aa7bac80d0 None None] Provisioning complete for port cecb1930-537c-4b20-b12e-a9f755f1fcf6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:22.176618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5b47a05d-27de-44ae-8b2c-c8aa7bac80d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.234576 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd0ac2c-8b10-4631-a22b-700db88d3b2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.291594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Made reservation on behalf of a1d5a7f281834a22aee867878a76c226 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:22.295423 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.326919 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.335443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['041ac3a9-0ca7-4449-9782-639f1235b461']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:22.347269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:22.347477 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'adfc0116-69c7-41b9-a20f-0f8e0f0c5109') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:22.386800 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.405734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8ab57ac9-c1ba-4a0f-9af1-3da5b110275f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.456389 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.459065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] device_id is not set on port 37a078bd-c02d-415b-a955-ad1a3f49706d yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:30:22.505359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd0ac2c-8b10-4631-a22b-700db88d3b2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.505877 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Releasing vlan 391 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:30:22.506290 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: items = [ Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:30:22.509362 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:30:22.527364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-8d62faff-ee87-4b2e-b951-cc91eaac96b0 None None] Could not find standard attr ID for object a58e708c-50a4-4135-8c1f-8d028c585717. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:22.550596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd0ac2c-8b10-4631-a22b-700db88d3b2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=48ae817e-c6a9-4f5d-9b6c-c87aab128156,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:22.563028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bbd0ac2c-8b10-4631-a22b-700db88d3b2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.568545 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bbd0ac2c-8b10-4631-a22b-700db88d3b2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/48ae817e-c6a9-4f5d-9b6c-c87aab128156 HTTP/1.1" status: 204 len: 168 time: 0.7576413 Dec 10 14:30:22.574257 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58448) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:22.637676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-4d0f345e-55cd-4f01-83f2-52f724b3bc05 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet b92e4239-8c60-49f3-82cc-fa2b69fdb4bf {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:22.641538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.644225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4d0f345e-55cd-4f01-83f2-52f724b3bc05 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.710592 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8ab57ac9-c1ba-4a0f-9af1-3da5b110275f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.715002 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8ab57ac9-c1ba-4a0f-9af1-3da5b110275f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.729636 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4d0f345e-55cd-4f01-83f2-52f724b3bc05 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.786358 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d34297eb-b45e-40a3-93a5-fff721097da7,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:22.803496 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Checking segment: {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:22.809568 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Network hostable DHCP agents. Network: e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:30:22.855000 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-383ec4ee-d20f-4bc6-8d3d-db1c327f8efa None None] Provisioning complete for port c93cdb3c-f190-4d12-85d0-6fafb9086b92 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:22.855378 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-383ec4ee-d20f-4bc6-8d3d-db1c327f8efa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.865528 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.869656 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4d0f345e-55cd-4f01-83f2-52f724b3bc05 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.886973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.890384 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/networks/041ac3a9-0ca7-4449-9782-639f1235b461 HTTP/1.1" status: 204 len: 168 time: 2.2149801 Dec 10 14:30:22.897565 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f41c316-2a0d-46b2-8804-8dd2d475b686 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:22.915373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58450) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:22.916096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8ab57ac9-c1ba-4a0f-9af1-3da5b110275f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.916327 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ab57ac9-c1ba-4a0f-9af1-3da5b110275f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Fanout notify agent at l3_agent the message router_deleted on router d2ee67c4-432f-4d44-92f7-f652b9c8f167 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:30:22.922625 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'network': {'name': 'tempest-network-smoke--690089249', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'port_security_enabled': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:22.931701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8ab57ac9-c1ba-4a0f-9af1-3da5b110275f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:22.932874 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8ab57ac9-c1ba-4a0f-9af1-3da5b110275f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/d2ee67c4-432f-4d44-92f7-f652b9c8f167 HTTP/1.1" status: 204 len: 168 time: 1.1606588 Dec 10 14:30:22.933920 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dfcc579-c6cd-4f58-a836-1b9fcbd08a2f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Network': ['ID=041ac3a9-0ca7-4449-9782-639f1235b461,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:22.937203 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58452) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:22.960100 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-383ec4ee-d20f-4bc6-8d3d-db1c327f8efa None None] Port c93cdb3c-f190-4d12-85d0-6fafb9086b92 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:22.982621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-383ec4ee-d20f-4bc6-8d3d-db1c327f8efa None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:22.982999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-383ec4ee-d20f-4bc6-8d3d-db1c327f8efa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.001360 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:30:23.006481 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-1cf5fd49-f5d7-4abd-9236-8a262865e192 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting subnet 73c675c1-06c8-45f2-a602-9df68c0a5ff7 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:23.009807 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1cf5fd49-f5d7-4abd-9236-8a262865e192 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.051058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8::29 (62f6936a-4052-4c55-a4da-5b8b8be326f4/274eb16c-9a10-413e-860b-79094f7e365b/37a078bd-c02d-415b-a955-ad1a3f49706d) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:23.061210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1cf5fd49-f5d7-4abd-9236-8a262865e192 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.088117 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:23.091757 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.100887 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:23.106071 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:23.112712 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.131047 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f1d95d9-7483-4f10-8032-2fc7467995ea None None] Network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:23.163069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] vlan segment allocate from pool success with {'vlan_id': 353, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:30:23.166742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4d0f345e-55cd-4f01-83f2-52f724b3bc05 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.206027 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-74740ebc-2990-453d-af29-594e1ad483b2 admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.1381869 Dec 10 14:30:23.206903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d0f345e-55cd-4f01-83f2-52f724b3bc05 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=b92e4239-8c60-49f3-82cc-fa2b69fdb4bf,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:23.209710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58454) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:23.212388 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4d0f345e-55cd-4f01-83f2-52f724b3bc05 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.219801 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4d0f345e-55cd-4f01-83f2-52f724b3bc05 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/b92e4239-8c60-49f3-82cc-fa2b69fdb4bf HTTP/1.1" status: 204 len: 168 time: 0.6413951 Dec 10 14:30:23.225106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:23.228058 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58456) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:23.256805 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'fixed_ips': [{'subnet_id': 'd34297eb-b45e-40a3-93a5-fff721097da7'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:23.257318 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.261336 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.261336 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Added segment 2d62797f-ef39-42b9-9390-c745f87a2ead of type vlan for network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 Dec 10 14:30:23.281395 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58458) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:23.281547 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-32cda74c-e7f1-43f6-b51c-7565accf2391 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0523567 Dec 10 14:30:23.335062 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:23.372110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.372864 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1cf5fd49-f5d7-4abd-9236-8a262865e192 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.374277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.390978 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a9806abc-452a-4508-9309-5d82a1b98504 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:23.452950 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.475512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.504233 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:23.505290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.506869 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Allocated IP 172.20.0.2 (e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f/d34297eb-b45e-40a3-93a5-fff721097da7/1815fff4-f85c-4cb7-8fb3-5238ec0b84d1) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:23.540380 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.655045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.661382 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:23.662073 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.693905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1cf5fd49-f5d7-4abd-9236-8a262865e192 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.696444 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.710358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.731736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.735164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:23.739550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.741663 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0246a92c-5e97-4dcc-b32d-9fefc0769806 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:23.768131 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88778d34-9bcf-4854-b003-9a6ac3ea51d8 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:23.770364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 0246a92c-5e97-4dcc-b32d-9fefc0769806 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:23.770703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0246a92c-5e97-4dcc-b32d-9fefc0769806 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:23.816103 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.820462 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf5fd49-f5d7-4abd-9236-8a262865e192 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Subnet': ['ID=73c675c1-06c8-45f2-a602-9df68c0a5ff7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:23.859943 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b13fb26-b692-4cd1-817c-965935b8c54c None None] Network 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:23.865382 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1cf5fd49-f5d7-4abd-9236-8a262865e192 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.871411 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1cf5fd49-f5d7-4abd-9236-8a262865e192 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/73c675c1-06c8-45f2-a602-9df68c0a5ff7 HTTP/1.1" status: 204 len: 168 time: 0.9307303 Dec 10 14:30:23.873949 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58460) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:23.879454 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.9610617 Dec 10 14:30:23.885227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58462) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:23.891187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-318858189', 'admin_state_up': True, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:23.891983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f02aefe3-2b98-4d67-918b-7b35363f73db tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Network': ['ID=6227fea4-3842-4a83-a78f-a5ec3bccdb07,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:23.901892 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:23.910871 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:23.919085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:23.925115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:23.925752 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:23.928881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=37a078bd-c02d-415b-a955-ad1a3f49706d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:23.950810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:30:23.978576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Pushing event updated for resources: {'Port': ['ID=1815fff4-f85c-4cb7-8fb3-5238ec0b84d1,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:24.019329 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.041899 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-97f59e1e-5d4b-46f3-9bb7-0cea944868ac None None] Provisioning complete for port cecb1930-537c-4b20-b12e-a9f755f1fcf6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:24.042278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-97f59e1e-5d4b-46f3-9bb7-0cea944868ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.060696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:24.088897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.091582 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:24.092081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.115593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:24.142059 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fc43c900-5967-41a5-b55c-8bead50cfcdb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 3.2665441 Dec 10 14:30:24.144775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58464) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:24.149190 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-48c17554-30c1-4f9b-8059-abc0c7693f0d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:24.219620 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d11c0f2-6940-402f-a748-8679b764790a None None] DHCP port deletion for 3d5e47e8-c136-4e46-bfdd-95d74daef4e6 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:24.254413 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Attempting to bind port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:24.254872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Attempting to bind port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:24.255371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Attempting to bind port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1 on network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:24.289349 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.296102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-add5d973-12a4-421a-a0f2-33b4e7f099a8 None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:24.298424 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:24.307013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Checking segment: {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:24.307013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.307013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Bound using segment: {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:24.307013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Bound port: 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:24.307013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.327554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port b2ad84d1-0864-4189-9875-81b9ef82fd92 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:24.327940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.423243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.427736 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2d11c0f2-6940-402f-a748-8679b764790a None None] Deleting port b2ad84d1-0864-4189-9875-81b9ef82fd92 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:24.428390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2d11c0f2-6940-402f-a748-8679b764790a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.444887 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.objects.ports [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103810) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:30:24.446190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.453706 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] For port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:24.495259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-add5d973-12a4-421a-a0f2-33b4e7f099a8 None None] Deleting port cecb1930-537c-4b20-b12e-a9f755f1fcf6 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:24.495738 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-add5d973-12a4-421a-a0f2-33b4e7f099a8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.506977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] For port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1815fff4-f85c-4cb7-8fb3-5238ec0b84d1,segment=NetworkSegment(3002d938-5fba-44ab-8087-00a333e47ca8),segment_id=3002d938-5fba-44ab-8087-00a333e47ca8)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:24.538752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port b2ad84d1-0864-4189-9875-81b9ef82fd92, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b2ad84d1-0864-4189-9875-81b9ef82fd92,segment=NetworkSegment(9a435957-a659-4401-92bd-6645ad45c2ae),segment_id=9a435957-a659-4401-92bd-6645ad45c2ae)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:24.539124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.565901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3d7b4c23-9397-40ae-b7c8-7df7a5030bfe None None] Provisioning complete for port 37a078bd-c02d-415b-a955-ad1a3f49706d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:24.566359 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3d7b4c23-9397-40ae-b7c8-7df7a5030bfe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.568584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48c17554-30c1-4f9b-8059-abc0c7693f0d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:24.573987 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-2d11c0f2-6940-402f-a748-8679b764790a None None] For port b2ad84d1-0864-4189-9875-81b9ef82fd92, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b2ad84d1-0864-4189-9875-81b9ef82fd92,segment=NetworkSegment(9a435957-a659-4401-92bd-6645ad45c2ae),segment_id=9a435957-a659-4401-92bd-6645ad45c2ae)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:24.573987 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2d11c0f2-6940-402f-a748-8679b764790a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.574210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-48c17554-30c1-4f9b-8059-abc0c7693f0d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.589801 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for b2ad84d1-0864-4189-9875-81b9ef82fd92 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:24.609246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.625052 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2d11c0f2-6940-402f-a748-8679b764790a None None] Calling delete_port for b2ad84d1-0864-4189-9875-81b9ef82fd92 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:24.632035 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.724531 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.ipam_backend_mixin [None req-48c17554-30c1-4f9b-8059-abc0c7693f0d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 274eb16c-9a10-413e-860b-79094f7e365b (CIDR: 2001:db8::/64) Dec 10 14:30:24.729123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Allocated IP 172.26.2.227 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/40d334eb-b103-4069-ab9a-9a2090c6f40b) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:24.838303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3d7b4c23-9397-40ae-b7c8-7df7a5030bfe None None] Port 37a078bd-c02d-415b-a955-ad1a3f49706d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:24.853984 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.916607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-add5d973-12a4-421a-a0f2-33b4e7f099a8 None None] For port cecb1930-537c-4b20-b12e-a9f755f1fcf6, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cecb1930-537c-4b20-b12e-a9f755f1fcf6,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:24.917082 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-add5d973-12a4-421a-a0f2-33b4e7f099a8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:24.920961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57295140-8ea4-40ac-8a98-30219d856836 None None] Pushing event updated for resources: {'Port': ['ID=1815fff4-f85c-4cb7-8fb3-5238ec0b84d1,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:24.947121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-add5d973-12a4-421a-a0f2-33b4e7f099a8 None None] Calling delete_port for cecb1930-537c-4b20-b12e-a9f755f1fcf6 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:25.057868 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-48c17554-30c1-4f9b-8059-abc0c7693f0d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:25.058533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-48c17554-30c1-4f9b-8059-abc0c7693f0d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:25.145284 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.157325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.163290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2d11c0f2-6940-402f-a748-8679b764790a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.164318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.200607 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-48c17554-30c1-4f9b-8059-abc0c7693f0d tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.0569174 Dec 10 14:30:25.203988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d11c0f2-6940-402f-a748-8679b764790a None None] Pushing event deleted for resources: {'Port': ['ID=b2ad84d1-0864-4189-9875-81b9ef82fd92,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:25.206108 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d11c0f2-6940-402f-a748-8679b764790a None None] No DVR routers for this DVR port b2ad84d1-0864-4189-9875-81b9ef82fd92 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:25.211108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58466) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:25.224268 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-139f9903-eaf4-408c-9f53-b4ae6e3fba96 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:25.233550 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No DVR routers for this DVR port b2ad84d1-0864-4189-9875-81b9ef82fd92 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:25.238210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-add5d973-12a4-421a-a0f2-33b4e7f099a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.252577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:25.266117 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add5d973-12a4-421a-a0f2-33b4e7f099a8 None None] Pushing event deleted for resources: {'Port': ['ID=cecb1930-537c-4b20-b12e-a9f755f1fcf6,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:25.270403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-add5d973-12a4-421a-a0f2-33b4e7f099a8 None None] No DVR routers for this DVR port cecb1930-537c-4b20-b12e-a9f755f1fcf6 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:25.311676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:25.314179 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:25.351660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2017c541-fca3-4eb5-bd42-f488ccbe04f9 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:25.408774 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:25.452308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] For port cecb1930-537c-4b20-b12e-a9f755f1fcf6, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cecb1930-537c-4b20-b12e-a9f755f1fcf6,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:25.480697 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-516c8ad8-0361-4860-982d-7aaeb9a06ea4 None None] Provisioning complete for port 40d334eb-b103-4069-ab9a-9a2090c6f40b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:25.481077 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-516c8ad8-0361-4860-982d-7aaeb9a06ea4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.497482 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.515716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:25.516085 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.535541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-139f9903-eaf4-408c-9f53-b4ae6e3fba96 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:25.539469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-139f9903-eaf4-408c-9f53-b4ae6e3fba96 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.550613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-516c8ad8-0361-4860-982d-7aaeb9a06ea4 None None] Port 40d334eb-b103-4069-ab9a-9a2090c6f40b cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:25.587628 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.588367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.609117 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.652699 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1815fff4-f85c-4cb7-8fb3-5238ec0b84d1,segment=NetworkSegment(3002d938-5fba-44ab-8087-00a333e47ca8),segment_id=3002d938-5fba-44ab-8087-00a333e47ca8)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:25.671191 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=cecb1930-537c-4b20-b12e-a9f755f1fcf6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:25.683655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:25.697210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:25.708521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:25.708521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.713107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2955a26b-d145-4a05-9bb8-7c1955f7bb02 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:25.722670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=f0d5e6c7-fdb1-4e45-816f-fb86f5a294cf,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:25.737041 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.ipam_backend_mixin [None req-139f9903-eaf4-408c-9f53-b4ae6e3fba96 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Validation for CIDR: 2001:db8:0:1::/64 failed - overlaps with subnet 4ed8fa39-6227-404f-b028-d7f1709e961b (CIDR: 2001:db8:0:1::/64) Dec 10 14:30:25.745919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.788330 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-139f9903-eaf4-408c-9f53-b4ae6e3fba96 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:25.789028 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-139f9903-eaf4-408c-9f53-b4ae6e3fba96 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:25.810088 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-913671ce-4d38-4696-93ab-eee9e651410f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.5158074 Dec 10 14:30:25.812749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58468) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:25.819622 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:25.823614 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Pushing event updated for resources: {'Port': ['ID=40d334eb-b103-4069-ab9a-9a2090c6f40b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:25.845663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.851219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b2ad84d1-0864-4189-9875-81b9ef82fd92 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:25.876181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=b2ad84d1-0864-4189-9875-81b9ef82fd92,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:25.884754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: b2ad84d1-0864-4189-9875-81b9ef82fd92 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:25.885325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b2ad84d1-0864-4189-9875-81b9ef82fd92 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:25.885808 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device cecb1930-537c-4b20-b12e-a9f755f1fcf6 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:25.911726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3d5e47e8-c136-4e46-bfdd-95d74daef4e6']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:25.914249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:25.919546 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-139f9903-eaf4-408c-9f53-b4ae6e3fba96 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 428 time: 0.7035320 Dec 10 14:30:25.925644 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58470) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:25.930516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'subnet': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'cidr': '2001:db8:0:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:2::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:25.940640 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: cecb1930-537c-4b20-b12e-a9f755f1fcf6 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:25.941153 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device cecb1930-537c-4b20-b12e-a9f755f1fcf6 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:25.948598 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a435957-a659-4401-92bd-6645ad45c2ae') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:25.951439 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a435957-a659-4401-92bd-6645ad45c2ae') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:25.963593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=1815fff4-f85c-4cb7-8fb3-5238ec0b84d1,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:26.018957 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': 'f0d5e6c7-fdb1-4e45-816f-fb86f5a294cf'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:26.023771 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.033337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.107585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.157507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.166906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0793513-b1bc-44c3-b751-530c0f14ec29 None None] Network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:26.169399 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Releasing vlan 389 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:30:26.169857 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:30:26.172802 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:30:26.209775 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:26.214836 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.223258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Allocated IP 2001:db8::f816:3eff:fe4a:7f01 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/f0d5e6c7-fdb1-4e45-816f-fb86f5a294cf/d1bd774f-7cce-4e4b-b81b-15515d08daf5) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:26.319935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.26.2.104 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/5a50d5fe-7e23-4220-a824-58a665d0e7c5) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:26.348804 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Made reservation on behalf of cc793beea85f4cf887a3485aad20d8e7 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:26.352602 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.390467 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-986e4ebc-1496-4343-b0ee-84f5a2b3e2c8 None None] Provisioning complete for port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:26.390467 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-986e4ebc-1496-4343-b0ee-84f5a2b3e2c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.423996 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.434969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.443306 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/networks/3d5e47e8-c136-4e46-bfdd-95d74daef4e6 HTTP/1.1" status: 204 len: 168 time: 2.5675423 Dec 10 14:30:26.449751 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58472) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:26.457548 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'network': {'name': 'tempest-RoutersTest-1946125185'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:26.501465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f4eddb5-e56c-4390-8f2b-614701ef419c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Network': ['ID=3d5e47e8-c136-4e46-bfdd-95d74daef4e6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:26.523891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.537238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.606740 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:26.610498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.617634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.629465 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.655115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.674372 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:26.678643 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:26.684725 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:26.697378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] vlan segment allocate from pool success with {'vlan_id': 374, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:30:26.726046 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.726392 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added segment 0303987c-d3b8-4585-bea4-664051940a49 of type vlan for network 4037f0f9-74b6-4ebb-9901-86102564dbf9 Dec 10 14:30:26.742165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Pushing event updated for resources: {'Port': ['ID=d1bd774f-7cce-4e4b-b81b-15515d08daf5,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:26.752548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:26.753559 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Attempting to bind port d1bd774f-7cce-4e4b-b81b-15515d08daf5 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:26.753944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Attempting to bind port d1bd774f-7cce-4e4b-b81b-15515d08daf5 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:26.754342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Attempting to bind port d1bd774f-7cce-4e4b-b81b-15515d08daf5 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:26.763346 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:26.763834 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:26.764303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.765141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:26.765281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Bound port: d1bd774f-7cce-4e4b-b81b-15515d08daf5, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:26.765733 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.766010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:26.769350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:26.770213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.775483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=c3586ecc-e9f2-4723-911c-1c07785f6890,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:26.816424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.816892 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d308ad0c-a7c6-435d-adb2-12434c8e61f2 None None] Provisioning complete for port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:26.817330 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d308ad0c-a7c6-435d-adb2-12434c8e61f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.820639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.863270 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.880105 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] For port d1bd774f-7cce-4e4b-b81b-15515d08daf5, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:26.881524 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:26.884177 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] For port d1bd774f-7cce-4e4b-b81b-15515d08daf5, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d1bd774f-7cce-4e4b-b81b-15515d08daf5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:26.902751 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-66584cc6-d518-4e5e-8fe1-92526e42f35b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0860343 Dec 10 14:30:26.914497 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:26.915347 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58474) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:26.919767 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:26.922898 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:26.923081 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:26.924206 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:26.928952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:75:9f:c2', 'name': 'tempest-NetworksTestDHCPv6-1761861671'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:26.933767 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c31239e-9ad0-4464-ad8b-0c139dfe7bca None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:26.940250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:26.949721 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Subnet': ['ID=f0ee04cf-d1c6-4d5a-b0b7-f5b64e3f07e2,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:26.954840 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8756154-38d7-4d33-8331-8f1cdb7ae677 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:26.958902 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=5a50d5fe-7e23-4220-a824-58a665d0e7c5,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:26.993525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.040754 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.055398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.061001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:27.061751 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.079078 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9e4c10c6-bbcc-418b-b553-e2bf58540deb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.1536040 Dec 10 14:30:27.086891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58476) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:27.094551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-339112236', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'f0ee04cf-d1c6-4d5a-b0b7-f5b64e3f07e2'}], 'security_groups': ['aa35563b-f7c7-4fc8-bd6e-3abebda57c57', '92de2ae6-4508-444e-9373-8290868944c7']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:27.109066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e8e1952-c969-40b8-b96e-aa0479114652 None None] Pushing event updated for resources: {'Port': ['ID=d1bd774f-7cce-4e4b-b81b-15515d08daf5,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:27.120070 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c9057f77-06ac-4a36-a438-23cbf5f22d28 None None] Provisioning complete for port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:27.120442 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c9057f77-06ac-4a36-a438-23cbf5f22d28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.168722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c9057f77-06ac-4a36-a438-23cbf5f22d28 None None] Port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:27.194828 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.252198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d21b3c2a-40b9-4aa0-9d7c-ab39dde9fcff None None] Update dhcp port {'port': {'network_id': '62f6936a-4052-4c55-a4da-5b8b8be326f4', 'fixed_ips': [{'subnet_id': '4ed8fa39-6227-404f-b028-d7f1709e961b', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': '274eb16c-9a10-413e-860b-79094f7e365b', 'ip_address': '2001:db8::2'}, {'subnet_id': 'f0ee04cf-d1c6-4d5a-b0b7-f5b64e3f07e2'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'a9806abc-452a-4508-9309-5d82a1b98504'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:30:27.298885 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d21b3c2a-40b9-4aa0-9d7c-ab39dde9fcff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.303144 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.8487725 Dec 10 14:30:27.328645 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58478) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:27.348357 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'subnet': {'network_id': '4037f0f9-74b6-4ebb-9901-86102564dbf9', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:27.403182 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:27.444752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22ff566b-21e5-4f54-8486-1f02b21c0127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Network': ['ID=4037f0f9-74b6-4ebb-9901-86102564dbf9,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:27.483344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 4037f0f9-74b6-4ebb-9901-86102564dbf9 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:30:27.587886 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 1815fff4-f85c-4cb7-8fb3-5238ec0b84d1 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:27.588306 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.649557 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Delete allocated IP 2001:db8::29 (62f6936a-4052-4c55-a4da-5b8b8be326f4/274eb16c-9a10-413e-860b-79094f7e365b) {{(pid=103810) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 10 14:30:27.665402 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Allocated IP 2001:db8:0:2::3e1 (62f6936a-4052-4c55-a4da-5b8b8be326f4/f0ee04cf-d1c6-4d5a-b0b7-f5b64e3f07e2/37a078bd-c02d-415b-a955-ad1a3f49706d) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:27.666390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:27.707513 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:30:27.841182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.854575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:27.858143 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.935438 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.935891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:27.937831 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:28.000139 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] In _notify_port_updated(), no bound segment for port 37a078bd-c02d-415b-a955-ad1a3f49706d on network 62f6936a-4052-4c55-a4da-5b8b8be326f4 {{(pid=103810) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 10 14:30:28.005778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:28.007069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:28.008159 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "PUT /v2.0/ports/37a078bd-c02d-415b-a955-ad1a3f49706d HTTP/1.1" status: 200 len: 969 time: 0.9199159 Dec 10 14:30:28.011103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58480) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:28.019554 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-d21b3c2a-40b9-4aa0-9d7c-ab39dde9fcff None None] Allocated IP 2001:db8:0:2::2 (62f6936a-4052-4c55-a4da-5b8b8be326f4/f0ee04cf-d1c6-4d5a-b0b7-f5b64e3f07e2/a9806abc-452a-4508-9309-5d82a1b98504) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:28.023865 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f81633-e51d-4f3c-932d-f7fac7b4130e tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event updated for resources: {'Port': ['ID=37a078bd-c02d-415b-a955-ad1a3f49706d,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:28.074493 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port 8b97ccd1-1856-4fba-aa18-eefbdd7b4e58 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:30:28.163742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d21b3c2a-40b9-4aa0-9d7c-ab39dde9fcff None None] For port a9806abc-452a-4508-9309-5d82a1b98504, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a9806abc-452a-4508-9309-5d82a1b98504,segment=NetworkSegment(f87ad518-f300-4f42-a1a0-01a3d390e144),segment_id=f87ad518-f300-4f42-a1a0-01a3d390e144)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:28.177607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:28.199197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Sync routers for ids ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:28.251034 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d21b3c2a-40b9-4aa0-9d7c-ab39dde9fcff None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:28.256140 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Routers {'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:28.257034 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:28.352138 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27da02e9-4c98-4ab9-b2a8-509dfeab81bf None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:28.392417 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:28.394763 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1da10d6d-6561-416a-accd-73204ca18b80 admin admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 5.1732435 Dec 10 14:30:28.412635 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d21b3c2a-40b9-4aa0-9d7c-ab39dde9fcff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:28.435136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58482) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:28.582668 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-624b0ba0-97fc-4569-98e7-86d66e69865a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port 37a078bd-c02d-415b-a955-ad1a3f49706d {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:28.583094 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-624b0ba0-97fc-4569-98e7-86d66e69865a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:28.691405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-624b0ba0-97fc-4569-98e7-86d66e69865a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:28.712889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-624b0ba0-97fc-4569-98e7-86d66e69865a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for 37a078bd-c02d-415b-a955-ad1a3f49706d owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:28.719106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-210c3e58-ab5e-421d-9ada-71718239666d None None] Provisioning complete for port d1bd774f-7cce-4e4b-b81b-15515d08daf5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:28.719484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-210c3e58-ab5e-421d-9ada-71718239666d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:28.789662 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21b3c2a-40b9-4aa0-9d7c-ab39dde9fcff None None] Pushing event updated for resources: {'Port': ['ID=a9806abc-452a-4508-9309-5d82a1b98504,revision_number=7']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:28.826155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Set router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:28.912276 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:28.955286 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-624b0ba0-97fc-4569-98e7-86d66e69865a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.008443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-624b0ba0-97fc-4569-98e7-86d66e69865a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=37a078bd-c02d-415b-a955-ad1a3f49706d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:29.104032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-624b0ba0-97fc-4569-98e7-86d66e69865a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.112796 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-210c3e58-ab5e-421d-9ada-71718239666d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.116773 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-624b0ba0-97fc-4569-98e7-86d66e69865a tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/37a078bd-c02d-415b-a955-ad1a3f49706d HTTP/1.1" status: 204 len: 168 time: 1.1026192 Dec 10 14:30:29.119194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58484) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:29.148283 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Subnet': ['ID=e5476e8f-088f-4ba5-ac74-99f1ba9f36c6,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:29.172994 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-a46aaa8f-e630-4dbb-9bd3-e5a876cd212c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] GET failed (client error): The resource could not be found. Dec 10 14:30:29.176616 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a46aaa8f-e630-4dbb-9bd3-e5a876cd212c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports/37a078bd-c02d-415b-a955-ad1a3f49706d HTTP/1.1" status: 404 len: 333 time: 0.0522504 Dec 10 14:30:29.178470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58486) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:29.190012 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.194798 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 172.20.0.14 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/c3586ecc-e9f2-4723-911c-1c07785f6890/8b97ccd1-1856-4fba-aa18-eefbdd7b4e58) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:29.210008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f322b76-4be1-4ac7-a1cd-2b85d971b4f7 None None] Update dhcp port {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': 'f0d5e6c7-fdb1-4e45-816f-fb86f5a294cf', 'ip_address': '2001:db8::f816:3eff:fe4a:7f01'}, {'subnet_id': 'c3586ecc-e9f2-4723-911c-1c07785f6890'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': 'd1bd774f-7cce-4e4b-b81b-15515d08daf5'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:30:29.211934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fe75:9fc2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/f0d5e6c7-fdb1-4e45-816f-fb86f5a294cf/8b97ccd1-1856-4fba-aa18-eefbdd7b4e58) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:29.260206 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-210c3e58-ab5e-421d-9ada-71718239666d None None] For port d1bd774f-7cce-4e4b-b81b-15515d08daf5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d1bd774f-7cce-4e4b-b81b-15515d08daf5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:29.264569 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Checking segment: {'id': '0303987c-d3b8-4585-bea4-664051940a49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '4037f0f9-74b6-4ebb-9901-86102564dbf9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:29.264898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6f322b76-4be1-4ac7-a1cd-2b85d971b4f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.265021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network hostable DHCP agents. Network: 4037f0f9-74b6-4ebb-9901-86102564dbf9, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:30:29.312048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c3dcdb3c-37d9-49e1-b7d3-acafa2ca209b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.343855 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-210c3e58-ab5e-421d-9ada-71718239666d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.415376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c3dcdb3c-37d9-49e1-b7d3-acafa2ca209b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.465944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227'}], 'enable_snat': True}, 'gw_port_id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:23Z', 'updated_at': '2021-12-10T14:30:26Z', 'revision_number': 3, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'gw_port': {'id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:3d:89', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1170, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:29.515200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Checking router: f78b2a0b-2685-4e50-9ccf-f76675b8f1ff for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:29.515824 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Updating router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff port 40d334eb-b103-4069-ab9a-9a2090c6f40b binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:30:29.547952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 4037f0f9-74b6-4ebb-9901-86102564dbf9 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:30:29.551049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.599768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c3dcdb3c-37d9-49e1-b7d3-acafa2ca209b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.602908 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c3dcdb3c-37d9-49e1-b7d3-acafa2ca209b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.604187 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c3dcdb3c-37d9-49e1-b7d3-acafa2ca209b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/security-groups/07d00b59-b5af-4433-b1dd-d4b515d901dd HTTP/1.1" status: 204 len: 168 time: 0.4246838 Dec 10 14:30:29.606734 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d1bd774f-7cce-4e4b-b81b-15515d08daf5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:29.615437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58488) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:29.633894 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3dcdb3c-37d9-49e1-b7d3-acafa2ca209b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=07d00b59-b5af-4433-b1dd-d4b515d901dd,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:29.648702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 4037f0f9-74b6-4ebb-9901-86102564dbf9) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:29.675567 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2891774-8a29-4da8-a65f-73cdc16c46c6 None None] Network 4037f0f9-74b6-4ebb-9901-86102564dbf9 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:29.707677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:29.708188 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.710341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9d77fd9f-1930-4780-861d-0055ffbb9fb6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.747027 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9d77fd9f-1930-4780-861d-0055ffbb9fb6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.787956 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-210c3e58-ab5e-421d-9ada-71718239666d None None] Pushing event updated for resources: {'Port': ['ID=d1bd774f-7cce-4e4b-b81b-15515d08daf5,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:29.849700 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f46de8a4-d9fc-4c0c-9072-d6395c90df4e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.5016184 Dec 10 14:30:29.851782 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58490) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:29.857938 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-202e04fa-39e7-44f0-b2cc-763feb528995 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1760317253', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:29.920333 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:29.968939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d1bd774f-7cce-4e4b-b81b-15515d08daf5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:29.969442 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.009348 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9d77fd9f-1930-4780-861d-0055ffbb9fb6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.011977 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9d77fd9f-1930-4780-861d-0055ffbb9fb6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.017064 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9d77fd9f-1930-4780-861d-0055ffbb9fb6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/security-groups/92de2ae6-4508-444e-9373-8290868944c7 HTTP/1.1" status: 204 len: 168 time: 0.4055164 Dec 10 14:30:30.017776 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58492) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:30.060233 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-48b6955f-077b-4ab3-b958-f09ef50f3d59 None None] Could not find standard attr ID for object 37a078bd-c02d-415b-a955-ad1a3f49706d. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:30.066683 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d77fd9f-1930-4780-861d-0055ffbb9fb6 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=92de2ae6-4508-444e-9373-8290868944c7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:30.076424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.084200 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router ff0346ca-999c-400f-8b50-ce9d0945eb30 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:30:30.087924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-202e04fa-39e7-44f0-b2cc-763feb528995 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.087924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-202e04fa-39e7-44f0-b2cc-763feb528995 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.093331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-4037f0f9-74b6-4ebb-9901-86102564dbf9', 'network_id': '4037f0f9-74b6-4ebb-9901-86102564dbf9', 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'fixed_ips': [{'subnet_id': 'e5476e8f-088f-4ba5-ac74-99f1ba9f36c6'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:30.094197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.116739 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6095cef-3bb2-4dc4-8183-a77ad98fa4aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.146453 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6095cef-3bb2-4dc4-8183-a77ad98fa4aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.155596 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-48b6955f-077b-4ab3-b958-f09ef50f3d59 None None] Provisioning complete for port c93cdb3c-f190-4d12-85d0-6fafb9086b92 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:30.156326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-48b6955f-077b-4ab3-b958-f09ef50f3d59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.173845 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-202e04fa-39e7-44f0-b2cc-763feb528995 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.186113 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.316550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6095cef-3bb2-4dc4-8183-a77ad98fa4aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.317436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-202e04fa-39e7-44f0-b2cc-763feb528995 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.327502 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6095cef-3bb2-4dc4-8183-a77ad98fa4aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.327502 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c6095cef-3bb2-4dc4-8183-a77ad98fa4aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/security-groups/aa35563b-f7c7-4fc8-bd6e-3abebda57c57 HTTP/1.1" status: 204 len: 168 time: 0.3000388 Dec 10 14:30:30.327954 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58494) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:30.347340 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6095cef-3bb2-4dc4-8183-a77ad98fa4aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa35563b-f7c7-4fc8-bd6e-3abebda57c57,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:30.379311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a9806abc-452a-4508-9309-5d82a1b98504 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:30.422149 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:30.451003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-6f322b76-4be1-4ac7-a1cd-2b85d971b4f7 None None] Allocated IP 172.20.0.2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/c3586ecc-e9f2-4723-911c-1c07785f6890/d1bd774f-7cce-4e4b-b81b-15515d08daf5) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:30.456968 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-48b6955f-077b-4ab3-b958-f09ef50f3d59 None None] Port c93cdb3c-f190-4d12-85d0-6fafb9086b92 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:30.467359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:30.482100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:30.567693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=8b97ccd1-1856-4fba-aa18-eefbdd7b4e58,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:30.588174 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.590379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-202e04fa-39e7-44f0-b2cc-763feb528995 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.595548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58496) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:30.603373 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-202e04fa-39e7-44f0-b2cc-763feb528995 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.7418153 Dec 10 14:30:30.638979 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-48b6955f-077b-4ab3-b958-f09ef50f3d59 None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:30.645672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-48b6955f-077b-4ab3-b958-f09ef50f3d59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.651210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Allocated IP 172.20.0.2 (4037f0f9-74b6-4ebb-9901-86102564dbf9/e5476e8f-088f-4ba5-ac74-99f1ba9f36c6/de9ebc9a-6d57-432f-97df-52240beb4f3c) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:30.676155 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-b8150ae8-08ab-40ae-941c-be51bae17348 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet 274eb16c-9a10-413e-860b-79094f7e365b {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:30.705841 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8150ae8-08ab-40ae-941c-be51bae17348 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.736989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:30.737770 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.777407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:30.789583 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Sync routers for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:30.797919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Allocated IP 172.20.0.1 (e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f/d34297eb-b45e-40a3-93a5-fff721097da7/cf294aa3-861a-4d96-9cb0-1603daad8c42) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:30.802186 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8150ae8-08ab-40ae-941c-be51bae17348 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.803406 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:30.804040 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:30.859478 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-68d0a4ab-a992-4357-9e36-0dbd513913f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1028 time: 3.9377801 Dec 10 14:30:30.862675 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58498) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:30.876487 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.922028 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:30.922375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.989777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:30.993287 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3c534b1d-5b02-41c2-b4bf-980f720acc5e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 7.1056643 Dec 10 14:30:31.008900 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58500) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:31.065277 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b353f19-a44e-458e-84a3-91cfa585265f None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:31.084948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.098204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Attempting to bind port 40d334eb-b103-4069-ab9a-9a2090c6f40b on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:31.098204 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Attempting to bind port 40d334eb-b103-4069-ab9a-9a2090c6f40b by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:31.098535 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Attempting to bind port 40d334eb-b103-4069-ab9a-9a2090c6f40b on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:31.103190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be66d9f0-d690-4cc5-8128-d16be29a91a6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:31.109677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be66d9f0-d690-4cc5-8128-d16be29a91a6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:31.113960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-6f322b76-4be1-4ac7-a1cd-2b85d971b4f7 None None] For port d1bd774f-7cce-4e4b-b81b-15515d08daf5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d1bd774f-7cce-4e4b-b81b-15515d08daf5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:31.115540 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-be66d9f0-d690-4cc5-8128-d16be29a91a6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1785 time: 0.2495551 Dec 10 14:30:31.115877 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58502) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:31.117225 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6f7171-6f41-4f15-bc49-4a1ce7e69eb2 None None] Pushing event updated for resources: {'Port': ['ID=40d334eb-b103-4069-ab9a-9a2090c6f40b,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:31.135955 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8636b140-ab39-4681-8342-7f292e4d3021 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?project_id=c0bfba20c10d46e1abb38c3a54bd852b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1163113 Dec 10 14:30:31.140825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58504) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:31.156839 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:31.158451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:31.159122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.159764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:31.160503 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Bound port: 40d334eb-b103-4069-ab9a-9a2090c6f40b, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:31.161122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.161799 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:31.250582 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8150ae8-08ab-40ae-941c-be51bae17348 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.270501 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.289581 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.316606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6f322b76-4be1-4ac7-a1cd-2b85d971b4f7 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.361277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a801814-536c-4985-b73f-d3b2f1bd2004 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:31.362828 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5a801814-536c-4985-b73f-d3b2f1bd2004 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2208030 Dec 10 14:30:31.370966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58506) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:31.436089 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3ab2148d-3ce7-4bbb-b304-dcdebd38c2e5 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0613275 Dec 10 14:30:31.439199 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58508) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:31.443259 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1569480859', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:31.464437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-61a6c3be-9d64-4223-9464-f685f2404301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 8b97ccd1-1856-4fba-aa18-eefbdd7b4e58 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:31.465023 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-61a6c3be-9d64-4223-9464-f685f2404301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.471059 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] For port 40d334eb-b103-4069-ab9a-9a2090c6f40b, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:31.486241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] For port 40d334eb-b103-4069-ab9a-9a2090c6f40b, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=40d334eb-b103-4069-ab9a-9a2090c6f40b,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:31.488264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6f322b76-4be1-4ac7-a1cd-2b85d971b4f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.506543 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:27Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:31.533807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8150ae8-08ab-40ae-941c-be51bae17348 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.565212 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Checking router: ff0346ca-999c-400f-8b50-ce9d0945eb30 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:31.565677 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Updating router ff0346ca-999c-400f-8b50-ce9d0945eb30 port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:30:31.597304 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8150ae8-08ab-40ae-941c-be51bae17348 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=274eb16c-9a10-413e-860b-79094f7e365b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:31.598032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-61a6c3be-9d64-4223-9464-f685f2404301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.600444 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.616491 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-902e8fbc-ef06-4cb6-848d-27ec31996350 None None] Could not find standard attr ID for object 37a078bd-c02d-415b-a955-ad1a3f49706d. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:31.616491 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.622974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.629205 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-61a6c3be-9d64-4223-9464-f685f2404301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 8b97ccd1-1856-4fba-aa18-eefbdd7b4e58 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:31.660271 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8150ae8-08ab-40ae-941c-be51bae17348 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.673387 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b8150ae8-08ab-40ae-941c-be51bae17348 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/274eb16c-9a10-413e-860b-79094f7e365b HTTP/1.1" status: 204 len: 168 time: 1.3221495 Dec 10 14:30:31.676545 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58510) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:31.685803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23b9592a-7bd0-46c7-bb18-3e85a3cf16c4 None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:31.697500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.790211 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:31.807063 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d63558e-e299-4b4c-9e2d-a211ebef5299 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:31.809677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d1bd774f-7cce-4e4b-b81b-15515d08daf5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:31.820925 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.845261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:31.847710 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f322b76-4be1-4ac7-a1cd-2b85d971b4f7 None None] Pushing event updated for resources: {'Port': ['ID=d1bd774f-7cce-4e4b-b81b-15515d08daf5,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:31.851451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-902e8fbc-ef06-4cb6-848d-27ec31996350 None None] Provisioning complete for port 40d334eb-b103-4069-ab9a-9a2090c6f40b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:31.852847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-902e8fbc-ef06-4cb6-848d-27ec31996350 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:31.857510 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:31.985039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.20.0.1 (4037f0f9-74b6-4ebb-9901-86102564dbf9/e5476e8f-088f-4ba5-ac74-99f1ba9f36c6/7f89f135-c2a9-4425-a982-3f88a60a9a74) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:31.991161 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Routers {'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:31.991807 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:31.995091 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Pushing event updated for resources: {'Port': ['ID=cf294aa3-861a-4d96-9cb0-1603daad8c42,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:32.034660 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-0d52c398-16d7-461b-8a8f-27dcdfbd8108 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet f0ee04cf-d1c6-4d5a-b0b7-f5b64e3f07e2 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:32.041804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d52c398-16d7-461b-8a8f-27dcdfbd8108 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.045452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.129019 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Network 4037f0f9-74b6-4ebb-9901-86102564dbf9 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:32.130759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6f7171-6f41-4f15-bc49-4a1ce7e69eb2 None None] Pushing event updated for resources: {'Port': ['ID=40d334eb-b103-4069-ab9a-9a2090c6f40b,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:32.134208 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:32.166316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:32.169887 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.176824 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:32.262047 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.315577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-61a6c3be-9d64-4223-9464-f685f2404301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.316203 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d52c398-16d7-461b-8a8f-27dcdfbd8108 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.410356 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61a6c3be-9d64-4223-9464-f685f2404301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=8b97ccd1-1856-4fba-aa18-eefbdd7b4e58,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:32.418231 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.466925 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Pushing event updated for resources: {'Port': ['ID=de9ebc9a-6d57-432f-97df-52240beb4f3c,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:32.508517 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Attempting to bind port de9ebc9a-6d57-432f-97df-52240beb4f3c on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:32.508894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Attempting to bind port de9ebc9a-6d57-432f-97df-52240beb4f3c by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '0303987c-d3b8-4585-bea4-664051940a49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '4037f0f9-74b6-4ebb-9901-86102564dbf9'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:32.509249 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Attempting to bind port de9ebc9a-6d57-432f-97df-52240beb4f3c on network 4037f0f9-74b6-4ebb-9901-86102564dbf9 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:32.511391 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d1bd774f-7cce-4e4b-b81b-15515d08daf5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:32.511764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.517518 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7829b468-0116-4857-809f-10620a38e484 None None] Pushing event updated for resources: {'Port': ['ID=5a50d5fe-7e23-4220-a824-58a665d0e7c5,revision_number=2']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:32.530641 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.531215 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.531570 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.535094 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.535543 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.536364 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.536899 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.538100 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.539452 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.541398 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.543128 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.543653 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.545684 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7829b468-0116-4857-809f-10620a38e484 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:30:32.577914 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-902e8fbc-ef06-4cb6-848d-27ec31996350 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.604884 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:32.605286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Checking segment: {'id': '0303987c-d3b8-4585-bea4-664051940a49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '4037f0f9-74b6-4ebb-9901-86102564dbf9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:32.607618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.607839 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Bound using segment: {'id': '0303987c-d3b8-4585-bea4-664051940a49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '4037f0f9-74b6-4ebb-9901-86102564dbf9'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:32.608322 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Bound port: de9ebc9a-6d57-432f-97df-52240beb4f3c, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0303987c-d3b8-4585-bea4-664051940a49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '4037f0f9-74b6-4ebb-9901-86102564dbf9'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:32.608713 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.612739 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Attempting to bind port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:32.613110 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Attempting to bind port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:32.613716 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Attempting to bind port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:32.614566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d52c398-16d7-461b-8a8f-27dcdfbd8108 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.619693 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:32.620069 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:32.620614 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.620860 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:32.621336 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Bound port: 5a50d5fe-7e23-4220-a824-58a665d0e7c5, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:32.630842 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.634122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e21fd34f-6f9f-4d6e-b6be-f1237295e08d None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:32.695807 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] Set router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:32.704009 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-61a6c3be-9d64-4223-9464-f685f2404301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.710062 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-61a6c3be-9d64-4223-9464-f685f2404301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/8b97ccd1-1856-4fba-aa18-eefbdd7b4e58 HTTP/1.1" status: 204 len: 168 time: 1.5912018 Dec 10 14:30:32.714099 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58512) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:32.762403 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] For port 5a50d5fe-7e23-4220-a824-58a665d0e7c5, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:32.765987 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] For port 5a50d5fe-7e23-4220-a824-58a665d0e7c5, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5a50d5fe-7e23-4220-a824-58a665d0e7c5,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:32.791546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.798914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.806864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-902e8fbc-ef06-4cb6-848d-27ec31996350 None None] For port 40d334eb-b103-4069-ab9a-9a2090c6f40b, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=40d334eb-b103-4069-ab9a-9a2090c6f40b,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:32.852788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85169e38-6af0-4115-b78d-fe30de3dac2b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:32.855538 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.855749 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85169e38-6af0-4115-b78d-fe30de3dac2b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:32.859323 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85169e38-6af0-4115-b78d-fe30de3dac2b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:32.861391 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-85169e38-6af0-4115-b78d-fe30de3dac2b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1398437 Dec 10 14:30:32.865756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58514) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:32.924690 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-902e8fbc-ef06-4cb6-848d-27ec31996350 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:32.992154 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:32.994549 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:32.998186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-a4edacf0-b8de-452d-a977-c1aa9cb33bb8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet c3586ecc-e9f2-4723-911c-1c07785f6890 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:33.004624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a4edacf0-b8de-452d-a977-c1aa9cb33bb8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:33.076764 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:33.177946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77326fc0-f040-4161-9e24-156a99b5f6d3 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:33.196607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0c9ac40d-d148-432d-9692-34c5a7a512cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:33.209035 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902e8fbc-ef06-4cb6-848d-27ec31996350 None None] Pushing event updated for resources: {'Port': ['ID=40d334eb-b103-4069-ab9a-9a2090c6f40b,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:33.262348 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 4037f0f9-74b6-4ebb-9901-86102564dbf9 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:33.275636 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a4edacf0-b8de-452d-a977-c1aa9cb33bb8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:33.275771 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7829b468-0116-4857-809f-10620a38e484 None None] Pushing event updated for resources: {'Port': ['ID=5a50d5fe-7e23-4220-a824-58a665d0e7c5,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:33.317864 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:33.334162 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=7f89f135-c2a9-4425-a982-3f88a60a9a74,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:33.340905 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:33.359298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:33.385853 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Provisioning complete for port d1bd774f-7cce-4e4b-b81b-15515d08daf5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:33.386362 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:33.469384 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] For port de9ebc9a-6d57-432f-97df-52240beb4f3c, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:33.500024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] For port de9ebc9a-6d57-432f-97df-52240beb4f3c, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=de9ebc9a-6d57-432f-97df-52240beb4f3c,segment=NetworkSegment(0303987c-d3b8-4585-bea4-664051940a49),segment_id=0303987c-d3b8-4585-bea4-664051940a49)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:33.565067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:33.609197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:33.653451 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a4edacf0-b8de-452d-a977-c1aa9cb33bb8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:33.738032 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Provisioning complete for port cf294aa3-861a-4d96-9cb0-1603daad8c42 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:33.738968 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:33.877094 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:30:33.933204 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:27Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:34.008411 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d1bd774f-7cce-4e4b-b81b-15515d08daf5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:34.010457 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53cf6d9d-3670-4a22-ac89-d82f2dfd5a8f None None] The sync data for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv is: [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:27Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:34.033741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a4edacf0-b8de-452d-a977-c1aa9cb33bb8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.122977 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4edacf0-b8de-452d-a977-c1aa9cb33bb8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=c3586ecc-e9f2-4723-911c-1c07785f6890,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:34.130844 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33bffef2-f5b6-4d30-8f26-32575b4e350b None None] Pushing event updated for resources: {'Port': ['ID=de9ebc9a-6d57-432f-97df-52240beb4f3c,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:34.148576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Port cf294aa3-861a-4d96-9cb0-1603daad8c42 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:34.160025 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d52c398-16d7-461b-8a8f-27dcdfbd8108 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.182793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a4edacf0-b8de-452d-a977-c1aa9cb33bb8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.186391 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a4edacf0-b8de-452d-a977-c1aa9cb33bb8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/c3586ecc-e9f2-4723-911c-1c07785f6890 HTTP/1.1" status: 204 len: 168 time: 1.3190732 Dec 10 14:30:34.195178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227'}], 'enable_snat': True}, 'gw_port_id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:23Z', 'updated_at': '2021-12-10T14:30:26Z', 'revision_number': 3, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'gw_port': {'id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:3d:89', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1170, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:34.199689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58516) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:34.219748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.267819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d1bd774f-7cce-4e4b-b81b-15515d08daf5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:34.269683 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.271818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b96857c-8970-4d61-b535-1339e3354bf2 None None] The sync data for ids ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'] in dv-neutron-821401-2-hyperv is: [{'id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227'}], 'enable_snat': True}, 'gw_port_id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:23Z', 'updated_at': '2021-12-10T14:30:26Z', 'revision_number': 3, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'gw_port': {'id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:3d:89', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1170, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:34.274715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Provisioning complete for port 40d334eb-b103-4069-ab9a-9a2090c6f40b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:34.274715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.334912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d52c398-16d7-461b-8a8f-27dcdfbd8108 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.344273 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0d52c398-16d7-461b-8a8f-27dcdfbd8108 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/f0ee04cf-d1c6-4d5a-b0b7-f5b64e3f07e2 HTTP/1.1" status: 204 len: 168 time: 2.6514866 Dec 10 14:30:34.349440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58518) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:34.353478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.372275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-41cea7eb-28f6-4518-aea6-74891f1502dd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet f0d5e6c7-fdb1-4e45-816f-fb86f5a294cf {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:34.381363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d52c398-16d7-461b-8a8f-27dcdfbd8108 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=f0ee04cf-d1c6-4d5a-b0b7-f5b64e3f07e2,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:34.386453 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-41cea7eb-28f6-4518-aea6-74891f1502dd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.408568 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a9fcabd-c92a-46bf-a478-7c2aaca67366 None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:34.412958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3a93397-d045-497e-8566-22fe03c475db None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:34.488056 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-90c0efe8-9521-4aba-80e9-8c24fb969feb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:34.488527 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-90c0efe8-9521-4aba-80e9-8c24fb969feb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:34.492653 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-90c0efe8-9521-4aba-80e9-8c24fb969feb tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/274eb16c-9a10-413e-860b-79094f7e365b HTTP/1.1" status: 404 len: 337 time: 0.1312659 Dec 10 14:30:34.505082 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58520) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:34.536078 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-41cea7eb-28f6-4518-aea6-74891f1502dd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.665657 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Subnet': ['ID=06dce599-7e77-4ea6-a2ef-4939d220952a,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:34.716780 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Checking segment: {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:34.717162 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network hostable DHCP agents. Network: 6227fea4-3842-4a83-a78f-a5ec3bccdb07, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:30:34.722914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-5362ae0e-e7d9-4e33-b137-005a129bbf1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting subnet 4ed8fa39-6227-404f-b028-d7f1709e961b {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:34.729969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5362ae0e-e7d9-4e33-b137-005a129bbf1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.845198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.871046 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5362ae0e-e7d9-4e33-b137-005a129bbf1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.891690 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-41cea7eb-28f6-4518-aea6-74891f1502dd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:34.983797 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:30:35.025850 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.067836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Provisioning complete for port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:35.068256 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.220906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fd6176e4-03d7-4e07-a07c-3e04ecd7f497 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.224796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-41cea7eb-28f6-4518-aea6-74891f1502dd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.247608 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 6227fea4-3842-4a83-a78f-a5ec3bccdb07) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:35.316073 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5362ae0e-e7d9-4e33-b137-005a129bbf1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.389040 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4b460e2-d132-4899-a5ba-713b19d7a5f5 None None] Network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:35.404164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.414601 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41cea7eb-28f6-4518-aea6-74891f1502dd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=f0d5e6c7-fdb1-4e45-816f-fb86f5a294cf,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:35.428067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-41cea7eb-28f6-4518-aea6-74891f1502dd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.451342 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.453246 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-41cea7eb-28f6-4518-aea6-74891f1502dd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/f0d5e6c7-fdb1-4e45-816f-fb86f5a294cf HTTP/1.1" status: 204 len: 168 time: 1.2516043 Dec 10 14:30:35.456959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58522) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:35.519154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:35.519765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.521379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] For port 5a50d5fe-7e23-4220-a824-58a665d0e7c5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5a50d5fe-7e23-4220-a824-58a665d0e7c5,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:35.571154 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.613905 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5362ae0e-e7d9-4e33-b137-005a129bbf1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.623433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.679947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.734731 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.750231 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1b0dfef9-c910-4678-b012-80f1e309fae3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.2905104 Dec 10 14:30:35.752000 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58524) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:35.753769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=7f89f135-c2a9-4425-a982-3f88a60a9a74,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:35.763923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:35.856856 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3a7fd566-8189-46e0-8b04-6d0bb9c4992d None None] Could not find standard attr ID for object 8b97ccd1-1856-4fba-aa18-eefbdd7b4e58. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:35.918669 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a9269e93-ad37-49e4-980d-74755dfbe4f1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 4.4792442 Dec 10 14:30:35.924963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5362ae0e-e7d9-4e33-b137-005a129bbf1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:35.930647 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5362ae0e-e7d9-4e33-b137-005a129bbf1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/4ed8fa39-6227-404f-b028-d7f1709e961b HTTP/1.1" status: 204 len: 168 time: 1.4222686 Dec 10 14:30:35.937338 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5362ae0e-e7d9-4e33-b137-005a129bbf1c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Subnet': ['ID=4ed8fa39-6227-404f-b028-d7f1709e961b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:35.939587 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58526) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:35.940107 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58528) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:35.952530 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Pushing event updated for resources: {'Port': ['ID=cf294aa3-861a-4d96-9cb0-1603daad8c42,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:36.018061 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0792b36-993c-4d36-98f8-5c79c28d0d9b None None] Pushing event updated for resources: {'Port': ['ID=5a50d5fe-7e23-4220-a824-58a665d0e7c5,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:36.047037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea29fe62-ba52-46e7-b844-38b2034e8b80 None None] Network 4037f0f9-74b6-4ebb-9901-86102564dbf9 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:36.256025 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-65ef3efc-46df-45fa-8c68-1c524405e036 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:36.256599 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-65ef3efc-46df-45fa-8c68-1c524405e036 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:36.262866 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-65ef3efc-46df-45fa-8c68-1c524405e036 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/841961b3-9ee9-4d7d-b2cb-7813b58c2992 HTTP/1.1" status: 404 len: 337 time: 0.3177104 Dec 10 14:30:36.275806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 4037f0f9-74b6-4ebb-9901-86102564dbf9 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:36.276785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58530) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:36.282618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device de9ebc9a-6d57-432f-97df-52240beb4f3c up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:36.370843 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-938aeb4c-952a-4d3b-a0c1-28b714f5166b tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "GET /v2.0/ports?device_id=aedcf7fb-bcb3-431e-95dd-dd181ee65daf HTTP/1.1" status: 200 len: 205 time: 0.0931838 Dec 10 14:30:36.382358 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:36.382358 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58532) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:36.434759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:36.457475 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-369d309f-5700-45ec-813f-183702551996 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] delete failed (client error): The resource could not be found. Dec 10 14:30:36.459300 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-369d309f-5700-45ec-813f-183702551996 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/routers/aedcf7fb-bcb3-431e-95dd-dd181ee65daf HTTP/1.1" status: 404 len: 336 time: 0.0819719 Dec 10 14:30:36.464138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58534) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:36.478904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9579ae6-f43f-471f-9f96-1d605b999d40 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:36.482507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3a7fd566-8189-46e0-8b04-6d0bb9c4992d None None] Provisioning complete for port c93cdb3c-f190-4d12-85d0-6fafb9086b92 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:36.483279 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3a7fd566-8189-46e0-8b04-6d0bb9c4992d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:36.538958 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:36.731519 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:36.756296 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f44bce7-693d-4cc4-b244-263bb1e318f7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:36.756837 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9f44bce7-693d-4cc4-b244-263bb1e318f7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:36.760130 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9f44bce7-693d-4cc4-b244-263bb1e318f7 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/d6c1a1b5-c637-472c-8aa6-1c82a185f10f HTTP/1.1" status: 404 len: 337 time: 0.2949958 Dec 10 14:30:36.772386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58536) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:36.775207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:36.776252 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:36.776492 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:36.786188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:36.796008 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:36.796706 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3a7fd566-8189-46e0-8b04-6d0bb9c4992d None None] Port c93cdb3c-f190-4d12-85d0-6fafb9086b92 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:36.849680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d878731d-ac1a-408d-a92d-c29fb4e02027 None None] Network 62f6936a-4052-4c55-a4da-5b8b8be326f4 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:36.895608 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-31f55e75-115d-4a97-bcbd-95036f7959bc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:36.896119 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-31f55e75-115d-4a97-bcbd-95036f7959bc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:36.904955 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-31f55e75-115d-4a97-bcbd-95036f7959bc tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/d6694149-b28c-4bc2-a263-a61bda721e96 HTTP/1.1" status: 404 len: 337 time: 0.1116920 Dec 10 14:30:36.908633 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58538) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:36.993114 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-e0517224-bd6d-4392-af50-7a3662534fa4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:36.994312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e0517224-bd6d-4392-af50-7a3662534fa4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:37.000019 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e0517224-bd6d-4392-af50-7a3662534fa4 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/0c2f6b45-2d45-4c04-aa82-d2dd4a5553ac HTTP/1.1" status: 404 len: 337 time: 0.0644915 Dec 10 14:30:37.003762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58540) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.012699 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3a7fd566-8189-46e0-8b04-6d0bb9c4992d None None] Provisioning complete for port a9806abc-452a-4508-9309-5d82a1b98504 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:37.013160 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3a7fd566-8189-46e0-8b04-6d0bb9c4992d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:37.049861 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-d16f24d3-72fa-48e6-a79e-3b313623fcc0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:37.050419 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d16f24d3-72fa-48e6-a79e-3b313623fcc0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:37.053787 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d16f24d3-72fa-48e6-a79e-3b313623fcc0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/8fb0edf4-fd7d-4b01-9e0c-b3c0702ffab5 HTTP/1.1" status: 404 len: 333 time: 0.0423977 Dec 10 14:30:37.059099 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58542) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.092569 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:30:37.159806 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:37.189639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port de9ebc9a-6d57-432f-97df-52240beb4f3c triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:37.190025 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:37.288639 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-dacd520e-c1c3-43b2-aa57-4bee7b9a2bd0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:37.289736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dacd520e-c1c3-43b2-aa57-4bee7b9a2bd0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:37.294735 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dacd520e-c1c3-43b2-aa57-4bee7b9a2bd0 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/d49f8028-c2be-45ef-af9f-c0f8f1e82091 HTTP/1.1" status: 404 len: 337 time: 0.2346585 Dec 10 14:30:37.298634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58544) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.311463 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7282fa7c-b2c9-4c33-8a9c-b9173e4c120c None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:37.313986 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d6158fac-0368-4132-ba66-7669a3ca21ab admin admin] 10.222.0.57 "PUT /v2.0/routers/f78b2a0b-2685-4e50-9ccf-f76675b8f1ff/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.8723507 Dec 10 14:30:37.363231 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-b6aeb054-08d7-43c6-a627-6dc5dbe493cf tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:37.363934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b6aeb054-08d7-43c6-a627-6dc5dbe493cf tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:37.374328 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b6aeb054-08d7-43c6-a627-6dc5dbe493cf tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/d2b69d21-837d-469a-bf15-17a45151604a HTTP/1.1" status: 404 len: 337 time: 0.0500677 Dec 10 14:30:37.377175 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58548) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.473693 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-540ababe-d3f6-472a-b802-54526fc250fd tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:37.474927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-540ababe-d3f6-472a-b802-54526fc250fd tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:37.484067 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-540ababe-d3f6-472a-b802-54526fc250fd tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/61fdf749-3e11-46fd-adf7-d59fdab5fb9f HTTP/1.1" status: 404 len: 333 time: 0.1001215 Dec 10 14:30:37.484067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:37.512039 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58550) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.528204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:37.566379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a13bf612-3aa9-4968-b9cc-ed7375092c61 None None] Sync routers for ids ['a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:37.600534 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-3e4ae5da-499f-49f2-bb10-44b8f5f549aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:37.601079 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3e4ae5da-499f-49f2-bb10-44b8f5f549aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:37.614975 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3e4ae5da-499f-49f2-bb10-44b8f5f549aa tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/4f60e9bd-51f1-4469-8f5c-d41331250e0c HTTP/1.1" status: 404 len: 337 time: 0.1009829 Dec 10 14:30:37.616407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58554) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.622269 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-31703404-18cd-48e8-883f-5bb6ad649231 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.0261233 Dec 10 14:30:37.627269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58556) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.645053 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:37.646883 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:37.651860 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:37.653808 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:37.722119 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=1940732e-9096-48d6-923e-c735ad6cf8f9,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:37.734221 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Allocated IP 172.20.0.2 (6227fea4-3842-4a83-a78f-a5ec3bccdb07/06dce599-7e77-4ea6-a2ef-4939d220952a/224b7552-af57-4388-9143-da740e40f170) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:37.745655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a13bf612-3aa9-4968-b9cc-ed7375092c61 None None] Routers {'a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:37.746305 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a13bf612-3aa9-4968-b9cc-ed7375092c61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:37.759596 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-abffd65c-8910-4d16-a79e-8e98b0fa2929 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9996731 Dec 10 14:30:37.760368 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58558) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.782905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:37.872350 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe9ba037-4900-4731-abd3-519cd2dc7747 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:37.881052 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fe9ba037-4900-4731-abd3-519cd2dc7747 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports/7f89f135-c2a9-4425-a982-3f88a60a9a74 HTTP/1.1" status: 200 len: 910 time: 0.2595119 Dec 10 14:30:37.884567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58562) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.887403 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-b93bcfda-083f-453e-b75c-c54c1e97429c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] DELETE failed (client error): The resource could not be found. Dec 10 14:30:37.890864 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b93bcfda-083f-453e-b75c-c54c1e97429c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:37.900916 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b93bcfda-083f-453e-b75c-c54c1e97429c tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/subnets/9a6b2a07-bd8a-489b-aaf2-4a32b7ab8b96 HTTP/1.1" status: 404 len: 337 time: 0.2433627 Dec 10 14:30:37.919534 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:37.919780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58564) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:37.930515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cf0a1a5-6567-4e47-8513-e1909b2f2f78 None None] DHCP port deletion for 62f6936a-4052-4c55-a4da-5b8b8be326f4 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:37.943823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a13bf612-3aa9-4968-b9cc-ed7375092c61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:38.118810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:38.151132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-2a92f05c-10eb-4800-bc39-d8ebd3fd2a75 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port c93cdb3c-f190-4d12-85d0-6fafb9086b92 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:38.151132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2a92f05c-10eb-4800-bc39-d8ebd3fd2a75 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:38.228363 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Sync routers for ids ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:38.246667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:38.254119 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Routers {'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:38.256487 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:38.262393 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:38.479754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:38.531387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3a7fd566-8189-46e0-8b04-6d0bb9c4992d None None] Provisioning complete for port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:38.531759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3a7fd566-8189-46e0-8b04-6d0bb9c4992d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:38.535198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a13bf612-3aa9-4968-b9cc-ed7375092c61 None None] Routers {'a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:38.535857 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a13bf612-3aa9-4968-b9cc-ed7375092c61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:38.541266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7282fa7c-b2c9-4c33-8a9c-b9173e4c120c None None] Deleting port d1bd774f-7cce-4e4b-b81b-15515d08daf5 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:38.548193 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7282fa7c-b2c9-4c33-8a9c-b9173e4c120c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:38.627272 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Set router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:38.764165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a13bf612-3aa9-4968-b9cc-ed7375092c61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:38.764165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a13bf612-3aa9-4968-b9cc-ed7375092c61 None None] The sync data for ids ['a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:38.791772 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port de9ebc9a-6d57-432f-97df-52240beb4f3c, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=de9ebc9a-6d57-432f-97df-52240beb4f3c,segment=NetworkSegment(0303987c-d3b8-4585-bea4-664051940a49),segment_id=0303987c-d3b8-4585-bea4-664051940a49)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:38.824119 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58574) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:38.841692 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1302064138-network', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:38.893578 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:38.894431 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5a50d5fe-7e23-4220-a824-58a665d0e7c5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:38.905060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0cf0a1a5-6567-4e47-8513-e1909b2f2f78 None None] Deleting port a9806abc-452a-4508-9309-5d82a1b98504 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:38.905060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cf0a1a5-6567-4e47-8513-e1909b2f2f78 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.033633 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.072403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2a92f05c-10eb-4800-bc39-d8ebd3fd2a75 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.096146 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-2a92f05c-10eb-4800-bc39-d8ebd3fd2a75 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for c93cdb3c-f190-4d12-85d0-6fafb9086b92 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:39.096499 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7282fa7c-b2c9-4c33-8a9c-b9173e4c120c None None] For port d1bd774f-7cce-4e4b-b81b-15515d08daf5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d1bd774f-7cce-4e4b-b81b-15515d08daf5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:39.096818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7282fa7c-b2c9-4c33-8a9c-b9173e4c120c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.113598 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Made reservation on behalf of 38edb140cc9c4afc8661e1f00beceb6d for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:39.117955 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.131453 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227'}], 'enable_snat': True}, 'gw_port_id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:23Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'gw_port': {'id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:3d:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1170, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'cf294aa3-861a-4d96-9cb0-1603daad8c42', 'name': '', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'mac_address': 'fa:16:3e:12:06:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 1180, 'fixed_ips': [{'subnet_id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:30Z', 'updated_at': '2021-12-10T14:30:33Z', 'revision_number': 2, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'subnets': [{'id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:39.147571 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7282fa7c-b2c9-4c33-8a9c-b9173e4c120c None None] Calling delete_port for d1bd774f-7cce-4e4b-b81b-15515d08daf5 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:39.153893 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.185017 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Checking router: f78b2a0b-2685-4e50-9ccf-f76675b8f1ff for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:39.185927 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Updating router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff port cf294aa3-861a-4d96-9cb0-1603daad8c42 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:30:39.228561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.233892 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.236049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0cf0a1a5-6567-4e47-8513-e1909b2f2f78 None None] For port a9806abc-452a-4508-9309-5d82a1b98504, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a9806abc-452a-4508-9309-5d82a1b98504,segment=NetworkSegment(f87ad518-f300-4f42-a1a0-01a3d390e144),segment_id=f87ad518-f300-4f42-a1a0-01a3d390e144)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:39.236049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cf0a1a5-6567-4e47-8513-e1909b2f2f78 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.238186 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=de9ebc9a-6d57-432f-97df-52240beb4f3c,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:39.304755 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.307316 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0cf0a1a5-6567-4e47-8513-e1909b2f2f78 None None] Calling delete_port for a9806abc-452a-4508-9309-5d82a1b98504 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:39.320742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:39.322213 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.334339 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2a92f05c-10eb-4800-bc39-d8ebd3fd2a75 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.415746 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.431929 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2a92f05c-10eb-4800-bc39-d8ebd3fd2a75 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.436451 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2a92f05c-10eb-4800-bc39-d8ebd3fd2a75 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/ports/c93cdb3c-f190-4d12-85d0-6fafb9086b92 HTTP/1.1" status: 204 len: 168 time: 1.5156476 Dec 10 14:30:39.455842 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58576) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:39.469791 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Pushing event updated for resources: {'Port': ['ID=224b7552-af57-4388-9143-da740e40f170,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:39.481274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a92f05c-10eb-4800-bc39-d8ebd3fd2a75 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=c93cdb3c-f190-4d12-85d0-6fafb9086b92,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:39.507907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.1 (6227fea4-3842-4a83-a78f-a5ec3bccdb07/06dce599-7e77-4ea6-a2ef-4939d220952a/a740df5b-822f-40aa-a293-e69ac39e4777) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:39.516555 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.520617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:39.529008 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] vlan segment allocate from pool success with {'vlan_id': 361, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:30:39.529240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:39.534249 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:39.536306 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Provisioning complete for port d1bd774f-7cce-4e4b-b81b-15515d08daf5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:39.536674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.544081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.544433 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Added segment 201484db-3b63-4310-83aa-539a159c055c of type vlan for network e7b30006-dcc3-417d-b60d-21edaa083929 Dec 10 14:30:39.611411 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.626047 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7282fa7c-b2c9-4c33-8a9c-b9173e4c120c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.634052 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Could not find standard attr ID for object d1bd774f-7cce-4e4b-b81b-15515d08daf5. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:39.666226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.objects.ports [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103810) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:30:39.675174 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.697295 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de686e4a-4b63-4386-b3ef-44390e1b12bc,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:39.707857 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.720883 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.plugins.ml2.db [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] No ports have port_id starting with d1bd774f-7cce-4e4b-b81b-15515d08daf5 Dec 10 14:30:39.730368 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7282fa7c-b2c9-4c33-8a9c-b9173e4c120c None None] Pushing event deleted for resources: {'Port': ['ID=d1bd774f-7cce-4e4b-b81b-15515d08daf5,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:39.731036 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:39.741795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.743275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:39.758310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:39.759693 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.794496 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7282fa7c-b2c9-4c33-8a9c-b9173e4c120c None None] No DVR routers for this DVR port d1bd774f-7cce-4e4b-b81b-15515d08daf5 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:39.804631 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.809441 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=fe79d879-8a72-4292-ad7b-fbbfbd6c4dc6,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:39.821636 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Attempting to bind port 224b7552-af57-4388-9143-da740e40f170 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:39.826046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Attempting to bind port 224b7552-af57-4388-9143-da740e40f170 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:39.826046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Attempting to bind port 224b7552-af57-4388-9143-da740e40f170 on network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:39.831811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cf0a1a5-6567-4e47-8513-e1909b2f2f78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.835744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fa37b9b-37a9-42e5-a3be-55447477c091 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:39.857525 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0b9c800b-37b0-4151-a0ba-aa00928857f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.0955815 Dec 10 14:30:39.861219 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58578) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:39.866647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:26:0c:6b', 'name': 'tempest-NetworksTestDHCPv6-426914292'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:39.913382 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:39.914120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Checking segment: {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:39.914706 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.915259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Bound using segment: {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:39.915933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Bound port: 224b7552-af57-4388-9143-da740e40f170, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:39.916504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.924905 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.926898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cf0a1a5-6567-4e47-8513-e1909b2f2f78 None None] No DVR routers for this DVR port a9806abc-452a-4508-9309-5d82a1b98504 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:39.930205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cf0a1a5-6567-4e47-8513-e1909b2f2f78 None None] Pushing event deleted for resources: {'Port': ['ID=a9806abc-452a-4508-9309-5d82a1b98504,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:39.976642 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Provisioning complete for port de9ebc9a-6d57-432f-97df-52240beb4f3c triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:39.977289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:39.985152 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 40d334eb-b103-4069-ab9a-9a2090c6f40b up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:40.020346 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b30c01-32ca-4b9f-9209-0bcb88ce18b0 None None] Pushing event updated for resources: {'Port': ['ID=cf294aa3-861a-4d96-9cb0-1603daad8c42,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:40.041512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Deleting port a9806abc-452a-4508-9309-5d82a1b98504 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:40.041863 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.186712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:40.187558 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Attempting to bind port cf294aa3-861a-4d96-9cb0-1603daad8c42 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:40.187558 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Attempting to bind port cf294aa3-861a-4d96-9cb0-1603daad8c42 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:40.187558 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Attempting to bind port cf294aa3-861a-4d96-9cb0-1603daad8c42 on network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:40.201012 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:40.201749 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Checking segment: {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:40.202765 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.203581 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Bound using segment: {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:40.204803 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Bound port: cf294aa3-861a-4d96-9cb0-1603daad8c42, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:40.206113 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.212701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '1940732e-9096-48d6-923e-c735ad6cf8f9'}, {'subnet_id': 'fe79d879-8a72-4292-ad7b-fbbfbd6c4dc6'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:40.212701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.224501 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] For port 224b7552-af57-4388-9143-da740e40f170, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:40.231363 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] For port 224b7552-af57-4388-9143-da740e40f170, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=224b7552-af57-4388-9143-da740e40f170,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:40.236464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.280741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] For port a9806abc-452a-4508-9309-5d82a1b98504, host dv-neutron-821401-2-hyperv, got binding levels [] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:40.281518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.296264 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port d0d3bf3b-1f65-4563-9d2b-ba7f63861762 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:30:40.316462 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 40d334eb-b103-4069-ab9a-9a2090c6f40b triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:40.318584 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.331766 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.337989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.337989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:40.338781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.379977 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] For port cf294aa3-861a-4d96-9cb0-1603daad8c42, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:40.385443 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] For port cf294aa3-861a-4d96-9cb0-1603daad8c42, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cf294aa3-861a-4d96-9cb0-1603daad8c42,segment=NetworkSegment(3002d938-5fba-44ab-8087-00a333e47ca8),segment_id=3002d938-5fba-44ab-8087-00a333e47ca8)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:40.432812 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Calling delete_port for a9806abc-452a-4508-9309-5d82a1b98504 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:40.441261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.ipam_backend_mixin [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Port a9806abc-452a-4508-9309-5d82a1b98504 was not found and therefore no delete operation was performed {{(pid=103810) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 10 14:30:40.443629 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.482185 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.486923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Port': ['ID=a9806abc-452a-4508-9309-5d82a1b98504,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:40.491795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] No DVR routers for this DVR port a9806abc-452a-4508-9309-5d82a1b98504 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:40.588738 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6afdfc9-113c-473a-9683-7bf1a14a7e62 None None] Pushing event updated for resources: {'Port': ['ID=224b7552-af57-4388-9143-da740e40f170,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:40.604207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] Pushing event updated for resources: {'Network': ['ID=e7b30006-dcc3-417d-b60d-21edaa083929,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:40.633123 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Could not find standard attr ID for object a9806abc-452a-4508-9309-5d82a1b98504. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:40.646513 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Routers {'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:40.647649 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:40.669307 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network e7b30006-dcc3-417d-b60d-21edaa083929 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:30:40.705063 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1ed6d814-d331-4b49-95ba-95b51e19d497 admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.8708725 Dec 10 14:30:40.708736 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58580) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:40.712624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.720531 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b30c01-32ca-4b9f-9209-0bcb88ce18b0 None None] Pushing event updated for resources: {'Port': ['ID=cf294aa3-861a-4d96-9cb0-1603daad8c42,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:40.728221 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Request body: {'subnet': {'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1302064138-subnet', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'ip_version': 4}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:40.750488 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 172.20.0.6 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/1940732e-9096-48d6-923e-c735ad6cf8f9/d0d3bf3b-1f65-4563-9d2b-ba7f63861762) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:40.780724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['62f6936a-4052-4c55-a4da-5b8b8be326f4']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:40.781917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.787364 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fe26:c6b (cdc891b5-3e75-4d62-a51b-0f84be9af82d/fe79d879-8a72-4292-ad7b-fbbfbd6c4dc6/d0d3bf3b-1f65-4563-9d2b-ba7f63861762) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:40.791605 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Could not find standard attr ID for object c93cdb3c-f190-4d12-85d0-6fafb9086b92. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:40.808001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f87ad518-f300-4f42-a1a0-01a3d390e144') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:40.808305 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f87ad518-f300-4f42-a1a0-01a3d390e144') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:40.839536 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.924801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.936140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Made reservation on behalf of 38edb140cc9c4afc8661e1f00beceb6d for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:40.940369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:40.983663 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] Set router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:41.031573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port 7f89f135-c2a9-4425-a982-3f88a60a9a74 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:41.032691 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.074377 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Releasing vlan 388 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:30:41.075018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.080071 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Provisioning complete for port cf294aa3-861a-4d96-9cb0-1603daad8c42 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:41.086745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:30:41.101720 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:30:41.199162 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.219330 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for 7f89f135-c2a9-4425-a982-3f88a60a9a74 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:41.290601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.355097 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227'}], 'enable_snat': True}, 'gw_port_id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:23Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'gw_port': {'id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:3d:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1170, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'cf294aa3-861a-4d96-9cb0-1603daad8c42', 'name': '', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'mac_address': 'fa:16:3e:12:06:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 1180, 'fixed_ips': [{'subnet_id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:30Z', 'updated_at': '2021-12-10T14:30:40Z', 'revision_number': 4, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'subnets': [{'id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:41.381542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:41.397701 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:41.402979 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d421a834-99cf-4f27-bf1b-b29be97c754c None None] The sync data for ids ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'] in dv-neutron-821401-2-hyperv is: [{'id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227'}], 'enable_snat': True}, 'gw_port_id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:23Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'gw_port': {'id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:3d:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1170, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'cf294aa3-861a-4d96-9cb0-1603daad8c42', 'name': '', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'mac_address': 'fa:16:3e:12:06:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 1180, 'fixed_ips': [{'subnet_id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:30Z', 'updated_at': '2021-12-10T14:30:40Z', 'revision_number': 4, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'subnets': [{'id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:41.432582 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:41.528652 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=a740df5b-822f-40aa-a293-e69ac39e4777,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:41.545694 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.564154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.603669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.624290 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.628505 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] 10.222.0.57 "DELETE /v2.0/networks/62f6936a-4052-4c55-a4da-5b8b8be326f4 HTTP/1.1" status: 204 len: 168 time: 2.1704342 Dec 10 14:30:41.644648 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] For port cf294aa3-861a-4d96-9cb0-1603daad8c42, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=cf294aa3-861a-4d96-9cb0-1603daad8c42,segment=NetworkSegment(3002d938-5fba-44ab-8087-00a333e47ca8),segment_id=3002d938-5fba-44ab-8087-00a333e47ca8)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:41.655816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a4da49a-2321-4bf5-95a6-8c28a99d97e3 tempest-PortsIpV6TestJSON-582837391 tempest-PortsIpV6TestJSON-582837391-project] Pushing event deleted for resources: {'Network': ['ID=62f6936a-4052-4c55-a4da-5b8b8be326f4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:41.733438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.780487 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.854523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.862705 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Provisioning complete for port 7f89f135-c2a9-4425-a982-3f88a60a9a74 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:41.863127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.864898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5a50d5fe-7e23-4220-a824-58a665d0e7c5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:41.933398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:41.995390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=7f89f135-c2a9-4425-a982-3f88a60a9a74,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:42.043559 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:42.047360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:42.063886 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:42.075104 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=d0d3bf3b-1f65-4563-9d2b-ba7f63861762,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:42.110497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Port 7f89f135-c2a9-4425-a982-3f88a60a9a74 was deleted so its status cannot be updated. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Dec 10 14:30:42.177130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:42.186191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c24a7f-89eb-4d7a-b5f1-065a234ccd4e None None] Pushing event updated for resources: {'Port': ['ID=cf294aa3-861a-4d96-9cb0-1603daad8c42,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:42.286369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:42.299235 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:42.396690 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:42.398021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:42.475496 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Pushing event updated for resources: {'Subnet': ['ID=81a8393c-4abf-4fa8-8b05-10f41384bcef,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:42.506795 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Checking segment: {'id': '201484db-3b63-4310-83aa-539a159c055c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:42.512846 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-226d3bf1-e2eb-45c4-a754-19e8a97d3c85 None None] Provisioning complete for port cf294aa3-861a-4d96-9cb0-1603daad8c42 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:42.513689 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Network hostable DHCP agents. Network: e7b30006-dcc3-417d-b60d-21edaa083929, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:30:42.519706 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-226d3bf1-e2eb-45c4-a754-19e8a97d3c85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:42.564890 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a177d981-6dc4-4938-9527-948ccbcf078c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1025 time: 2.6966033 Dec 10 14:30:42.564890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58586) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:42.641348 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Network e7b30006-dcc3-417d-b60d-21edaa083929 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:30:42.644831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Allocated IP 172.20.0.2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/1940732e-9096-48d6-923e-c735ad6cf8f9/0da2c25f-d8af-4924-bb0a-0f20c2cfa82f) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:42.653651 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:42.655473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:42.668209 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be63e49e-7b71-45b4-bdf6-03e120b52018 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:42.673986 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-be63e49e-7b71-45b4-bdf6-03e120b52018 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1023 time: 0.1024697 Dec 10 14:30:42.674669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58588) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:42.710268 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58590) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:42.752849 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, e7b30006-dcc3-417d-b60d-21edaa083929) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:42.774793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:42.775468 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:42.776657 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Allocated IP 2001:db8::f816:3eff:fe0d:ed34 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/fe79d879-8a72-4292-ad7b-fbbfbd6c4dc6/0da2c25f-d8af-4924-bb0a-0f20c2cfa82f) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:42.793816 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e617b094-626a-4a32-9954-793d73043360 None None] Network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:42.809999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-291703d1-dcc2-47ae-baf7-ef972633d401 None None] Network e7b30006-dcc3-417d-b60d-21edaa083929 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:42.900967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-7c532fde-c035-4f9a-a5ee-30b5373af819 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port d0d3bf3b-1f65-4563-9d2b-ba7f63861762 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:42.903129 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7c532fde-c035-4f9a-a5ee-30b5373af819 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:42.911579 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f167f64a-ceb1-49fa-9fb5-c0064f34681c admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.1959224 Dec 10 14:30:42.914814 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58594) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:42.946306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1302064138-router', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:43.019552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:43.026695 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58596) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:43.027314 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f7e3f5ec-8435-4545-a551-26a7b355d59d admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=cc793beea85f4cf887a3485aad20d8e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3146722 Dec 10 14:30:43.103188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-e7b30006-dcc3-417d-b60d-21edaa083929', 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929', 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'fixed_ips': [{'subnet_id': '81a8393c-4abf-4fa8-8b05-10f41384bcef'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:43.105558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.141978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7c532fde-c035-4f9a-a5ee-30b5373af819 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.167624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-7c532fde-c035-4f9a-a5ee-30b5373af819 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for d0d3bf3b-1f65-4563-9d2b-ba7f63861762 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:43.193101 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c87e970e-580c-4712-a428-e0fd5008aff6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.196204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.197353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.210361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:43.221013 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2370e6cb-b0c6-4185-ad3c-ea6e59d03b79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3317711 Dec 10 14:30:43.224414 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58598) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:43.273452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c87e970e-580c-4712-a428-e0fd5008aff6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.343652 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.351087 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d4c27c0d-2c58-4722-bd00-3deb401861fa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd HTTP/1.1" status: 200 len: 205 time: 0.1254821 Dec 10 14:30:43.355745 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58600) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:43.406464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1154344b-a5e4-4d3d-9a7f-3dc6af6c7a0f None None] Sync routers for ids ['a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:43.439083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device de9ebc9a-6d57-432f-97df-52240beb4f3c up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:43.463911 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-793ab3d9-d217-4e9f-ab34-2ee01f671171 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.521133 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1154344b-a5e4-4d3d-9a7f-3dc6af6c7a0f None None] Routers {'a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:43.521687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1154344b-a5e4-4d3d-9a7f-3dc6af6c7a0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:43.644714 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c87e970e-580c-4712-a428-e0fd5008aff6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.646366 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c87e970e-580c-4712-a428-e0fd5008aff6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.649567 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c87e970e-580c-4712-a428-e0fd5008aff6 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/b8c79e1d-d40a-49ea-b8c0-06f81e64417d HTTP/1.1" status: 204 len: 168 time: 0.6193950 Dec 10 14:30:43.666580 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1154344b-a5e4-4d3d-9a7f-3dc6af6c7a0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:43.738926 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1154344b-a5e4-4d3d-9a7f-3dc6af6c7a0f None None] Routers {'a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:43.739763 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1154344b-a5e4-4d3d-9a7f-3dc6af6c7a0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:43.800392 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.809155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1154344b-a5e4-4d3d-9a7f-3dc6af6c7a0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:43.810595 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1154344b-a5e4-4d3d-9a7f-3dc6af6c7a0f None None] The sync data for ids ['a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:43.830083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.843067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c87e970e-580c-4712-a428-e0fd5008aff6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8c79e1d-d40a-49ea-b8c0-06f81e64417d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:43.848283 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-793ab3d9-d217-4e9f-ab34-2ee01f671171 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.854222 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-793ab3d9-d217-4e9f-ab34-2ee01f671171 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:43.950321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.028770 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port de9ebc9a-6d57-432f-97df-52240beb4f3c triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:44.029144 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.051213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-793ab3d9-d217-4e9f-ab34-2ee01f671171 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.055840 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-793ab3d9-d217-4e9f-ab34-2ee01f671171 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Fanout notify agent at l3_agent the message router_deleted on router a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:30:44.055840 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7c532fde-c035-4f9a-a5ee-30b5373af819 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.065127 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-793ab3d9-d217-4e9f-ab34-2ee01f671171 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.069691 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-793ab3d9-d217-4e9f-ab34-2ee01f671171 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd HTTP/1.1" status: 204 len: 168 time: 0.6983130 Dec 10 14:30:44.077073 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.081075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58606) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:44.106560 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-03b6e344-53ab-4df6-9730-5877f352119f None None] Provisioning complete for port 224b7552-af57-4388-9143-da740e40f170 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:44.106954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-03b6e344-53ab-4df6-9730-5877f352119f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.164313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.183081 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=a740df5b-822f-40aa-a293-e69ac39e4777,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:44.204918 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c532fde-c035-4f9a-a5ee-30b5373af819 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=d0d3bf3b-1f65-4563-9d2b-ba7f63861762,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:44.259466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.262217 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Allocated IP 172.20.0.2 (e7b30006-dcc3-417d-b60d-21edaa083929/81a8393c-4abf-4fa8-8b05-10f41384bcef/58eb663f-7c79-4d69-a382-2f71c919693d) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:44.352436 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-0c873b2b-5641-440b-b9ab-c31f49f30f80 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting subnet e5476e8f-088f-4ba5-ac74-99f1ba9f36c6 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:44.360137 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0c873b2b-5641-440b-b9ab-c31f49f30f80 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.385299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-03b6e344-53ab-4df6-9730-5877f352119f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.406362 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:44.410185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:44.437083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:44.458053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:44.478754 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0c873b2b-5641-440b-b9ab-c31f49f30f80 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.496127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:44.498461 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Pushing event updated for resources: {'Port': ['ID=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:44.510944 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.515920 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 224b7552-af57-4388-9143-da740e40f170 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:44.575737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7c532fde-c035-4f9a-a5ee-30b5373af819 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.582364 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7c532fde-c035-4f9a-a5ee-30b5373af819 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/d0d3bf3b-1f65-4563-9d2b-ba7f63861762 HTTP/1.1" status: 204 len: 168 time: 1.9064925 Dec 10 14:30:44.586041 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58616) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:44.595823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-03b6e344-53ab-4df6-9730-5877f352119f None None] For port 224b7552-af57-4388-9143-da740e40f170, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=224b7552-af57-4388-9143-da740e40f170,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:44.641863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.649810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router ff0346ca-999c-400f-8b50-ce9d0945eb30 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:44.670598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-03b6e344-53ab-4df6-9730-5877f352119f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.714049 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0c873b2b-5641-440b-b9ab-c31f49f30f80 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.715549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Attempting to bind port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:44.715928 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Attempting to bind port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:44.716614 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Attempting to bind port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:44.767937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:44.768318 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:44.768720 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.769801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:44.770311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Bound port: 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:44.770748 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.817657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38fa9789-0599-4968-9391-0e4536b1016c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:44.819836 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38fa9789-0599-4968-9391-0e4536b1016c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:44.821833 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38fa9789-0599-4968-9391-0e4536b1016c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:44.824434 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-38fa9789-0599-4968-9391-0e4536b1016c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.2363582 Dec 10 14:30:44.826417 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58622) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:44.855384 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 224b7552-af57-4388-9143-da740e40f170 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:44.855384 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.876975 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b6e344-53ab-4df6-9730-5877f352119f None None] Pushing event updated for resources: {'Port': ['ID=224b7552-af57-4388-9143-da740e40f170,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:44.905801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.914470 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-90e30461-be1b-4f29-b3dd-c7a3665d086f None None] Provisioning complete for port 224b7552-af57-4388-9143-da740e40f170 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:44.914754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-90e30461-be1b-4f29-b3dd-c7a3665d086f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.920545 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-62682590-a1d0-4910-a159-3057292ca293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 1940732e-9096-48d6-923e-c735ad6cf8f9 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:44.925310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0c873b2b-5641-440b-b9ab-c31f49f30f80 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.928225 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-62682590-a1d0-4910-a159-3057292ca293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:44.984957 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c873b2b-5641-440b-b9ab-c31f49f30f80 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Subnet': ['ID=e5476e8f-088f-4ba5-ac74-99f1ba9f36c6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:44.989913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] For port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:44.995037 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] For port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:44.996778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0c873b2b-5641-440b-b9ab-c31f49f30f80 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.001575 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0c873b2b-5641-440b-b9ab-c31f49f30f80 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/e5476e8f-088f-4ba5-ac74-99f1ba9f36c6 HTTP/1.1" status: 204 len: 168 time: 0.9086370 Dec 10 14:30:45.002439 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a68654d3-10cf-466c-b388-b95919326426 None None] Network 4037f0f9-74b6-4ebb-9901-86102564dbf9 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:45.005150 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58626) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:45.022041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.062669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-62682590-a1d0-4910-a159-3057292ca293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.238936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58630) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:45.266291 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-62682590-a1d0-4910-a159-3057292ca293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.297289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.298932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.384426 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:45.395069 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Network e7b30006-dcc3-417d-b60d-21edaa083929 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:45.396006 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Sync routers for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:45.401780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Pushing event updated for resources: {'Port': ['ID=58eb663f-7c79-4d69-a382-2f71c919693d,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:45.406816 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f2d8cc85-eafe-4b20-9fff-392abe1b261e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/routers/ff0346ca-999c-400f-8b50-ce9d0945eb30/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.4632461 Dec 10 14:30:45.414535 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58634) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:45.418577 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:45.419238 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:45.425075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:45.483920 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Allocated IP 172.26.2.94 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/fe83f899-36f9-48cd-9370-e256933ed108) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:45.490173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:45.493233 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1f67b138-ddf7-49d8-bcf1-b5d9dc23b39c tempest-ServiceProvidersTest-1762555398 tempest-ServiceProvidersTest-1762555398-project] 10.222.0.57 "GET /v2.0/service-providers HTTP/1.1" status: 200 len: 498 time: 0.2531638 Dec 10 14:30:45.515884 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-90e30461-be1b-4f29-b3dd-c7a3665d086f None None] Provisioning complete for port a740df5b-822f-40aa-a293-e69ac39e4777 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:45.517066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-90e30461-be1b-4f29-b3dd-c7a3665d086f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.584765 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-90e30461-be1b-4f29-b3dd-c7a3665d086f None None] Port a740df5b-822f-40aa-a293-e69ac39e4777 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:45.635242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d1bd774f-7cce-4e4b-b81b-15515d08daf5 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:45.659626 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:45.668920 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port de9ebc9a-6d57-432f-97df-52240beb4f3c {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:45.669265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.689698 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: d1bd774f-7cce-4e4b-b81b-15515d08daf5 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:45.690289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d1bd774f-7cce-4e4b-b81b-15515d08daf5 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:45.690607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a9806abc-452a-4508-9309-5d82a1b98504 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:45.701805 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-62682590-a1d0-4910-a159-3057292ca293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.711677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf753dbb-ded1-43f8-8d7c-2b89b7b00634 None None] Pushing event updated for resources: {'Port': ['ID=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:45.729103 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: a9806abc-452a-4508-9309-5d82a1b98504 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:45.729590 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a9806abc-452a-4508-9309-5d82a1b98504 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:45.733110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Attempting to bind port 58eb663f-7c79-4d69-a382-2f71c919693d on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:45.733110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Attempting to bind port 58eb663f-7c79-4d69-a382-2f71c919693d by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '201484db-3b63-4310-83aa-539a159c055c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:45.733110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Attempting to bind port 58eb663f-7c79-4d69-a382-2f71c919693d on network e7b30006-dcc3-417d-b60d-21edaa083929 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:45.743788 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:45.744262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Checking segment: {'id': '201484db-3b63-4310-83aa-539a159c055c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:45.744783 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.745458 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Bound using segment: {'id': '201484db-3b63-4310-83aa-539a159c055c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:45.746092 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Bound port: 58eb663f-7c79-4d69-a382-2f71c919693d, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '201484db-3b63-4310-83aa-539a159c055c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:45.746573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.756731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14b80207-b5e1-41a9-a60e-3c5b0bff68cb None None] DHCP port deletion for 4037f0f9-74b6-4ebb-9901-86102564dbf9 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:45.762160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-62682590-a1d0-4910-a159-3057292ca293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.766900 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-62682590-a1d0-4910-a159-3057292ca293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/1940732e-9096-48d6-923e-c735ad6cf8f9 HTTP/1.1" status: 204 len: 168 time: 0.9386098 Dec 10 14:30:45.769686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58638) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:45.854177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62682590-a1d0-4910-a159-3057292ca293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=1940732e-9096-48d6-923e-c735ad6cf8f9,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:45.898328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f3fb32d6-e8c6-401c-874c-c7e31eaf1a33 None None] Provisioning complete for port a740df5b-822f-40aa-a293-e69ac39e4777 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:45.906511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f3fb32d6-e8c6-401c-874c-c7e31eaf1a33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.926486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-a50da773-0a36-421d-bb05-8dfcfa73fce1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet fe79d879-8a72-4292-ad7b-fbbfbd6c4dc6 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:45.953954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port de9ebc9a-6d57-432f-97df-52240beb4f3c, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=de9ebc9a-6d57-432f-97df-52240beb4f3c,segment=NetworkSegment(0303987c-d3b8-4585-bea4-664051940a49),segment_id=0303987c-d3b8-4585-bea4-664051940a49)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:45.954304 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.984910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for de9ebc9a-6d57-432f-97df-52240beb4f3c owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:45.986019 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a740df5b-822f-40aa-a293-e69ac39e4777', 'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:f7:ab:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_interface', 'standard_attr_id': 1186, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:38Z', 'updated_at': '2021-12-10T14:30:43Z', 'revision_number': 2, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:45.988432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a50da773-0a36-421d-bb05-8dfcfa73fce1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:45.988859 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e54b10f-69a4-406a-82c1-5509f5ef43b6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:45.989627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e54b10f-69a4-406a-82c1-5509f5ef43b6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:45.990108 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e54b10f-69a4-406a-82c1-5509f5ef43b6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:45.990693 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e54b10f-69a4-406a-82c1-5509f5ef43b6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:45.991173 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e54b10f-69a4-406a-82c1-5509f5ef43b6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:45.991635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e54b10f-69a4-406a-82c1-5509f5ef43b6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:45.992275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e54b10f-69a4-406a-82c1-5509f5ef43b6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:45.992788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e54b10f-69a4-406a-82c1-5509f5ef43b6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:45.995214 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4e54b10f-69a4-406a-82c1-5509f5ef43b6 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 5671 time: 0.5702517 Dec 10 14:30:45.998420 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58640) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:46.039942 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Checking router: ff0346ca-999c-400f-8b50-ce9d0945eb30 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:46.040680 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Updating router ff0346ca-999c-400f-8b50-ce9d0945eb30 port a740df5b-822f-40aa-a293-e69ac39e4777 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:30:46.093694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a50da773-0a36-421d-bb05-8dfcfa73fce1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.111809 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.118500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f3fb32d6-e8c6-401c-874c-c7e31eaf1a33 None None] Port a740df5b-822f-40aa-a293-e69ac39e4777 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:46.167554 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] For port 58eb663f-7c79-4d69-a382-2f71c919693d, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:46.170810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-14b80207-b5e1-41a9-a60e-3c5b0bff68cb None None] Deleting port de9ebc9a-6d57-432f-97df-52240beb4f3c {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:46.179756 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-14b80207-b5e1-41a9-a60e-3c5b0bff68cb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.184321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddee0dc7-b929-47ba-a009-81eaecc24ef4 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:46.184750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddee0dc7-b929-47ba-a009-81eaecc24ef4 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:46.185206 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddee0dc7-b929-47ba-a009-81eaecc24ef4 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:46.185704 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddee0dc7-b929-47ba-a009-81eaecc24ef4 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:46.186161 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddee0dc7-b929-47ba-a009-81eaecc24ef4 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:46.186791 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddee0dc7-b929-47ba-a009-81eaecc24ef4 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:46.187255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddee0dc7-b929-47ba-a009-81eaecc24ef4 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:46.192066 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ddee0dc7-b929-47ba-a009-81eaecc24ef4 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4624 time: 0.1901405 Dec 10 14:30:46.193155 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58644) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:46.243440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a50da773-0a36-421d-bb05-8dfcfa73fce1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.363452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.372019 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-14b80207-b5e1-41a9-a60e-3c5b0bff68cb None None] For port de9ebc9a-6d57-432f-97df-52240beb4f3c, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=de9ebc9a-6d57-432f-97df-52240beb4f3c,segment=NetworkSegment(0303987c-d3b8-4585-bea4-664051940a49),segment_id=0303987c-d3b8-4585-bea4-664051940a49)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:46.373380 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-14b80207-b5e1-41a9-a60e-3c5b0bff68cb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.397970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58646) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:46.408041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device cf294aa3-861a-4d96-9cb0-1603daad8c42 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:46.421021 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-14b80207-b5e1-41a9-a60e-3c5b0bff68cb None None] Calling delete_port for de9ebc9a-6d57-432f-97df-52240beb4f3c owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:46.430022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a50da773-0a36-421d-bb05-8dfcfa73fce1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.451048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] For port 58eb663f-7c79-4d69-a382-2f71c919693d, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=58eb663f-7c79-4d69-a382-2f71c919693d,segment=NetworkSegment(201484db-3b63-4310-83aa-539a159c055c),segment_id=201484db-3b63-4310-83aa-539a159c055c)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:46.489472 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.506709 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.509628 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a50da773-0a36-421d-bb05-8dfcfa73fce1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.513640 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a50da773-0a36-421d-bb05-8dfcfa73fce1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/fe79d879-8a72-4292-ad7b-fbbfbd6c4dc6 HTTP/1.1" status: 204 len: 168 time: 0.7400632 Dec 10 14:30:46.534437 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port cf294aa3-861a-4d96-9cb0-1603daad8c42 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:46.535045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.554917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a50da773-0a36-421d-bb05-8dfcfa73fce1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=fe79d879-8a72-4292-ad7b-fbbfbd6c4dc6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:46.570160 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58650) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:46.571323 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.609456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.655987 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-60650009-3053-4e17-b6b5-6a34a85664fd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0841289 Dec 10 14:30:46.666350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58652) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:46.675132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Pushing event updated for resources: {'Port': ['ID=fe83f899-36f9-48cd-9370-e256933ed108,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:46.699463 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:46.701733 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-397f2e9c-776b-4ae4-a430-653671989883 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.704991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:46.708931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:46.710605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:46.730043 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Attempting to bind port a740df5b-822f-40aa-a293-e69ac39e4777 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:46.730310 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Attempting to bind port a740df5b-822f-40aa-a293-e69ac39e4777 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:46.730862 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Attempting to bind port a740df5b-822f-40aa-a293-e69ac39e4777 on network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:46.737404 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:46.738033 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Checking segment: {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:46.738601 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.739160 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Bound using segment: {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:46.739808 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Bound port: a740df5b-822f-40aa-a293-e69ac39e4777, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:46.740358 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:46.747543 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7a32e45-6b23-4a66-941f-fff3b4c5d4b8 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:46.852668 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] For port a740df5b-822f-40aa-a293-e69ac39e4777, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:46.858681 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] For port a740df5b-822f-40aa-a293-e69ac39e4777, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a740df5b-822f-40aa-a293-e69ac39e4777,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:46.860120 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f2b138-a4f1-4d89-97fc-d8d295fa3e1c None None] Pushing event updated for resources: {'Port': ['ID=a740df5b-822f-40aa-a293-e69ac39e4777,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:46.908274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 224b7552-af57-4388-9143-da740e40f170 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:46.947414 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.007281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ab1df8-6c53-427b-8ea8-a79b6fa0c505 None None] Pushing event updated for resources: {'Port': ['ID=58eb663f-7c79-4d69-a382-2f71c919693d,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:47.018512 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-14b80207-b5e1-41a9-a60e-3c5b0bff68cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.019592 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:47.023526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.089398 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f2b138-a4f1-4d89-97fc-d8d295fa3e1c None None] Pushing event updated for resources: {'Port': ['ID=a740df5b-822f-40aa-a293-e69ac39e4777,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:47.098249 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-397f2e9c-776b-4ae4-a430-653671989883 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.110957 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14b80207-b5e1-41a9-a60e-3c5b0bff68cb None None] No DVR routers for this DVR port de9ebc9a-6d57-432f-97df-52240beb4f3c on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:47.135876 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:47.136772 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:47.181684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-397f2e9c-776b-4ae4-a430-653671989883 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.189045 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b80207-b5e1-41a9-a60e-3c5b0bff68cb None None] Pushing event deleted for resources: {'Port': ['ID=de9ebc9a-6d57-432f-97df-52240beb4f3c,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:47.196662 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0c4b75b5-7ab9-43a6-9fe2-7febfc2b06cd None None] Provisioning complete for port fe83f899-36f9-48cd-9370-e256933ed108 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:47.197133 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0c4b75b5-7ab9-43a6-9fe2-7febfc2b06cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.298282 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 224b7552-af57-4388-9143-da740e40f170 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:47.298999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.313064 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0c4b75b5-7ab9-43a6-9fe2-7febfc2b06cd None None] Port fe83f899-36f9-48cd-9370-e256933ed108 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:47.330968 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58654) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:47.332770 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-397f2e9c-776b-4ae4-a430-653671989883 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=2171ba1daf3d42a499b1111857e2a6fe&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9333971 Dec 10 14:30:47.341013 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-397f2e9c-776b-4ae4-a430-653671989883 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea5ea660-5d96-4f7b-80bf-38068b981f55,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:47.351130 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.405620 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.405620 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.493700 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:47.536865 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f1119276-980b-46ba-b1fc-597ec981c512 None None] Provisioning complete for port a740df5b-822f-40aa-a293-e69ac39e4777 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:47.536865 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f1119276-980b-46ba-b1fc-597ec981c512 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.587207 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:47.590266 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=4be0af70-c176-4c45-aad4-5123f1642584,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:47.608477 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebe2748e-c4a1-48e7-a06a-e7a4ffa8a10c None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:47.616884 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=de9ebc9a-6d57-432f-97df-52240beb4f3c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:47.617865 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:47.618308 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.632690 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No DVR routers for this DVR port de9ebc9a-6d57-432f-97df-52240beb4f3c on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:47.679756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:47.710311 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:47.736308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:47.737600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.786762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.792443 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f1119276-980b-46ba-b1fc-597ec981c512 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.838716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.857342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9abc8ab2-97af-4985-95ae-843c1b813364 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.887431 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4037f0f9-74b6-4ebb-9901-86102564dbf9']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:47.897387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f1119276-980b-46ba-b1fc-597ec981c512 None None] For port a740df5b-822f-40aa-a293-e69ac39e4777, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a740df5b-822f-40aa-a293-e69ac39e4777,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:47.908377 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.915959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0303987c-d3b8-4585-bea4-664051940a49') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:47.916412 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0303987c-d3b8-4585-bea4-664051940a49') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:47.923831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9abc8ab2-97af-4985-95ae-843c1b813364 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.936279 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a740df5b-822f-40aa-a293-e69ac39e4777', 'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:f7:ab:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_interface', 'standard_attr_id': 1186, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:38Z', 'updated_at': '2021-12-10T14:30:46Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:47.942304 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b6c48e60-bbbc-470b-a246-a7dc53f4bfb1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2738078 Dec 10 14:30:47.943260 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58656) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:47.946861 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:47.948862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:47.956723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:47.981041 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b0464d9-f995-4b32-9206-459299de9bfb None None] The sync data for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv is: [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a740df5b-822f-40aa-a293-e69ac39e4777', 'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:f7:ab:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_interface', 'standard_attr_id': 1186, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:38Z', 'updated_at': '2021-12-10T14:30:46Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:47.982316 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c96ed050-1fe5-4b83-bec9-a40d9136fc4f tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2863 time: 1.7852833 Dec 10 14:30:47.991738 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f1119276-980b-46ba-b1fc-597ec981c512 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.069701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.081490 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Releasing vlan 374 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:30:48.082144 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.096147 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1119276-980b-46ba-b1fc-597ec981c512 None None] Pushing event updated for resources: {'Port': ['ID=a740df5b-822f-40aa-a293-e69ac39e4777,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:48.097759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.156132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:30:48.180697 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:30:48.183811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbb4e847-c509-462b-a3be-1628420fba48 None None] Update dhcp port {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': '4be0af70-c176-4c45-aad4-5123f1642584'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': '0da2c25f-d8af-4924-bb0a-0f20c2cfa82f'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:30:48.187494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9abc8ab2-97af-4985-95ae-843c1b813364 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.190978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9abc8ab2-97af-4985-95ae-843c1b813364 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.194680 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9abc8ab2-97af-4985-95ae-843c1b813364 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/ea5ea660-5d96-4f7b-80bf-38068b981f55 HTTP/1.1" status: 204 len: 168 time: 0.8592050 Dec 10 14:30:48.211366 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7ea81191-344c-4c52-bc67-4008ef105027 None None] Provisioning complete for port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:48.212130 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7ea81191-344c-4c52-bc67-4008ef105027 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.218432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9abc8ab2-97af-4985-95ae-843c1b813364 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea5ea660-5d96-4f7b-80bf-38068b981f55,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:48.270367 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device de9ebc9a-6d57-432f-97df-52240beb4f3c no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:48.308040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.326282 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: de9ebc9a-6d57-432f-97df-52240beb4f3c {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:30:48.326905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device de9ebc9a-6d57-432f-97df-52240beb4f3c not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:30:48.342203 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.350600 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/networks/4037f0f9-74b6-4ebb-9901-86102564dbf9 HTTP/1.1" status: 204 len: 168 time: 3.3403549 Dec 10 14:30:48.351461 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cbb4e847-c509-462b-a3be-1628420fba48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.352494 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58662) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:48.365655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68e39eb2-e7ba-4a6d-b39a-4a7eadaca250 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Network': ['ID=4037f0f9-74b6-4ebb-9901-86102564dbf9,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:48.376710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-27469821', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:48.384897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Router 4288339e-f09b-4cd3-bef5-41762390c3ed is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:30:48.482905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58664) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:48.489141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-913adc8e-3fdc-40de-8287-a9f1ab96f171 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-636624433', 'description': 'tempest-secgroup-smoke-636624433 description', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:48.548408 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:48.552659 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.604076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7ea81191-344c-4c52-bc67-4008ef105027 None None] Provisioning complete for port a740df5b-822f-40aa-a293-e69ac39e4777 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:48.604076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7ea81191-344c-4c52-bc67-4008ef105027 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.705637 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-cbb4e847-c509-462b-a3be-1628420fba48 None None] Allocated IP 172.20.0.2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/4be0af70-c176-4c45-aad4-5123f1642584/0da2c25f-d8af-4924-bb0a-0f20c2cfa82f) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:48.760616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.764742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.812187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 58eb663f-7c79-4d69-a382-2f71c919693d up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:48.815237 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5edfc51f-68ac-4a4e-a28e-a92607f8da86 None None] Network e7b30006-dcc3-417d-b60d-21edaa083929 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:48.816184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913adc8e-3fdc-40de-8287-a9f1ab96f171 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.934515 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913adc8e-3fdc-40de-8287-a9f1ab96f171 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:48.952093 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:48.955640 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.001557 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913adc8e-3fdc-40de-8287-a9f1ab96f171 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.040983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913adc8e-3fdc-40de-8287-a9f1ab96f171 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroup': ['ID=27b83861-1b2d-49f5-87e4-db2e023d9028,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:49.072582 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Sync routers for ids ['4288339e-f09b-4cd3-bef5-41762390c3ed'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:49.113667 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.114907 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1124aa25-f357-448b-8304-e383ff1a9a11 admin admin] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 6.1721351 Dec 10 14:30:49.117829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58666) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:49.150075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Routers {'4288339e-f09b-4cd3-bef5-41762390c3ed'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:49.150816 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['4288339e-f09b-4cd3-bef5-41762390c3ed'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:49.232597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.254058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-cbb4e847-c509-462b-a3be-1628420fba48 None None] For port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:49.279239 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-913adc8e-3fdc-40de-8287-a9f1ab96f171 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.279239 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-913adc8e-3fdc-40de-8287-a9f1ab96f171 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.7945733 Dec 10 14:30:49.282573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58668) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:49.289521 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-02573226-1cb9-4c28-baeb-6ebab0390735 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '27b83861-1b2d-49f5-87e4-db2e023d9028', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:49.346659 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 58eb663f-7c79-4d69-a382-2f71c919693d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:49.347381 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.384092 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-73fae59d-3fbd-437f-b67f-630e5a04b142 None None] Provisioning complete for port 58eb663f-7c79-4d69-a382-2f71c919693d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:49.384574 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-73fae59d-3fbd-437f-b67f-630e5a04b142 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.449912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-02573226-1cb9-4c28-baeb-6ebab0390735 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.452806 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cbb4e847-c509-462b-a3be-1628420fba48 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.467129 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Set router 4288339e-f09b-4cd3-bef5-41762390c3ed gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:49.587589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:30:49.592489 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.599996 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-cbb4e847-c509-462b-a3be-1628420fba48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.712649 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.802328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-02573226-1cb9-4c28-baeb-6ebab0390735 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.853671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-73fae59d-3fbd-437f-b67f-630e5a04b142 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.887741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb4e847-c509-462b-a3be-1628420fba48 None None] Pushing event updated for resources: {'Port': ['ID=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,revision_number=6']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:49.918743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-02573226-1cb9-4c28-baeb-6ebab0390735 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:49.943549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 58eb663f-7c79-4d69-a382-2f71c919693d, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=58eb663f-7c79-4d69-a382-2f71c919693d,segment=NetworkSegment(201484db-3b63-4310-83aa-539a159c055c),segment_id=201484db-3b63-4310-83aa-539a159c055c)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:49.971560 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'name': 'tempest-TestVolumeBootPattern-1302064138-router', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94'}], 'enable_snat': True}, 'gw_port_id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:43Z', 'updated_at': '2021-12-10T14:30:46Z', 'revision_number': 3, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'gw_port': {'id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:6f:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1200, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:44Z', 'updated_at': '2021-12-10T14:30:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:49.985758 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02573226-1cb9-4c28-baeb-6ebab0390735 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=76d89283-f8d8-41e0-b6b2-dd453cf90baf,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:50.008545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Checking router: 4288339e-f09b-4cd3-bef5-41762390c3ed for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:50.008782 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_gateway, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.008897 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Updating router 4288339e-f09b-4cd3-bef5-41762390c3ed port fe83f899-36f9-48cd-9370-e256933ed108 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:30:50.010913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.011819 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a740df5b-822f-40aa-a293-e69ac39e4777 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:50.035311 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.080525 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Allocated IP 172.20.0.1 (e7b30006-dcc3-417d-b60d-21edaa083929/81a8393c-4abf-4fa8-8b05-10f41384bcef/b4cf4bde-96e7-442d-b89c-6e3af846a05d) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:50.083317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-02573226-1cb9-4c28-baeb-6ebab0390735 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.087205 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-02573226-1cb9-4c28-baeb-6ebab0390735 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8002307 Dec 10 14:30:50.089708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58670) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:50.118617 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-31662db4-1176-44c6-829a-125177b78c98 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '27b83861-1b2d-49f5-87e4-db2e023d9028', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:50.132761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.177576 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.186417 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-73fae59d-3fbd-437f-b67f-630e5a04b142 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:30:50.186783 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-73fae59d-3fbd-437f-b67f-630e5a04b142 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:30:50.206433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.280595 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=58eb663f-7c79-4d69-a382-2f71c919693d,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:50.288911 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port a740df5b-822f-40aa-a293-e69ac39e4777 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:50.289130 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31662db4-1176-44c6-829a-125177b78c98 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.289261 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.324298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.335793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.26.2.223 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/a4eca117-384f-4a32-b33c-a3f0ccff0b51) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:50.396109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:50.397147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Network e7b30006-dcc3-417d-b60d-21edaa083929 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:50.406062 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:50.421018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:50.447431 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:50.447952 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.469867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31662db4-1176-44c6-829a-125177b78c98 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.471876 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] For port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:50.515825 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.571323 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31662db4-1176-44c6-829a-125177b78c98 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.598073 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.599100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.621064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.628269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31662db4-1176-44c6-829a-125177b78c98 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c4735d21-c9bc-40b3-86af-1c3b2a9592fa,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:50.685493 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 58eb663f-7c79-4d69-a382-2f71c919693d up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:50.687792 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edbcce0f-71c3-4f1a-a27d-7d00bf82812d None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:50.759277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:50.777457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:50.787440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:50.788117 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.797161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,revision_number=8']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:50.815661 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=14b38d17-838e-42f5-9950-b658bd6b499c,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:50.826641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31662db4-1176-44c6-829a-125177b78c98 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.828337 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-31662db4-1176-44c6-829a-125177b78c98 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.7336793 Dec 10 14:30:50.831146 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58672) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:50.840037 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ef6c5f3f-39e5-4748-97ab-520959fe2728 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '27b83861-1b2d-49f5-87e4-db2e023d9028', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:50.845690 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.859495 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-95df7927-2892-4e9d-aba0-39e5b37e6020 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.9153361 Dec 10 14:30:50.864693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58674) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:50.871004 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:dc:9f:e3', 'name': 'tempest-NetworksTestDHCPv6-1781760209'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:50.878549 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 58eb663f-7c79-4d69-a382-2f71c919693d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:50.879112 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:50.906673 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Pushing event updated for resources: {'Port': ['ID=b4cf4bde-96e7-442d-b89c-6e3af846a05d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:51.049082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ef6c5f3f-39e5-4748-97ab-520959fe2728 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.156708 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.166997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-86f05655-3bc6-4457-9d2b-8cab3949d1cf None None] Provisioning complete for port 58eb663f-7c79-4d69-a382-2f71c919693d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:51.167371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-86f05655-3bc6-4457-9d2b-8cab3949d1cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.217085 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ef6c5f3f-39e5-4748-97ab-520959fe2728 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.269687 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:51.287510 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ef6c5f3f-39e5-4748-97ab-520959fe2728 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.315732 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef6c5f3f-39e5-4748-97ab-520959fe2728 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dfb87583-5ddb-4598-9313-2ce3900a8b8e,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:51.354805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.397733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.423904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.443958 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:51.444827 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:51.445207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.451489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:51.458940 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ef6c5f3f-39e5-4748-97ab-520959fe2728 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.462909 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ef6c5f3f-39e5-4748-97ab-520959fe2728 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6280088 Dec 10 14:30:51.463105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58676) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:51.467532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4de09310-1c8d-483b-b9f4-a41030dd1784 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '27b83861-1b2d-49f5-87e4-db2e023d9028', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:51.479552 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb0de10b-ac9e-4c6e-989d-fe1d24b12acc None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:51.488095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.503330 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-86f05655-3bc6-4457-9d2b-8cab3949d1cf None None] Provisioning complete for port b4cf4bde-96e7-442d-b89c-6e3af846a05d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:51.503710 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-86f05655-3bc6-4457-9d2b-8cab3949d1cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.504229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=a4eca117-384f-4a32-b33c-a3f0ccff0b51,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:51.518796 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:51.535764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.563080 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Pushing event updated for resources: {'Port': ['ID=b4cf4bde-96e7-442d-b89c-6e3af846a05d,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:51.573310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.589321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4de09310-1c8d-483b-b9f4-a41030dd1784 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.611476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8be25ff-f753-48c8-90a2-4389109e121d None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:51.619158 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-86f05655-3bc6-4457-9d2b-8cab3949d1cf None None] Port b4cf4bde-96e7-442d-b89c-6e3af846a05d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:51.629658 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b84426b-c5d3-43ae-a10c-a52ab9588fdf None None] Pushing event updated for resources: {'Port': ['ID=fe83f899-36f9-48cd-9370-e256933ed108,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:51.651525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Attempting to bind port fe83f899-36f9-48cd-9370-e256933ed108 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:51.651895 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Attempting to bind port fe83f899-36f9-48cd-9370-e256933ed108 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:51.652266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Attempting to bind port fe83f899-36f9-48cd-9370-e256933ed108 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:51.672911 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:51.673296 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:51.673732 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.674132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:51.674769 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Bound port: fe83f899-36f9-48cd-9370-e256933ed108, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:51.675383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.700328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:51.712259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-073d1dd4-9b09-4a27-bd7d-e3b6ae10396e None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:51.715153 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4de09310-1c8d-483b-b9f4-a41030dd1784 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.721226 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-86f05655-3bc6-4457-9d2b-8cab3949d1cf None None] Provisioning complete for port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:51.721628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-86f05655-3bc6-4457-9d2b-8cab3949d1cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.769514 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Network e7b30006-dcc3-417d-b60d-21edaa083929 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:51.771369 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:51.777830 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4de09310-1c8d-483b-b9f4-a41030dd1784 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.822981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:51.851383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] For port fe83f899-36f9-48cd-9370-e256933ed108, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:51.852264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port f99f975a-dd8a-46d0-9f74-f7008e84b5b4 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:30:51.872358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] For port fe83f899-36f9-48cd-9370-e256933ed108, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=fe83f899-36f9-48cd-9370-e256933ed108,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:51.930788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Router 4288339e-f09b-4cd3-bef5-41762390c3ed has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:51.932802 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4de09310-1c8d-483b-b9f4-a41030dd1784 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8fc7c805-94b8-4778-9bce-e9fa7288bac7,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:51.952245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.017706 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fadc1d94-bca0-4001-b521-ceb6621bef1d None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:52.030203 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Routers {'4288339e-f09b-4cd3-bef5-41762390c3ed'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:52.031234 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['4288339e-f09b-4cd3-bef5-41762390c3ed'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:52.078316 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4de09310-1c8d-483b-b9f4-a41030dd1784 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.084157 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4de09310-1c8d-483b-b9f4-a41030dd1784 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6158190 Dec 10 14:30:52.088649 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 172.20.0.9 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/4be0af70-c176-4c45-aad4-5123f1642584/f99f975a-dd8a-46d0-9f74-f7008e84b5b4) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:52.091631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58678) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:52.096947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fedc:9fe3 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/14b38d17-838e-42f5-9950-b658bd6b499c/f99f975a-dd8a-46d0-9f74-f7008e84b5b4) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:52.098596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5888b0f4-7516-4dd2-938f-bbd9e4673669 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '27b83861-1b2d-49f5-87e4-db2e023d9028', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:52.122050 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b84426b-c5d3-43ae-a10c-a52ab9588fdf None None] Pushing event updated for resources: {'Port': ['ID=fe83f899-36f9-48cd-9370-e256933ed108,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:52.138668 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Provisioning complete for port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:52.139065 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.150059 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:52.156099 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3370eb85-54e0-47c3-9b11-80432c66ac41 admin admin] 10.222.0.57 "PUT /v2.0/routers/4288339e-f09b-4cd3-bef5-41762390c3ed/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0370276 Dec 10 14:30:52.227712 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-5888b0f4-7516-4dd2-938f-bbd9e4673669 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:30:52.237096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5888b0f4-7516-4dd2-938f-bbd9e4673669 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.243851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] Set router 4288339e-f09b-4cd3-bef5-41762390c3ed gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:52.316211 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5888b0f4-7516-4dd2-938f-bbd9e4673669 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.397511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5888b0f4-7516-4dd2-938f-bbd9e4673669 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.416627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Provisioning complete for port a4eca117-384f-4a32-b33c-a3f0ccff0b51 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:52.417049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.432437 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5888b0f4-7516-4dd2-938f-bbd9e4673669 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=190aadfb-7bd4-4543-aacc-eddae798f364,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:52.467878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.482639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Port a4eca117-384f-4a32-b33c-a3f0ccff0b51 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:52.499230 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_gateway, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.502262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5888b0f4-7516-4dd2-938f-bbd9e4673669 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.503535 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5888b0f4-7516-4dd2-938f-bbd9e4673669 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4102094 Dec 10 14:30:52.506353 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58686) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:52.510906 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9a969071-489a-48ad-a6a3-13da1a28dfa9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '27b83861-1b2d-49f5-87e4-db2e023d9028', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:52.527900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Provisioning complete for port fe83f899-36f9-48cd-9370-e256933ed108 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:52.529866 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.633659 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-9a969071-489a-48ad-a6a3-13da1a28dfa9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:30:52.648854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a969071-489a-48ad-a6a3-13da1a28dfa9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.649937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:52.673510 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.736969 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a969071-489a-48ad-a6a3-13da1a28dfa9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.765780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'name': 'tempest-TestVolumeBootPattern-1302064138-router', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94'}], 'enable_snat': True}, 'gw_port_id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:43Z', 'updated_at': '2021-12-10T14:30:50Z', 'revision_number': 4, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'gw_port': {'id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:6f:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1200, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:44Z', 'updated_at': '2021-12-10T14:30:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'b4cf4bde-96e7-442d-b89c-6e3af846a05d', 'name': '', 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'mac_address': 'fa:16:3e:2a:38:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:49Z', 'updated_at': '2021-12-10T14:30:51Z', 'revision_number': 2, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'subnets': [{'id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:52.770321 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.781390 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:52.789291 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:52.793584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:52.796364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=f99f975a-dd8a-46d0-9f74-f7008e84b5b4,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:52.809516 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d04d6cd-1d10-4c11-b4e8-bace02e743c2 None None] The sync data for ids ['4288339e-f09b-4cd3-bef5-41762390c3ed'] in dv-neutron-821401-2-hyperv is: [{'id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'name': 'tempest-TestVolumeBootPattern-1302064138-router', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94'}], 'enable_snat': True}, 'gw_port_id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:43Z', 'updated_at': '2021-12-10T14:30:50Z', 'revision_number': 4, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'gw_port': {'id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:6f:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1200, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:44Z', 'updated_at': '2021-12-10T14:30:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'b4cf4bde-96e7-442d-b89c-6e3af846a05d', 'name': '', 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'mac_address': 'fa:16:3e:2a:38:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:49Z', 'updated_at': '2021-12-10T14:30:51Z', 'revision_number': 2, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'subnets': [{'id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:52.814826 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a969071-489a-48ad-a6a3-13da1a28dfa9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.820939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:52.821646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.827845 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] For port fe83f899-36f9-48cd-9370-e256933ed108, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=fe83f899-36f9-48cd-9370-e256933ed108,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:52.876152 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a969071-489a-48ad-a6a3-13da1a28dfa9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=caea8fef-6be7-4477-b337-8b1fa89addd2,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:52.907301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.915043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:52.915741 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.930805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.995536 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9a969071-489a-48ad-a6a3-13da1a28dfa9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:52.996924 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9a969071-489a-48ad-a6a3-13da1a28dfa9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4895821 Dec 10 14:30:53.012491 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f1a165-8cee-490f-a388-ffda839295ec None None] Pushing event updated for resources: {'Port': ['ID=fe83f899-36f9-48cd-9370-e256933ed108,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:53.034305 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-58b35a58-bfec-446a-89e5-f5096337d7ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 2.1673770 Dec 10 14:30:53.041607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58690) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:53.042502 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-86f063f2-a66f-4ff2-adf7-da6bd06d0624 None None] Could not find standard attr ID for object d0d3bf3b-1f65-4563-9d2b-ba7f63861762. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:30:53.056974 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-86f063f2-a66f-4ff2-adf7-da6bd06d0624 None None] Provisioning complete for port b4cf4bde-96e7-442d-b89c-6e3af846a05d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:53.057405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-86f063f2-a66f-4ff2-adf7-da6bd06d0624 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.101319 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58692) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:53.110684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-3c5dd45d-66e5-4906-9d5a-73dc3d1f2b00 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-485525198', 'description': 'tempest-secgroup-smoke-485525198 description', 'project_id': 'a1d5a7f281834a22aee867878a76c226'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:53.110930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-86f063f2-a66f-4ff2-adf7-da6bd06d0624 None None] Port b4cf4bde-96e7-442d-b89c-6e3af846a05d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:53.112027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f15d7c7d-7330-40bc-9bbf-b4e27f39d1da tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:53.128957 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-86f063f2-a66f-4ff2-adf7-da6bd06d0624 None None] Provisioning complete for port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:53.129385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-86f063f2-a66f-4ff2-adf7-da6bd06d0624 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.136343 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f15d7c7d-7330-40bc-9bbf-b4e27f39d1da tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:53.138957 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f15d7c7d-7330-40bc-9bbf-b4e27f39d1da tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1863 time: 0.1011119 Dec 10 14:30:53.143187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58694) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:53.262131 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3c5dd45d-66e5-4906-9d5a-73dc3d1f2b00 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.299001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router a4772d7e-f186-4631-b2e3-2bb145bd2322 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:30:53.328241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-86f063f2-a66f-4ff2-adf7-da6bd06d0624 None None] Provisioning complete for port fe83f899-36f9-48cd-9370-e256933ed108 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:53.328702 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-86f063f2-a66f-4ff2-adf7-da6bd06d0624 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.359126 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4a176589-3649-4b6f-bbeb-63f5f79064f1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port f99f975a-dd8a-46d0-9f74-f7008e84b5b4 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:53.359619 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a176589-3649-4b6f-bbeb-63f5f79064f1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.401880 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3c5dd45d-66e5-4906-9d5a-73dc3d1f2b00 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.465940 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3c5dd45d-66e5-4906-9d5a-73dc3d1f2b00 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.496997 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:53.508181 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e4977a0-df5a-4cbc-8d58-4e6bb355e6b4 None None] Sync routers for ids ['a4772d7e-f186-4631-b2e3-2bb145bd2322'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:53.521152 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e4977a0-df5a-4cbc-8d58-4e6bb355e6b4 None None] Routers {'a4772d7e-f186-4631-b2e3-2bb145bd2322'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:53.522382 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0e4977a0-df5a-4cbc-8d58-4e6bb355e6b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a4772d7e-f186-4631-b2e3-2bb145bd2322'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:53.535566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c5dd45d-66e5-4906-9d5a-73dc3d1f2b00 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'SecurityGroup': ['ID=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:53.572307 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0e4977a0-df5a-4cbc-8d58-4e6bb355e6b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:53.582469 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e4977a0-df5a-4cbc-8d58-4e6bb355e6b4 None None] Routers {'a4772d7e-f186-4631-b2e3-2bb145bd2322'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:53.583390 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0e4977a0-df5a-4cbc-8d58-4e6bb355e6b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a4772d7e-f186-4631-b2e3-2bb145bd2322'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:53.589021 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-f8db0cab-3d94-4ef0-bda7-41ad5b2f3809 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-636624433&fields=id&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 267 time: 0.2451437 Dec 10 14:30:53.621409 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-0e4977a0-df5a-4cbc-8d58-4e6bb355e6b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:53.622401 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e4977a0-df5a-4cbc-8d58-4e6bb355e6b4 None None] The sync data for ids ['a4772d7e-f186-4631-b2e3-2bb145bd2322'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:53.642407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.643120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3c5dd45d-66e5-4906-9d5a-73dc3d1f2b00 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.643836 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3c5dd45d-66e5-4906-9d5a-73dc3d1f2b00 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.5404603 Dec 10 14:30:53.646889 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0f8e92b0-52cf-4d62-8ccd-d9038e0ae161 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 878 time: 5.2896531 Dec 10 14:30:53.647538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58712) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:53.650302 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58710) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:53.675607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ce99b961-c45c-4cfe-959e-9419ba7672d9 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Request body: {'security_group_rule': {'security_group_id': '86f9ef55-d8a0-4e93-a6a9-e2c927f963a5', 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:53.759889 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ca4d07b6-388f-45fa-a6dc-3b0adde84b99 None None] Provisioning complete for port f99f975a-dd8a-46d0-9f74-f7008e84b5b4 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:53.760420 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ca4d07b6-388f-45fa-a6dc-3b0adde84b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.779068 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-df468df9-b69b-416a-9c0a-a4cbca70f893 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/routers/a4772d7e-f186-4631-b2e3-2bb145bd2322 HTTP/1.1" status: 200 len: 879 time: 0.1275780 Dec 10 14:30:53.781455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58714) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:53.803358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ca4d07b6-388f-45fa-a6dc-3b0adde84b99 None None] Port f99f975a-dd8a-46d0-9f74-f7008e84b5b4 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:53.852866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a176589-3649-4b6f-bbeb-63f5f79064f1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.875589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4a176589-3649-4b6f-bbeb-63f5f79064f1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for f99f975a-dd8a-46d0-9f74-f7008e84b5b4 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:53.884676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-a9ed17ba-d33e-4b73-85a4-25a69a833896 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:53.886140 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-a9ed17ba-d33e-4b73-85a4-25a69a833896 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/networks?id=6227fea4-3842-4a83-a78f-a5ec3bccdb07 HTTP/1.1" status: 200 len: 796 time: 0.2654576 Dec 10 14:30:53.888970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ce99b961-c45c-4cfe-959e-9419ba7672d9 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:53.953121 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-d96e812a-a463-432d-a826-71707186c37e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/quotas/c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 375 time: 0.0583301 Dec 10 14:30:53.970523 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-177a240f-3e31-4511-aa07-1c5839a84f12 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 882 time: 0.1850138 Dec 10 14:30:53.970789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58716) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:53.975103 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-eba5e494-d074-4184-83f2-56dd5067ec27 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'name': 'updatedtempest-RoutersTest-router-27469821'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:54.304453 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ce99b961-c45c-4cfe-959e-9419ba7672d9 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.306137 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eba5e494-d074-4184-83f2-56dd5067ec27 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.326252 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-92311373-85d8-414e-9409-0cbb2e50c66e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3664751 Dec 10 14:30:54.416144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ce99b961-c45c-4cfe-959e-9419ba7672d9 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.427886 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eba5e494-d074-4184-83f2-56dd5067ec27 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.460528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce99b961-c45c-4cfe-959e-9419ba7672d9 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f3ad5191-14de-4ada-91ed-9e912e8ff1fc,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:54.531128 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ce99b961-c45c-4cfe-959e-9419ba7672d9 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.535308 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ce99b961-c45c-4cfe-959e-9419ba7672d9 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8618083 Dec 10 14:30:54.536872 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58720) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:54.542783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-60b121c3-af11-4375-9994-35701432e293 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Request body: {'security_group_rule': {'security_group_id': '86f9ef55-d8a0-4e93-a6a9-e2c927f963a5', 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:54.558160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eba5e494-d074-4184-83f2-56dd5067ec27 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router a4772d7e-f186-4631-b2e3-2bb145bd2322 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:30:54.586854 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-471c0b67-4546-43fa-b8a0-65098f8cfb65 service neutron] 10.222.0.57 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2444644 Dec 10 14:30:54.597315 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a176589-3649-4b6f-bbeb-63f5f79064f1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.682926 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a176589-3649-4b6f-bbeb-63f5f79064f1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=f99f975a-dd8a-46d0-9f74-f7008e84b5b4,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:54.699728 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60b121c3-af11-4375-9994-35701432e293 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.720474 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eba5e494-d074-4184-83f2-56dd5067ec27 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:30:54.721597 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device fe83f899-36f9-48cd-9370-e256933ed108 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:54.733668 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-eba5e494-d074-4184-83f2-56dd5067ec27 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.742768 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-eba5e494-d074-4184-83f2-56dd5067ec27 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/a4772d7e-f186-4631-b2e3-2bb145bd2322 HTTP/1.1" status: 200 len: 886 time: 0.7632186 Dec 10 14:30:54.743238 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58722) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:54.772724 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec1b387e-f8fe-4466-95b8-6d8600e0e0ba None None] Sync routers for ids ['a4772d7e-f186-4631-b2e3-2bb145bd2322'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:54.818582 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec1b387e-f8fe-4466-95b8-6d8600e0e0ba None None] Routers {'a4772d7e-f186-4631-b2e3-2bb145bd2322'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:54.819480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ec1b387e-f8fe-4466-95b8-6d8600e0e0ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a4772d7e-f186-4631-b2e3-2bb145bd2322'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:54.862170 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-9b101296-ca7c-4688-a9b3-8ff27ff662e9 service neutron] 10.222.0.57 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2743745 Dec 10 14:30:54.877142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ec1b387e-f8fe-4466-95b8-6d8600e0e0ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:54.891379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60b121c3-af11-4375-9994-35701432e293 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.892297 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec1b387e-f8fe-4466-95b8-6d8600e0e0ba None None] Routers {'a4772d7e-f186-4631-b2e3-2bb145bd2322'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:54.895799 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ec1b387e-f8fe-4466-95b8-6d8600e0e0ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['a4772d7e-f186-4631-b2e3-2bb145bd2322'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:54.898431 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58724) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:54.900137 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7d6c2c9d-00b7-4e4e-8645-01c3dba3ba4c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/routers/a4772d7e-f186-4631-b2e3-2bb145bd2322 HTTP/1.1" status: 200 len: 886 time: 0.1553469 Dec 10 14:30:54.916193 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4a176589-3649-4b6f-bbeb-63f5f79064f1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:54.919707 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4a176589-3649-4b6f-bbeb-63f5f79064f1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/f99f975a-dd8a-46d0-9f74-f7008e84b5b4 HTTP/1.1" status: 204 len: 168 time: 1.7750666 Dec 10 14:30:54.922269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58726) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:54.942598 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-51373b3b-e979-457e-8ad9-0603dce8d98b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=a4772d7e-f186-4631-b2e3-2bb145bd2322 HTTP/1.1" status: 200 len: 205 time: 0.0413957 Dec 10 14:30:54.944891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58728) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:54.970843 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-ec1b387e-f8fe-4466-95b8-6d8600e0e0ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:54.971665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec1b387e-f8fe-4466-95b8-6d8600e0e0ba None None] The sync data for ids ['a4772d7e-f186-4631-b2e3-2bb145bd2322'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:54.984001 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port fe83f899-36f9-48cd-9370-e256933ed108 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:54.986623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.017801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2642ab16-b613-4db7-b4c2-6bcf45a6f869 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:55.019361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2642ab16-b613-4db7-b4c2-6bcf45a6f869 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:55.021294 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2642ab16-b613-4db7-b4c2-6bcf45a6f869 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:55.025698 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2642ab16-b613-4db7-b4c2-6bcf45a6f869 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.0994749 Dec 10 14:30:55.026013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58730) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:55.088042 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-06ba49ed-2bf3-41a9-b6e2-fbc979698f9f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 14b38d17-838e-42f5-9950-b658bd6b499c {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:55.092095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06ba49ed-2bf3-41a9-b6e2-fbc979698f9f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.095633 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60b121c3-af11-4375-9994-35701432e293 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.120286 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60b121c3-af11-4375-9994-35701432e293 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5f0ff7b1-ff53-4a72-a525-dd859634ffee,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:55.125057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.176853 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06ba49ed-2bf3-41a9-b6e2-fbc979698f9f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.224274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60b121c3-af11-4375-9994-35701432e293 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.225489 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-60b121c3-af11-4375-9994-35701432e293 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.6876197 Dec 10 14:30:55.228860 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58740) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:55.234674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7574a9e5-e0f1-4f2e-9be1-c0ac5d52e138 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Request body: {'security_group_rule': {'security_group_id': '86f9ef55-d8a0-4e93-a6a9-e2c927f963a5', 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:55.255253 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-15ece891-4645-4d4c-b752-f5c13a641cb0 req-a596b683-819c-4712-8154-4ba9055b301a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 210 time: 0.0391555 Dec 10 14:30:55.272092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.299352 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06ba49ed-2bf3-41a9-b6e2-fbc979698f9f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.376512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7574a9e5-e0f1-4f2e-9be1-c0ac5d52e138 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.390427 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port a4eca117-384f-4a32-b33c-a3f0ccff0b51 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:55.390872 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.432508 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7574a9e5-e0f1-4f2e-9be1-c0ac5d52e138 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.440142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06ba49ed-2bf3-41a9-b6e2-fbc979698f9f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.480576 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06ba49ed-2bf3-41a9-b6e2-fbc979698f9f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=14b38d17-838e-42f5-9950-b658bd6b499c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:55.484541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-06ba49ed-2bf3-41a9-b6e2-fbc979698f9f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.487498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.490207 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-06ba49ed-2bf3-41a9-b6e2-fbc979698f9f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/14b38d17-838e-42f5-9950-b658bd6b499c HTTP/1.1" status: 204 len: 168 time: 0.4629047 Dec 10 14:30:55.492295 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58744) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:55.492791 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20cba7c6-79d0-471e-841a-78b6cb8f2065 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:55.536858 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for a4eca117-384f-4a32-b33c-a3f0ccff0b51 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:55.602347 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-05d2b649-3d1c-4308-8f21-bfbad88e0802 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 4be0af70-c176-4c45-aad4-5123f1642584 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:30:55.609573 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05d2b649-3d1c-4308-8f21-bfbad88e0802 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.661684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7574a9e5-e0f1-4f2e-9be1-c0ac5d52e138 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.664796 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05d2b649-3d1c-4308-8f21-bfbad88e0802 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.684744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7574a9e5-e0f1-4f2e-9be1-c0ac5d52e138 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=77e9c743-3f61-4f55-b3e7-055908df0662,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:55.772742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7574a9e5-e0f1-4f2e-9be1-c0ac5d52e138 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.774613 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7574a9e5-e0f1-4f2e-9be1-c0ac5d52e138 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5447278 Dec 10 14:30:55.777386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58746) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:55.783940 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4dfd0e6a-f5c2-420e-bb4b-f4c7d37456a4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Request body: {'security_group_rule': {'security_group_id': '86f9ef55-d8a0-4e93-a6a9-e2c927f963a5', 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:55.841312 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05d2b649-3d1c-4308-8f21-bfbad88e0802 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.854145 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dfd0e6a-f5c2-420e-bb4b-f4c7d37456a4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.917032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dfd0e6a-f5c2-420e-bb4b-f4c7d37456a4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.943255 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Sync routers for ids ['4288339e-f09b-4cd3-bef5-41762390c3ed'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:30:55.947684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:55.954608 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Routers {'4288339e-f09b-4cd3-bef5-41762390c3ed'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:55.964558 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['4288339e-f09b-4cd3-bef5-41762390c3ed'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:55.977143 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=a4eca117-384f-4a32-b33c-a3f0ccff0b51,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:55.990059 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d45fc6d9-0077-484f-906c-eaccdb63def7 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:56.010770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dfd0e6a-f5c2-420e-bb4b-f4c7d37456a4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.033084 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05d2b649-3d1c-4308-8f21-bfbad88e0802 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.038074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dfd0e6a-f5c2-420e-bb4b-f4c7d37456a4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3b9d547d-317b-471f-bde0-ae11f7b29790,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:56.080903 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Set router 4288339e-f09b-4cd3-bef5-41762390c3ed gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:56.086528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05d2b649-3d1c-4308-8f21-bfbad88e0802 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=4be0af70-c176-4c45-aad4-5123f1642584,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:56.094001 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05d2b649-3d1c-4308-8f21-bfbad88e0802 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.100580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58748) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:56.100783 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-05d2b649-3d1c-4308-8f21-bfbad88e0802 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/4be0af70-c176-4c45-aad4-5123f1642584 HTTP/1.1" status: 204 len: 168 time: 0.6072211 Dec 10 14:30:56.113145 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.147689 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d227adef-972d-4291-8864-e796868ff6ea tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0459142 Dec 10 14:30:56.151201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4dfd0e6a-f5c2-420e-bb4b-f4c7d37456a4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.154783 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4dfd0e6a-f5c2-420e-bb4b-f4c7d37456a4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3737321 Dec 10 14:30:56.154783 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58750) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:56.163494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58752) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:56.168266 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-43560115-0fa5-47ad-9703-edb3bcf5d9d0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Request body: {'security_group_rule': {'security_group_id': '86f9ef55-d8a0-4e93-a6a9-e2c927f963a5', 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:56.238719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa3f195e-506c-4ac6-a5a4-7d14c0a50142 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:56.243814 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fa3f195e-506c-4ac6-a5a4-7d14c0a50142 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 867 time: 0.0897853 Dec 10 14:30:56.244350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58754) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:56.246060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.246365 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2b28cfd-12cf-4250-9ab6-adf5f7323197 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:56.248929 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.276174 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-43560115-0fa5-47ad-9703-edb3bcf5d9d0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Project a1d5a7f281834a22aee867878a76c226 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:30:56.292041 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-43560115-0fa5-47ad-9703-edb3bcf5d9d0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.315940 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ca5bcb2-f24e-4c8f-8e47-01593f69b712 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:56.319783 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4ca5bcb2-f24e-4c8f-8e47-01593f69b712 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0721011 Dec 10 14:30:56.327551 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58758) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:56.364860 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-97c92c4f-78c3-40b0-9528-fb7cf59ddaa6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0420306 Dec 10 14:30:56.373963 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58760) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:56.380670 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f4be7024-9575-48ac-bd75-6b6c7b9e891a None None] Provisioning complete for port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:56.381706 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f4be7024-9575-48ac-bd75-6b6c7b9e891a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.385148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ffe44381-08b1-4ac4-a4d2-02ba03885414 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:56.392901 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-dc7bbf75-6aac-428f-b78a-0b7f5ff86ca2 req-2ff2e436-6f8b-455e-9d31-b1312ee25977 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 210 time: 0.0302026 Dec 10 14:30:56.396090 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'name': 'tempest-TestVolumeBootPattern-1302064138-router', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94'}], 'enable_snat': True}, 'gw_port_id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:43Z', 'updated_at': '2021-12-10T14:30:50Z', 'revision_number': 4, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'gw_port': {'id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:6f:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1200, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:44Z', 'updated_at': '2021-12-10T14:30:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'b4cf4bde-96e7-442d-b89c-6e3af846a05d', 'name': '', 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'mac_address': 'fa:16:3e:2a:38:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:49Z', 'updated_at': '2021-12-10T14:30:51Z', 'revision_number': 2, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'subnets': [{'id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:56.403224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.403708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Fanout notify agent at l3_agent the message router_deleted on router a4772d7e-f186-4631-b2e3-2bb145bd2322 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:30:56.418405 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.419695 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7c168998-6645-4dfc-9384-e2836001c506 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/a4772d7e-f186-4631-b2e3-2bb145bd2322 HTTP/1.1" status: 204 len: 168 time: 1.4736130 Dec 10 14:30:56.423675 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58762) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:56.428635 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'network': {'name': 'tempest-RoutersTest-2063078950'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:56.447553 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Checking router: 4288339e-f09b-4cd3-bef5-41762390c3ed for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:30:56.447910 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Updating router 4288339e-f09b-4cd3-bef5-41762390c3ed port b4cf4bde-96e7-442d-b89c-6e3af846a05d binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:30:56.484168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-43560115-0fa5-47ad-9703-edb3bcf5d9d0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.496921 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.534210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5eea2fe-b4e4-4d82-a6dc-9cf97846f493 None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:30:56.541659 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:56.545352 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.570826 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-43560115-0fa5-47ad-9703-edb3bcf5d9d0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.600606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] vlan segment allocate from pool success with {'vlan_id': 364, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:30:56.611515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c5eea2fe-b4e4-4d82-a6dc-9cf97846f493 None None] Deleting port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:30:56.611515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c5eea2fe-b4e4-4d82-a6dc-9cf97846f493 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.612379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.612929 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added segment 6a9ccf95-aa89-48bf-90b6-4a5066fc3547 of type vlan for network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc Dec 10 14:30:56.617723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43560115-0fa5-47ad-9703-edb3bcf5d9d0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=246be7b6-77d8-418e-a179-a1259c4bee01,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:56.632663 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ffe44381-08b1-4ac4-a4d2-02ba03885414 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:56.656271 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ffe44381-08b1-4ac4-a4d2-02ba03885414 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.662362 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-ffe44381-08b1-4ac4-a4d2-02ba03885414 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:56.663345 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ffe44381-08b1-4ac4-a4d2-02ba03885414 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:56.674275 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.684667 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c5eea2fe-b4e4-4d82-a6dc-9cf97846f493 None None] For port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:56.685457 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c5eea2fe-b4e4-4d82-a6dc-9cf97846f493 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.708625 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:30:56.710107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c5eea2fe-b4e4-4d82-a6dc-9cf97846f493 None None] Calling delete_port for 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:30:56.726619 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-43560115-0fa5-47ad-9703-edb3bcf5d9d0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.730557 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-43560115-0fa5-47ad-9703-edb3bcf5d9d0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5633845 Dec 10 14:30:56.738277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58770) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:56.738277 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-19100f41-0df9-4185-8996-64f82f878e87 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Request body: {'security_group_rule': {'security_group_id': '86f9ef55-d8a0-4e93-a6a9-e2c927f963a5', 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:56.792789 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ffe44381-08b1-4ac4-a4d2-02ba03885414 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.4144931 Dec 10 14:30:56.793005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58772) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:56.802438 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.803036 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.809674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:56.811756 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.811881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-78372c68-36a5-4bf6-a481-5e10b66f8c4b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'slaac'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:56.864891 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.881268 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Network': ['ID=b5aecaaf-096f-4fbf-9712-7c43f5e14bdc,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:56.894228 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:30:56.896349 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:56.949630 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-19100f41-0df9-4185-8996-64f82f878e87 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Project a1d5a7f281834a22aee867878a76c226 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:30:56.949936 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe4552e0-41bb-48e2-8966-3ef480fbebf7 None None] Pushing event updated for resources: {'Port': ['ID=b4cf4bde-96e7-442d-b89c-6e3af846a05d,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:56.956495 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-19100f41-0df9-4185-8996-64f82f878e87 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.005460 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Attempting to bind port b4cf4bde-96e7-442d-b89c-6e3af846a05d on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:57.005848 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Attempting to bind port b4cf4bde-96e7-442d-b89c-6e3af846a05d by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '201484db-3b63-4310-83aa-539a159c055c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:57.006215 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Attempting to bind port b4cf4bde-96e7-442d-b89c-6e3af846a05d on network e7b30006-dcc3-417d-b60d-21edaa083929 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:57.011868 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c5eea2fe-b4e4-4d82-a6dc-9cf97846f493 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.025760 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:57.026136 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Checking segment: {'id': '201484db-3b63-4310-83aa-539a159c055c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:57.026553 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.029864 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Bound using segment: {'id': '201484db-3b63-4310-83aa-539a159c055c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:57.030363 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Bound port: b4cf4bde-96e7-442d-b89c-6e3af846a05d, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '201484db-3b63-4310-83aa-539a159c055c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:57.032832 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.036684 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-794e6767-4251-4f23-a4bd-de408b379376 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.6119437 Dec 10 14:30:57.039564 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58776) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:57.044823 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'subnet': {'network_id': 'b5aecaaf-096f-4fbf-9712-7c43f5e14bdc', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:57.059855 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-19100f41-0df9-4185-8996-64f82f878e87 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.110296 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5eea2fe-b4e4-4d82-a6dc-9cf97846f493 None None] Pushing event deleted for resources: {'Port': ['ID=0da2c25f-d8af-4924-bb0a-0f20c2cfa82f,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:57.115683 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5eea2fe-b4e4-4d82-a6dc-9cf97846f493 None None] No DVR routers for this DVR port 0da2c25f-d8af-4924-bb0a-0f20c2cfa82f on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:30:57.119719 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] For port b4cf4bde-96e7-442d-b89c-6e3af846a05d, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:57.127651 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] For port b4cf4bde-96e7-442d-b89c-6e3af846a05d, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b4cf4bde-96e7-442d-b89c-6e3af846a05d,segment=NetworkSegment(201484db-3b63-4310-83aa-539a159c055c),segment_id=201484db-3b63-4310-83aa-539a159c055c)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:57.146439 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-19100f41-0df9-4185-8996-64f82f878e87 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.171982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19100f41-0df9-4185-8996-64f82f878e87 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3cf57d61-50f3-425a-856a-68b2cda2eca8,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:57.176902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-78372c68-36a5-4bf6-a481-5e10b66f8c4b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:57.180265 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-78372c68-36a5-4bf6-a481-5e10b66f8c4b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.181861 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-78372c68-36a5-4bf6-a481-5e10b66f8c4b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:57.182212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-78372c68-36a5-4bf6-a481-5e10b66f8c4b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:57.216566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-1d38ea8f-bb53-48b2-9ccc-5a0d9b824e61 None None] Provisioning complete for port b4cf4bde-96e7-442d-b89c-6e3af846a05d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:57.216877 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1d38ea8f-bb53-48b2-9ccc-5a0d9b824e61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.233498 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.249958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-1d38ea8f-bb53-48b2-9ccc-5a0d9b824e61 None None] Port b4cf4bde-96e7-442d-b89c-6e3af846a05d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:30:57.263870 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-19100f41-0df9-4185-8996-64f82f878e87 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.265585 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-19100f41-0df9-4185-8996-64f82f878e87 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.5332003 Dec 10 14:30:57.269048 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-78372c68-36a5-4bf6-a481-5e10b66f8c4b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.4738567 Dec 10 14:30:57.273798 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58782) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:57.282943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2f249b22-132f-4582-8bac-13c7d9169697 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:57.302440 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Routers {'4288339e-f09b-4cd3-bef5-41762390c3ed'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:30:57.303265 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['4288339e-f09b-4cd3-bef5-41762390c3ed'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:57.306438 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe4552e0-41bb-48e2-8966-3ef480fbebf7 None None] Pushing event updated for resources: {'Port': ['ID=b4cf4bde-96e7-442d-b89c-6e3af846a05d,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:57.419043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:57.425100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.463330 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] Set router 4288339e-f09b-4cd3-bef5-41762390c3ed gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:30:57.585737 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-fc64d33d-1496-43b0-bea9-1e6974ce6fad None None] Provisioning complete for port b4cf4bde-96e7-442d-b89c-6e3af846a05d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:57.585737 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc64d33d-1496-43b0-bea9-1e6974ce6fad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.592528 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-aaefeb10-1f5e-4eea-9701-967955284eb2 req-bc7edaff-46a2-4171-bec0-67be4546a755 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 210 time: 0.0607502 Dec 10 14:30:57.606851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f249b22-132f-4582-8bac-13c7d9169697 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:57.611106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2f249b22-132f-4582-8bac-13c7d9169697 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.613211 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-2f249b22-132f-4582-8bac-13c7d9169697 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:57.613678 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2f249b22-132f-4582-8bac-13c7d9169697 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:57.728436 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc64d33d-1496-43b0-bea9-1e6974ce6fad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.755416 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2f249b22-132f-4582-8bac-13c7d9169697 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.4772680 Dec 10 14:30:57.755705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58826) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:57.760755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-01888642-3be4-4b24-85d4-962d482040ba tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:57.765522 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'name': 'tempest-TestVolumeBootPattern-1302064138-router', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94'}], 'enable_snat': True}, 'gw_port_id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:43Z', 'updated_at': '2021-12-10T14:30:50Z', 'revision_number': 4, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'gw_port': {'id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:6f:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1200, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:44Z', 'updated_at': '2021-12-10T14:30:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'b4cf4bde-96e7-442d-b89c-6e3af846a05d', 'name': '', 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'mac_address': 'fa:16:3e:2a:38:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:49Z', 'updated_at': '2021-12-10T14:30:57Z', 'revision_number': 4, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'subnets': [{'id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:30:57.781567 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fc64d33d-1496-43b0-bea9-1e6974ce6fad None None] For port b4cf4bde-96e7-442d-b89c-6e3af846a05d, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=b4cf4bde-96e7-442d-b89c-6e3af846a05d,segment=NetworkSegment(201484db-3b63-4310-83aa-539a159c055c),segment_id=201484db-3b63-4310-83aa-539a159c055c)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:30:57.801676 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44010332-a660-40a3-ba1b-594695a26bc4 None None] The sync data for ids ['4288339e-f09b-4cd3-bef5-41762390c3ed'] in dv-neutron-821401-2-hyperv is: [{'id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'name': 'tempest-TestVolumeBootPattern-1302064138-router', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94'}], 'enable_snat': True}, 'gw_port_id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:43Z', 'updated_at': '2021-12-10T14:30:50Z', 'revision_number': 4, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'gw_port': {'id': 'fe83f899-36f9-48cd-9370-e256933ed108', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:6f:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1200, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:44Z', 'updated_at': '2021-12-10T14:30:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'b4cf4bde-96e7-442d-b89c-6e3af846a05d', 'name': '', 'network_id': 'e7b30006-dcc3-417d-b60d-21edaa083929', 'tenant_id': '38edb140cc9c4afc8661e1f00beceb6d', 'mac_address': 'fa:16:3e:2a:38:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4288339e-f09b-4cd3-bef5-41762390c3ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:49Z', 'updated_at': '2021-12-10T14:30:57Z', 'revision_number': 4, 'project_id': '38edb140cc9c4afc8661e1f00beceb6d', 'subnets': [{'id': '81a8393c-4abf-4fa8-8b05-10f41384bcef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:30:57.839177 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.862743 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fc64d33d-1496-43b0-bea9-1e6974ce6fad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.929927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Subnet': ['ID=47d3c035-cc5c-46f9-b04b-7bedd04839eb,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:57.935387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc64d33d-1496-43b0-bea9-1e6974ce6fad None None] Pushing event updated for resources: {'Port': ['ID=b4cf4bde-96e7-442d-b89c-6e3af846a05d,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:57.942395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Checking segment: {'id': '6a9ccf95-aa89-48bf-90b6-4a5066fc3547', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': 'b5aecaaf-096f-4fbf-9712-7c43f5e14bdc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:57.950499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network hostable DHCP agents. Network: b5aecaaf-096f-4fbf-9712-7c43f5e14bdc, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:30:57.993559 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01888642-3be4-4b24-85d4-962d482040ba tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:57.997246 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-01888642-3be4-4b24-85d4-962d482040ba tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:57.998810 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-01888642-3be4-4b24-85d4-962d482040ba tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:57.999323 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-01888642-3be4-4b24-85d4-962d482040ba tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:58.039397 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:30:58.070895 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-01888642-3be4-4b24-85d4-962d482040ba tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.3140697 Dec 10 14:30:58.074306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58828) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:58.079554 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-847a5c13-ac7f-434c-ac41-b33708452715 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'slaac'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:58.162438 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, b5aecaaf-096f-4fbf-9712-7c43f5e14bdc) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:58.168987 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:58.169927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:58.177013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d782eb65-b91e-4c4a-8d2c-7b7b606a264f None None] Network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:30:58.256708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-847a5c13-ac7f-434c-ac41-b33708452715 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:58.260307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-847a5c13-ac7f-434c-ac41-b33708452715 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:58.266541 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-847a5c13-ac7f-434c-ac41-b33708452715 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:58.268531 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-847a5c13-ac7f-434c-ac41-b33708452715 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:58.304097 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-b5aecaaf-096f-4fbf-9712-7c43f5e14bdc', 'network_id': 'b5aecaaf-096f-4fbf-9712-7c43f5e14bdc', 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'fixed_ips': [{'subnet_id': '47d3c035-cc5c-46f9-b04b-7bedd04839eb'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:30:58.305258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:58.319431 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-86a3ab12-6c27-4e4f-8d27-8e0740a6e537 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2787521 Dec 10 14:30:58.327659 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58830) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:58.335917 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-98d5cc3b-80a2-42b5-bdb9-65bc4758031e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-990608777', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:58.351015 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-847a5c13-ac7f-434c-ac41-b33708452715 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.2747605 Dec 10 14:30:58.355732 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58832) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:58.362913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e9778bf5-8bc3-4d3b-9a67-a5f795b21b77 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:58.462104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Allocated IP 172.20.0.2 (b5aecaaf-096f-4fbf-9712-7c43f5e14bdc/47d3c035-cc5c-46f9-b04b-7bedd04839eb/c6d66425-4836-48bd-9f70-e26911e8d4df) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:30:58.490691 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98d5cc3b-80a2-42b5-bdb9-65bc4758031e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:58.491644 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98d5cc3b-80a2-42b5-bdb9-65bc4758031e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:58.628001 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:58.725164 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2b61d737-e2f5-4c66-99a7-b08be0b99747 req-bfa83de0-b642-4f7f-b639-87edab5f7af1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 210 time: 0.0361090 Dec 10 14:30:58.737557 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:58.794224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Pushing event updated for resources: {'Port': ['ID=c6d66425-4836-48bd-9f70-e26911e8d4df,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:58.801290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device b4cf4bde-96e7-442d-b89c-6e3af846a05d up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:30:58.860918 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:30:58.863929 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:30:58.867999 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:30:58.930493 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port b4cf4bde-96e7-442d-b89c-6e3af846a05d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:30:58.930871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:58.962547 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Attempting to bind port c6d66425-4836-48bd-9f70-e26911e8d4df on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:30:58.962998 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Attempting to bind port c6d66425-4836-48bd-9f70-e26911e8d4df by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6a9ccf95-aa89-48bf-90b6-4a5066fc3547', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': 'b5aecaaf-096f-4fbf-9712-7c43f5e14bdc'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:30:58.963431 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Attempting to bind port c6d66425-4836-48bd-9f70-e26911e8d4df on network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:30:58.972018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:30:58.972495 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Checking segment: {'id': '6a9ccf95-aa89-48bf-90b6-4a5066fc3547', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': 'b5aecaaf-096f-4fbf-9712-7c43f5e14bdc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:30:58.973131 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:58.973628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Bound using segment: {'id': '6a9ccf95-aa89-48bf-90b6-4a5066fc3547', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': 'b5aecaaf-096f-4fbf-9712-7c43f5e14bdc'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:30:58.974168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Bound port: c6d66425-4836-48bd-9f70-e26911e8d4df, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6a9ccf95-aa89-48bf-90b6-4a5066fc3547', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': 'b5aecaaf-096f-4fbf-9712-7c43f5e14bdc'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:30:58.974848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:59.040030 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98d5cc3b-80a2-42b5-bdb9-65bc4758031e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:59.077473 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-3830cdfd-1b2a-406c-b600-36749cb5fc89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:59.079310 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-3830cdfd-1b2a-406c-b600-36749cb5fc89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/networks?id=6227fea4-3842-4a83-a78f-a5ec3bccdb07 HTTP/1.1" status: 200 len: 796 time: 0.6307397 Dec 10 14:30:59.103511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9778bf5-8bc3-4d3b-9a67-a5f795b21b77 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:59.107213 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] For port c6d66425-4836-48bd-9f70-e26911e8d4df, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:30:59.112910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e9778bf5-8bc3-4d3b-9a67-a5f795b21b77 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:59.112910 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-e9778bf5-8bc3-4d3b-9a67-a5f795b21b77 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:30:59.112910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e9778bf5-8bc3-4d3b-9a67-a5f795b21b77 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:30:59.113269 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] For port c6d66425-4836-48bd-9f70-e26911e8d4df, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c6d66425-4836-48bd-9f70-e26911e8d4df,segment=NetworkSegment(6a9ccf95-aa89-48bf-90b6-4a5066fc3547),segment_id=6a9ccf95-aa89-48bf-90b6-4a5066fc3547)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:30:59.139874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98d5cc3b-80a2-42b5-bdb9-65bc4758031e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:59.182713 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-44aab00c-8455-407b-a856-3b75e7300720 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 379 time: 0.0932133 Dec 10 14:30:59.188865 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:59.194274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'port': {'device_id': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'admin_state_up': True, 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'security_groups': ['27b83861-1b2d-49f5-87e4-db2e023d9028']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:59.216299 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e9778bf5-8bc3-4d3b-9a67-a5f795b21b77 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.8594482 Dec 10 14:30:59.219067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58856) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:59.260556 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1f88e312-7f58-434a-b331-e2dbf72aa72a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0401347 Dec 10 14:30:59.262913 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58866) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:59.273272 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7b0c17-7063-4d64-aca4-493e0f7176ae None None] Pushing event updated for resources: {'Port': ['ID=c6d66425-4836-48bd-9f70-e26911e8d4df,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:30:59.283418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98d5cc3b-80a2-42b5-bdb9-65bc4758031e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:59.284633 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-98d5cc3b-80a2-42b5-bdb9-65bc4758031e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.9546053 Dec 10 14:30:59.287332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58870) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:59.339990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25fa9c78-b2aa-4faa-8ced-07f7810ee61f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:30:59.341625 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-25fa9c78-b2aa-4faa-8ced-07f7810ee61f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0776434 Dec 10 14:30:59.344639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58882) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:59.387398 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-48d46fe6-5267-40d9-9428-682245cb59aa tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0416050 Dec 10 14:30:59.393110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58888) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:30:59.403219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:30:59.603375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:59.607429 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:59.715384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:59.718958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:30:59.721959 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:30:59.874914 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2c7b1b6e-2c69-42d8-9d55-3b3951604d57 req-685f9e19-a603-47dd-bd2d-1dfb759eeb62 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 210 time: 0.0390353 Dec 10 14:31:00.022567 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.10 (6227fea4-3842-4a83-a78f-a5ec3bccdb07/06dce599-7e77-4ea6-a2ef-4939d220952a/70717ebc-79f9-48f1-b654-d7a76d6366d3) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:00.088727 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.20.0.1 (b5aecaaf-096f-4fbf-9712-7c43f5e14bdc/47d3c035-cc5c-46f9-b04b-7bedd04839eb/2e863a7f-8fa6-43af-b9c6-f44557a3cabd) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:00.149623 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:31:00.151247 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.215262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:00.219766 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:00.224630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:00.225716 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.229616 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da0498b1-0e33-4d8a-8bca-9e887b0afdbd None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:00.262924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=8a90ebc2-a2fe-409c-ac33-76ba6c30ed7c,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:00.339264 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.340220 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2b2d077a-ab8c-4079-a956-79f349a58c2f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.9418805 Dec 10 14:31:00.343468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58896) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:00.349171 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:86:30:99', 'name': 'tempest-NetworksTestDHCPv6-2062153024'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:00.355353 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.421759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91836832-29e7-4849-a74c-daba975e243a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '8a90ebc2-a2fe-409c-ac33-76ba6c30ed7c'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:00.424317 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91836832-29e7-4849-a74c-daba975e243a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.475479 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.528057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.544184 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:00.552780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:00.558370 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:00.569330 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:00.601091 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=70717ebc-79f9-48f1-b654-d7a76d6366d3,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:00.607599 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:00.615447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:00.642470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:00.645365 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-91836832-29e7-4849-a74c-daba975e243a None None] Allocated IP 2001:db8::f816:3eff:fef8:bd30 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/8a90ebc2-a2fe-409c-ac33-76ba6c30ed7c/f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:00.656983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:00.657693 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.735362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=2e863a7f-8fa6-43af-b9c6-f44557a3cabd,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:00.743872 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.793986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5703a188-658c-433a-82fd-ca9f3c9141f9 None None] Network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:00.794228 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:00.798521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c6d66425-4836-48bd-9f70-e26911e8d4df up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:00.820624 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port b7a29473-1427-4db6-89f9-e129b3657aa5 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:31:00.828780 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-6aa0531d-4203-4654-9203-e24f59d8461e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6390867 Dec 10 14:31:00.852215 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Request body: {'port': {'device_id': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:00.990670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.008116 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-07383818-5704-42ae-b8a6-7bf9f6d8904b None None] Provisioning complete for port c6d66425-4836-48bd-9f70-e26911e8d4df triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:01.008529 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-07383818-5704-42ae-b8a6-7bf9f6d8904b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.055702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4dd5253-fbba-4767-b350-40a167f24d2c req-a141373d-21aa-41d8-8344-af2e3906310c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:01.057333 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d4dd5253-fbba-4767-b350-40a167f24d2c req-a141373d-21aa-41d8-8344-af2e3906310c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 932 time: 0.0614164 Dec 10 14:31:01.144117 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d4dd5253-fbba-4767-b350-40a167f24d2c req-c7fe6fd7-60fb-44af-8dcb-fa478b8780a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0752192 Dec 10 14:31:01.216549 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.314066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.342908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c6d66425-4836-48bd-9f70-e26911e8d4df triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:01.343311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.386667 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91836832-29e7-4849-a74c-daba975e243a None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.449341 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-07383818-5704-42ae-b8a6-7bf9f6d8904b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.531067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-07383818-5704-42ae-b8a6-7bf9f6d8904b None None] For port c6d66425-4836-48bd-9f70-e26911e8d4df, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c6d66425-4836-48bd-9f70-e26911e8d4df,segment=NetworkSegment(6a9ccf95-aa89-48bf-90b6-4a5066fc3547),segment_id=6a9ccf95-aa89-48bf-90b6-4a5066fc3547)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:01.531067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.591866 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 70717ebc-79f9-48f1-b654-d7a76d6366d3 {{(pid=103810) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:31:01.603445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.638528 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.provisioning_blocks [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Transition to ACTIVE for port object 70717ebc-79f9-48f1-b654-d7a76d6366d3 will not be triggered until provisioned by entity L2. {{(pid=103810) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:31:01.685554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.731137 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91836832-29e7-4849-a74c-daba975e243a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.753379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.773533 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-07383818-5704-42ae-b8a6-7bf9f6d8904b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.792826 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91836832-29e7-4849-a74c-daba975e243a None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:01.797889 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fe86:3099 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/8a90ebc2-a2fe-409c-ac33-76ba6c30ed7c/b7a29473-1427-4db6-89f9-e129b3657aa5) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:01.823224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-91836832-29e7-4849-a74c-daba975e243a None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:01.826058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91836832-29e7-4849-a74c-daba975e243a None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:01.842105 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91836832-29e7-4849-a74c-daba975e243a None None] Pushing event updated for resources: {'Port': ['ID=f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:01.908446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.917165 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.925515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:31:01.931880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:31:01.945780 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=2e863a7f-8fa6-43af-b9c6-f44557a3cabd,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:01.957795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07383818-5704-42ae-b8a6-7bf9f6d8904b None None] Pushing event updated for resources: {'Port': ['ID=c6d66425-4836-48bd-9f70-e26911e8d4df,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:01.979577 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ef649dbf-70cb-406a-92c3-ce6ef7a02781 None None] Provisioning complete for port c6d66425-4836-48bd-9f70-e26911e8d4df triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:01.980203 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ef649dbf-70cb-406a-92c3-ce6ef7a02781 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:01.985147 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-91836832-29e7-4849-a74c-daba975e243a None None] Attempting to bind port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:01.985766 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-91836832-29e7-4849-a74c-daba975e243a None None] Attempting to bind port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:01.986310 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91836832-29e7-4849-a74c-daba975e243a None None] Attempting to bind port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:02.024010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.026820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91836832-29e7-4849-a74c-daba975e243a None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:02.027841 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91836832-29e7-4849-a74c-daba975e243a None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:02.028575 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91836832-29e7-4849-a74c-daba975e243a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.029354 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91836832-29e7-4849-a74c-daba975e243a None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:02.030161 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-91836832-29e7-4849-a74c-daba975e243a None None] Bound port: f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:02.032202 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91836832-29e7-4849-a74c-daba975e243a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.168554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Pushing event updated for resources: {'Port': ['ID=70717ebc-79f9-48f1-b654-d7a76d6366d3,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:02.169187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-91836832-29e7-4849-a74c-daba975e243a None None] For port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:02.204612 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-91836832-29e7-4849-a74c-daba975e243a None None] For port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:02.225677 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ef649dbf-70cb-406a-92c3-ce6ef7a02781 None None] Provisioning complete for port 2e863a7f-8fa6-43af-b9c6-f44557a3cabd triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:02.226407 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ef649dbf-70cb-406a-92c3-ce6ef7a02781 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.235175 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:02.235810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.243391 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:02.254746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Attempting to bind port 70717ebc-79f9-48f1-b654-d7a76d6366d3 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:02.255013 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Attempting to bind port 70717ebc-79f9-48f1-b654-d7a76d6366d3 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:02.257715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Attempting to bind port 70717ebc-79f9-48f1-b654-d7a76d6366d3 on network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:02.267052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Port 70717ebc-79f9-48f1-b654-d7a76d6366d3 on network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:31:02.272360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Attempting to bind port 70717ebc-79f9-48f1-b654-d7a76d6366d3 on network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:02.273969 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ef649dbf-70cb-406a-92c3-ce6ef7a02781 None None] Port 2e863a7f-8fa6-43af-b9c6-f44557a3cabd cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:02.274831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:02.275185 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Checking segment: {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:02.275712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Bound using segment: {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:02.276019 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Bound port: 70717ebc-79f9-48f1-b654-d7a76d6366d3, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2d62797f-ef39-42b9-9390-c745f87a2ead', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07'}}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:02.276390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.298320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91836832-29e7-4849-a74c-daba975e243a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.417671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91836832-29e7-4849-a74c-daba975e243a None None] Pushing event updated for resources: {'Port': ['ID=f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:02.437625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:02.443622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:02.452834 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:02.466495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:02.467173 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.472405 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=b7a29473-1427-4db6-89f9-e129b3657aa5,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:02.495759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7030ba-df05-4976-afa8-b8281b726061 req-834eb5bd-510f-482d-92fd-c656a7377a07 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:02.497275 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7b7030ba-df05-4976-afa8-b8281b726061 req-834eb5bd-510f-482d-92fd-c656a7377a07 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 944 time: 0.2649841 Dec 10 14:31:02.569153 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-28aa3ea1-7c43-4411-a450-c08160a5c12a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 2.2215605 Dec 10 14:31:02.572553 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58906) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:02.621066 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7b7030ba-df05-4976-afa8-b8281b726061 req-b5141c50-a069-45ab-9e73-8e85d5abcd44 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1136026 Dec 10 14:31:02.651321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7db4382-5e49-413a-bfe7-ee7069d15ea9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:02.658264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7db4382-5e49-413a-bfe7-ee7069d15ea9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:02.660037 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d7db4382-5e49-413a-bfe7-ee7069d15ea9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.0863068 Dec 10 14:31:02.662856 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58908) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:02.685558 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-17389825-9be0-4930-9d9d-1b8653f77c53 None None] Provisioning complete for port 2e863a7f-8fa6-43af-b9c6-f44557a3cabd triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:02.686323 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-17389825-9be0-4930-9d9d-1b8653f77c53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.793105 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c6d66425-4836-48bd-9f70-e26911e8d4df up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:02.850136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4f057273-541a-4b51-9010-a5f8fbaf9fa8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port b7a29473-1427-4db6-89f9-e129b3657aa5 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:02.850531 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4f057273-541a-4b51-9010-a5f8fbaf9fa8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.885642 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-17389825-9be0-4930-9d9d-1b8653f77c53 None None] Port 2e863a7f-8fa6-43af-b9c6-f44557a3cabd cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:02.912545 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] For port 70717ebc-79f9-48f1-b654-d7a76d6366d3, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:02.923997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port c6d66425-4836-48bd-9f70-e26911e8d4df triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:02.923997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.924230 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] For port 70717ebc-79f9-48f1-b654-d7a76d6366d3, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=70717ebc-79f9-48f1-b654-d7a76d6366d3,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:02.954809 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b704c432-a02c-4968-9e53-465004bbcbbf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:02.984023 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4f057273-541a-4b51-9010-a5f8fbaf9fa8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:03.015742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-4f057273-541a-4b51-9010-a5f8fbaf9fa8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for b7a29473-1427-4db6-89f9-e129b3657aa5 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:03.023511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:03.069854 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router 29bfcc86-c895-4ac7-899f-a63cdcb7f25e is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:31:03.080656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:03.082047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:03.084021 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] 10.222.0.39 "PUT /v2.0/ports/70717ebc-79f9-48f1-b654-d7a76d6366d3 HTTP/1.1" status: 200 len: 1094 time: 2.2463262 Dec 10 14:31:03.087427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:31:03.090529 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9822cf1a-ea19-4027-8bfb-263824f77672" -d '{"events": [{"name": "network-changed", "server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:31:03.199161 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:31:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1cd7c39f-5c28-44e3-84c6-919a2922709f x-openstack-request-id: req-1cd7c39f-5c28-44e3-84c6-919a2922709f {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:31:03.199399 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:31:03.199768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-1cd7c39f-5c28-44e3-84c6-919a2922709f {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:31:03.200346 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'status': 'completed', 'code': 200} Dec 10 14:31:03.218335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02915c66-ddbe-43df-b90f-4b6e07601d2f service neutron] Pushing event updated for resources: {'Port': ['ID=70717ebc-79f9-48f1-b654-d7a76d6366d3,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:03.346699 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:03.355184 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2c3ce3cb-c3ae-4990-a0ef-3c0a038d7d28 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/29bfcc86-c895-4ac7-899f-a63cdcb7f25e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0626836 Dec 10 14:31:03.356674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9822cf1a-ea19-4027-8bfb-263824f77672 req-8cda114c-4013-468a-a32f-d8491bd53456 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:03.358251 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-9822cf1a-ea19-4027-8bfb-263824f77672 req-8cda114c-4013-468a-a32f-d8491bd53456 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 1097 time: 0.1623735 Dec 10 14:31:03.358741 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58914) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:03.359256 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfbc5892-0313-471e-858f-3eaa268dfd25 None None] Sync routers for ids ['29bfcc86-c895-4ac7-899f-a63cdcb7f25e'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:03.400349 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfbc5892-0313-471e-858f-3eaa268dfd25 None None] Routers {'29bfcc86-c895-4ac7-899f-a63cdcb7f25e'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:03.401003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-dfbc5892-0313-471e-858f-3eaa268dfd25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['29bfcc86-c895-4ac7-899f-a63cdcb7f25e'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:03.483977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-dfbc5892-0313-471e-858f-3eaa268dfd25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:03.505655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfbc5892-0313-471e-858f-3eaa268dfd25 None None] Routers {'29bfcc86-c895-4ac7-899f-a63cdcb7f25e'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:03.506326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-dfbc5892-0313-471e-858f-3eaa268dfd25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:30:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['29bfcc86-c895-4ac7-899f-a63cdcb7f25e'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:03.527733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e57952bd-3cb8-46b2-9882-ba6f65e252ff tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:03.529187 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e57952bd-3cb8-46b2-9882-ba6f65e252ff tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports/2e863a7f-8fa6-43af-b9c6-f44557a3cabd HTTP/1.1" status: 200 len: 910 time: 0.1693439 Dec 10 14:31:03.532300 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58916) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:03.540119 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '47d3c035-cc5c-46f9-b04b-7bedd04839eb'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:03.567460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-dfbc5892-0313-471e-858f-3eaa268dfd25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:03.568396 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfbc5892-0313-471e-858f-3eaa268dfd25 None None] The sync data for ids ['29bfcc86-c895-4ac7-899f-a63cdcb7f25e'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:03.606364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4f057273-541a-4b51-9010-a5f8fbaf9fa8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:03.677813 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9822cf1a-ea19-4027-8bfb-263824f77672 req-75f965dd-3509-4295-9a15-66de5365722f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:03.679603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f057273-541a-4b51-9010-a5f8fbaf9fa8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=b7a29473-1427-4db6-89f9-e129b3657aa5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:03.680142 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-9822cf1a-ea19-4027-8bfb-263824f77672 req-75f965dd-3509-4295-9a15-66de5365722f service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&shared=False HTTP/1.1" status: 200 len: 897 time: 0.3105607 Dec 10 14:31:03.714643 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4f057273-541a-4b51-9010-a5f8fbaf9fa8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:03.721303 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4f057273-541a-4b51-9010-a5f8fbaf9fa8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/b7a29473-1427-4db6-89f9-e129b3657aa5 HTTP/1.1" status: 204 len: 168 time: 1.0574167 Dec 10 14:31:03.723756 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58920) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:03.842142 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edf10178-243b-4df3-888a-ac2b89f0f216 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:03.844966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edf10178-243b-4df3-888a-ac2b89f0f216 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:03.847234 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-edf10178-243b-4df3-888a-ac2b89f0f216 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1457 time: 0.1222761 Dec 10 14:31:03.855380 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58922) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:03.862238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-603428ac-033d-4889-ba4c-a5b61ea4c780 req-d48cd238-0c92-4a40-8a07-ffe735119f3a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:03.864058 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-603428ac-033d-4889-ba4c-a5b61ea4c780 req-d48cd238-0c92-4a40-8a07-ffe735119f3a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 944 time: 0.1381354 Dec 10 14:31:03.903674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:03.973407 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d9516070-cecf-4ede-8aa1-3523eab33e3c None None] Provisioning complete for port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:03.973900 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d9516070-cecf-4ede-8aa1-3523eab33e3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:03.986071 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-603428ac-033d-4889-ba4c-a5b61ea4c780 req-fed888b8-01d4-4803-ba76-d96e97023b4b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1046240 Dec 10 14:31:03.987355 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-f5a20296-d04f-43b8-8d29-0d0744fd9e3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 8a90ebc2-a2fe-409c-ac33-76ba6c30ed7c {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:03.991134 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9822cf1a-ea19-4027-8bfb-263824f77672 req-50e3a9a3-0d69-4082-8138-97bdb6bf35f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:03.998553 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-9822cf1a-ea19-4027-8bfb-263824f77672 req-50e3a9a3-0d69-4082-8138-97bdb6bf35f3 service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3110011 Dec 10 14:31:04.001590 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5a20296-d04f-43b8-8d29-0d0744fd9e3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.117040 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d9516070-cecf-4ede-8aa1-3523eab33e3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.163781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5a20296-d04f-43b8-8d29-0d0744fd9e3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.166769 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d9516070-cecf-4ede-8aa1-3523eab33e3c None None] For port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:04.210964 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-112c3140-d4d5-4e4f-8fa0-f123a47024c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:04.212588 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-112c3140-d4d5-4e4f-8fa0-f123a47024c7 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 1097 time: 0.1390853 Dec 10 14:31:04.227423 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d9516070-cecf-4ede-8aa1-3523eab33e3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.270085 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-84ad98c2-2e6b-45fd-912b-d45400dc5641 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=70717ebc-79f9-48f1-b654-d7a76d6366d3 HTTP/1.1" status: 200 len: 217 time: 0.0489149 Dec 10 14:31:04.297652 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9516070-cecf-4ede-8aa1-3523eab33e3c None None] Pushing event updated for resources: {'Port': ['ID=f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:04.343542 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-5bad179e-a86c-4fdd-9588-b6d9245bb419 None None] Could not find standard attr ID for object b7a29473-1427-4db6-89f9-e129b3657aa5. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:31:04.351075 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5a20296-d04f-43b8-8d29-0d0744fd9e3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.382635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-99506e1e-bc8a-4ce6-948f-39a391da66f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:04.384082 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-99506e1e-bc8a-4ce6-948f-39a391da66f3 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=06dce599-7e77-4ea6-a2ef-4939d220952a HTTP/1.1" status: 200 len: 835 time: 0.0933006 Dec 10 14:31:04.427279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.473914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-79c72819-6d71-4df3-8ae8-1ca18520d65a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:04.475518 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-79c72819-6d71-4df3-8ae8-1ca18520d65a service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=6227fea4-3842-4a83-a78f-a5ec3bccdb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0813890 Dec 10 14:31:04.490604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.547945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5a20296-d04f-43b8-8d29-0d0744fd9e3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.588044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:04.588562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.589937 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/ports/2e863a7f-8fa6-43af-b9c6-f44557a3cabd HTTP/1.1" status: 200 len: 910 time: 1.0556905 Dec 10 14:31:04.590726 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=2e863a7f-8fa6-43af-b9c6-f44557a3cabd,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:04.594233 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58926) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:04.598797 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5a20296-d04f-43b8-8d29-0d0744fd9e3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=8a90ebc2-a2fe-409c-ac33-76ba6c30ed7c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:04.643312 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.643669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.644006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.644337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.644522 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-ca645f19-313e-40c0-9917-4b6cabbbed13 service neutron] 10.222.0.39 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1609981 Dec 10 14:31:04.644718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.645007 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.645335 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.645693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.646034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.646428 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.646760 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.647090 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.647425 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aed00aa6-adfb-41d6-9979-9d7909f3923c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:04.648212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f5a20296-d04f-43b8-8d29-0d0744fd9e3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.652083 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f5a20296-d04f-43b8-8d29-0d0744fd9e3f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/8a90ebc2-a2fe-409c-ac33-76ba6c30ed7c HTTP/1.1" status: 204 len: 168 time: 0.7993817 Dec 10 14:31:04.660245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4beb7d0e-18e9-4b98-9874-fe04246895db None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:04.663303 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58928) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:04.725267 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:04.754628 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9e2c54a9-7730-456b-b4c8-a4367fc1701f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0888803 Dec 10 14:31:04.757208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58930) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:04.762603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:04.818105 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:04.818463 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:04.888290 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-13ae6024-db2d-4b94-9849-3ba818ff2654 req-31107f18-1a54-4ff8-a84d-2d94cf64e33e service neutron] 10.222.0.39 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2347219 Dec 10 14:31:04.950254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c967151-a630-4a21-9713-87865f8cdb4a None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:04.987139 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:04.991604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.003255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7c967151-a630-4a21-9713-87865f8cdb4a None None] Deleting port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:05.003255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7c967151-a630-4a21-9713-87865f8cdb4a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.042626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.082787 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7c967151-a630-4a21-9713-87865f8cdb4a None None] For port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:05.083246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7c967151-a630-4a21-9713-87865f8cdb4a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.097680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-7c967151-a630-4a21-9713-87865f8cdb4a None None] Calling delete_port for f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:05.184930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-76e06860-f374-41ae-9ac5-2c369c0ff967 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.207935 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1deb397-4194-41ce-b078-1e2ea24ab4cc req-1a22350c-996d-47d6-8864-7372bde5425d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:05.209512 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b1deb397-4194-41ce-b078-1e2ea24ab4cc req-1a22350c-996d-47d6-8864-7372bde5425d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 944 time: 0.0816066 Dec 10 14:31:05.301594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7c967151-a630-4a21-9713-87865f8cdb4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.322636 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b1deb397-4194-41ce-b078-1e2ea24ab4cc req-3eb83af1-195c-45d4-bcc6-fe2ca82b7d09 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0771785 Dec 10 14:31:05.330495 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c967151-a630-4a21-9713-87865f8cdb4a None None] Pushing event deleted for resources: {'Port': ['ID=f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:05.332584 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c967151-a630-4a21-9713-87865f8cdb4a None None] No DVR routers for this DVR port f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:05.430376 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port 2e863a7f-8fa6-43af-b9c6-f44557a3cabd {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:05.430754 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.459118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.objects.ports [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103810) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:31:05.465142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.515740 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:05.519202 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:05.524444 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:05.525052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.527844 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.534629 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=4ae0c946-e656-46b3-8e50-e07a5a89f88f,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:05.535551 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f7b13e5-a6f9-4587-a000-5f5748163914 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:05.541953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for 2e863a7f-8fa6-43af-b9c6-f44557a3cabd owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:05.597479 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e806353e-9ef0-4bd3-bf58-e04df9f30e35 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.8388720 Dec 10 14:31:05.599907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58936) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:05.606424 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:6d:f4:cb', 'name': 'tempest-NetworksTestDHCPv6-409349888'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:05.653689 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '4ae0c946-e656-46b3-8e50-e07a5a89f88f'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:05.654708 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.815991 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:05.819518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.856724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=2e863a7f-8fa6-43af-b9c6-f44557a3cabd,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:05.924237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:05.950385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port eb2c4627-4ceb-4bc1-bc86-02cc548051a0 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:31:06.005220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Allocated IP 2001:db8::f816:3eff:fe1b:7a4a (cdc891b5-3e75-4d62-a51b-0f84be9af82d/4ae0c946-e656-46b3-8e50-e07a5a89f88f/72295bec-6b99-46e8-aeef-4884e73a5b84) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:06.023893 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.208200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.212068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router 29bfcc86-c895-4ac7-899f-a63cdcb7f25e has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:06.243069 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.272093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.289481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:06.294417 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9edeb59a-6354-4ff0-874c-0790108b87d0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/29bfcc86-c895-4ac7-899f-a63cdcb7f25e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7004821 Dec 10 14:31:06.297290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58940) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:06.303945 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a5e639-3c9e-4379-a7d6-6d0c6379a62a None None] Sync routers for ids ['29bfcc86-c895-4ac7-899f-a63cdcb7f25e'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:06.322755 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a5e639-3c9e-4379-a7d6-6d0c6379a62a None None] Routers {'29bfcc86-c895-4ac7-899f-a63cdcb7f25e'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:06.323760 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d2a5e639-3c9e-4379-a7d6-6d0c6379a62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['29bfcc86-c895-4ac7-899f-a63cdcb7f25e'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:06.334577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fe6d:f4cb (cdc891b5-3e75-4d62-a51b-0f84be9af82d/4ae0c946-e656-46b3-8e50-e07a5a89f88f/eb2c4627-4ceb-4bc1-bc86-02cc548051a0) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:06.341325 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-18cf8e3c-eb8b-4c95-8b74-8e4d00f169fa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=29bfcc86-c895-4ac7-899f-a63cdcb7f25e HTTP/1.1" status: 200 len: 205 time: 0.0412848 Dec 10 14:31:06.341770 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58942) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:06.352884 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:06.359508 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:06.363032 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:06.413693 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d2a5e639-3c9e-4379-a7d6-6d0c6379a62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:06.435533 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a5e639-3c9e-4379-a7d6-6d0c6379a62a None None] Routers {'29bfcc86-c895-4ac7-899f-a63cdcb7f25e'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:06.436110 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Pushing event updated for resources: {'Port': ['ID=72295bec-6b99-46e8-aeef-4884e73a5b84,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:06.439157 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d2a5e639-3c9e-4379-a7d6-6d0c6379a62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['29bfcc86-c895-4ac7-899f-a63cdcb7f25e'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:06.439318 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-134b8c9b-591b-4e21-93ce-c0a61b43effc tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.522153 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Attempting to bind port 72295bec-6b99-46e8-aeef-4884e73a5b84 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:06.522737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.523254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Attempting to bind port 72295bec-6b99-46e8-aeef-4884e73a5b84 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:06.523623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Attempting to bind port 72295bec-6b99-46e8-aeef-4884e73a5b84 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:06.529610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 30, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:06.530400 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:06.531075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.531829 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:06.532501 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Bound port: 72295bec-6b99-46e8-aeef-4884e73a5b84, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:06.532954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.533135 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d2a5e639-3c9e-4379-a7d6-6d0c6379a62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:06.536388 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a5e639-3c9e-4379-a7d6-6d0c6379a62a None None] The sync data for ids ['29bfcc86-c895-4ac7-899f-a63cdcb7f25e'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:06.639273 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] For port 72295bec-6b99-46e8-aeef-4884e73a5b84, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:06.639651 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.642917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] For port 72295bec-6b99-46e8-aeef-4884e73a5b84, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=72295bec-6b99-46e8-aeef-4884e73a5b84,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:06.679828 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:06.710310 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:06.710655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f4878204-b21d-4cdb-8b1e-6a6f82a0c7a0 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:06.717734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=eb2c4627-4ceb-4bc1-bc86-02cc548051a0,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:06.730255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.732411 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:06.734076 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:06.738447 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:06.745475 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:06.746118 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.809920 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c06f1630-0a0b-4b06-af85-5738b47a6be2 None None] Pushing event updated for resources: {'Port': ['ID=72295bec-6b99-46e8-aeef-4884e73a5b84,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:06.841359 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ae233df4-0237-4ca8-b169-d5456117fed5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.2403104 Dec 10 14:31:06.844786 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58946) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:06.893398 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-134b8c9b-591b-4e21-93ce-c0a61b43effc tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.901953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88618a5-9fb2-4af7-98a7-20c54b76746a req-af8c1674-d4a9-45f1-9e89-4d222a2d9ac9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:06.903434 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f88618a5-9fb2-4af7-98a7-20c54b76746a req-af8c1674-d4a9-45f1-9e89-4d222a2d9ac9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 944 time: 0.1714349 Dec 10 14:31:06.907021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-134b8c9b-591b-4e21-93ce-c0a61b43effc tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:06.910141 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b18f94-3b08-45ee-beb4-576686dc2ae2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:06.916647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b18f94-3b08-45ee-beb4-576686dc2ae2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:06.921409 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f6b18f94-3b08-45ee-beb4-576686dc2ae2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.0730283 Dec 10 14:31:06.924624 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58948) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:06.999845 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f88618a5-9fb2-4af7-98a7-20c54b76746a req-0c4f213d-489a-4ec2-87c5-4c1fda2d10e6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0841117 Dec 10 14:31:07.010930 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-134b8c9b-591b-4e21-93ce-c0a61b43effc tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.011687 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-134b8c9b-591b-4e21-93ce-c0a61b43effc tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Fanout notify agent at l3_agent the message router_deleted on router 29bfcc86-c895-4ac7-899f-a63cdcb7f25e {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:31:07.034095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-134b8c9b-591b-4e21-93ce-c0a61b43effc tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.035693 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-134b8c9b-591b-4e21-93ce-c0a61b43effc tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/29bfcc86-c895-4ac7-899f-a63cdcb7f25e HTTP/1.1" status: 204 len: 168 time: 0.6924572 Dec 10 14:31:07.038398 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58950) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:07.086696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-cba03867-676d-4ac3-8c66-12038deb953d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port eb2c4627-4ceb-4bc1-bc86-02cc548051a0 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:07.087102 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cba03867-676d-4ac3-8c66-12038deb953d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.152793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-38fe4bc9-61c4-49f3-880e-ffc8c2f66b53 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting subnet 47d3c035-cc5c-46f9-b04b-7bedd04839eb {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:07.163992 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38fe4bc9-61c4-49f3-880e-ffc8c2f66b53 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.232018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38fe4bc9-61c4-49f3-880e-ffc8c2f66b53 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.236703 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cba03867-676d-4ac3-8c66-12038deb953d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.271445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-cba03867-676d-4ac3-8c66-12038deb953d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for eb2c4627-4ceb-4bc1-bc86-02cc548051a0 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:07.377082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38fe4bc9-61c4-49f3-880e-ffc8c2f66b53 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.520645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38fe4bc9-61c4-49f3-880e-ffc8c2f66b53 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.550343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cba03867-676d-4ac3-8c66-12038deb953d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.552031 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38fe4bc9-61c4-49f3-880e-ffc8c2f66b53 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Subnet': ['ID=47d3c035-cc5c-46f9-b04b-7bedd04839eb,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:07.561701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-38fe4bc9-61c4-49f3-880e-ffc8c2f66b53 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.567344 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-38fe4bc9-61c4-49f3-880e-ffc8c2f66b53 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/47d3c035-cc5c-46f9-b04b-7bedd04839eb HTTP/1.1" status: 204 len: 168 time: 0.5255826 Dec 10 14:31:07.567612 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-368ed2c0-31f2-4708-9476-0330734917fe None None] Network b5aecaaf-096f-4fbf-9712-7c43f5e14bdc requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:07.569196 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58954) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:07.587142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba03867-676d-4ac3-8c66-12038deb953d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=eb2c4627-4ceb-4bc1-bc86-02cc548051a0,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:07.622814 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cba03867-676d-4ac3-8c66-12038deb953d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.628309 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.632391 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cba03867-676d-4ac3-8c66-12038deb953d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/eb2c4627-4ceb-4bc1-bc86-02cc548051a0 HTTP/1.1" status: 204 len: 168 time: 0.7085762 Dec 10 14:31:07.634516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58956) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:07.722529 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.731842 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25d72d3b-77fb-4d80-8fb4-591f9209ad4e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:07.733640 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25d72d3b-77fb-4d80-8fb4-591f9209ad4e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:07.739687 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-25d72d3b-77fb-4d80-8fb4-591f9209ad4e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1021829 Dec 10 14:31:07.743031 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58958) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:07.778323 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7a33841-74b7-49b7-bcd4-61a1e6248929 None None] DHCP port deletion for b5aecaaf-096f-4fbf-9712-7c43f5e14bdc request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:07.817671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 70717ebc-79f9-48f1-b654-d7a76d6366d3 details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:31:07.853798 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-006f3c99-1bae-43f4-a8c3-abf7b0ac035d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 4ae0c946-e656-46b3-8e50-e07a5a89f88f {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:07.859179 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-006f3c99-1bae-43f4-a8c3-abf7b0ac035d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.896391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port c6d66425-4836-48bd-9f70-e26911e8d4df {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:07.896391 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.904317 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f7a33841-74b7-49b7-bcd4-61a1e6248929 None None] Deleting port c6d66425-4836-48bd-9f70-e26911e8d4df {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:07.904773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7a33841-74b7-49b7-bcd4-61a1e6248929 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.982115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port c6d66425-4836-48bd-9f70-e26911e8d4df, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c6d66425-4836-48bd-9f70-e26911e8d4df,segment=NetworkSegment(6a9ccf95-aa89-48bf-90b6-4a5066fc3547),segment_id=6a9ccf95-aa89-48bf-90b6-4a5066fc3547)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:07.982417 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:07.991622 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f7a33841-74b7-49b7-bcd4-61a1e6248929 None None] For port c6d66425-4836-48bd-9f70-e26911e8d4df, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=c6d66425-4836-48bd-9f70-e26911e8d4df,segment=NetworkSegment(6a9ccf95-aa89-48bf-90b6-4a5066fc3547),segment_id=6a9ccf95-aa89-48bf-90b6-4a5066fc3547)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:07.992121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7a33841-74b7-49b7-bcd4-61a1e6248929 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.000029 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-006f3c99-1bae-43f4-a8c3-abf7b0ac035d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.017142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f7a33841-74b7-49b7-bcd4-61a1e6248929 None None] Calling delete_port for c6d66425-4836-48bd-9f70-e26911e8d4df owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:08.026195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for c6d66425-4836-48bd-9f70-e26911e8d4df owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:08.034705 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 70717ebc-79f9-48f1-b654-d7a76d6366d3, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=70717ebc-79f9-48f1-b654-d7a76d6366d3,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:08.066704 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'port_id': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'mac_address': 'fa:16:3e:56:68:9b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:31:08.179010 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.202930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-84715bf1-feb4-4132-8741-5caf3fac1541 None None] Provisioning complete for port 72295bec-6b99-46e8-aeef-4884e73a5b84 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:08.204147 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-84715bf1-feb4-4132-8741-5caf3fac1541 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.223181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d4263d8-fa2d-4395-9f2c-161eb4bf3097 req-9f93954f-61aa-407b-a721-204a44c80f1f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:08.224857 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7d4263d8-fa2d-4395-9f2c-161eb4bf3097 req-9f93954f-61aa-407b-a721-204a44c80f1f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 944 time: 0.1099551 Dec 10 14:31:08.227934 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 70717ebc-79f9-48f1-b654-d7a76d6366d3 {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:31:08.242860 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-006f3c99-1bae-43f4-a8c3-abf7b0ac035d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.257849 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 70717ebc-79f9-48f1-b654-d7a76d6366d3, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=70717ebc-79f9-48f1-b654-d7a76d6366d3,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:08.328202 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7d4263d8-fa2d-4395-9f2c-161eb4bf3097 req-f6c4afaf-988c-42ff-90ba-861783b7d497 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0939536 Dec 10 14:31:08.334384 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7a33841-74b7-49b7-bcd4-61a1e6248929 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.336842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.350728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-84715bf1-feb4-4132-8741-5caf3fac1541 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.365280 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=c6d66425-4836-48bd-9f70-e26911e8d4df,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:08.378077 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.380128 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7a33841-74b7-49b7-bcd4-61a1e6248929 None None] No DVR routers for this DVR port c6d66425-4836-48bd-9f70-e26911e8d4df on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:08.380871 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No DVR routers for this DVR port c6d66425-4836-48bd-9f70-e26911e8d4df on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:08.383776 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a33841-74b7-49b7-bcd4-61a1e6248929 None None] Pushing event deleted for resources: {'Port': ['ID=c6d66425-4836-48bd-9f70-e26911e8d4df,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:08.472748 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-006f3c99-1bae-43f4-a8c3-abf7b0ac035d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.504965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-84715bf1-feb4-4132-8741-5caf3fac1541 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:31:08.504965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-84715bf1-feb4-4132-8741-5caf3fac1541 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:31:08.504965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=70717ebc-79f9-48f1-b654-d7a76d6366d3,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:08.521654 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.530824 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-006f3c99-1bae-43f4-a8c3-abf7b0ac035d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=4ae0c946-e656-46b3-8e50-e07a5a89f88f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:08.535119 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-006f3c99-1bae-43f4-a8c3-abf7b0ac035d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.541106 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58964) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:08.541248 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-006f3c99-1bae-43f4-a8c3-abf7b0ac035d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/4ae0c946-e656-46b3-8e50-e07a5a89f88f HTTP/1.1" status: 204 len: 168 time: 0.7970450 Dec 10 14:31:08.554161 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b5aecaaf-096f-4fbf-9712-7c43f5e14bdc']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:08.565702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6a9ccf95-aa89-48bf-90b6-4a5066fc3547') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:08.566358 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6a9ccf95-aa89-48bf-90b6-4a5066fc3547') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:08.580502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.596094 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['70717ebc-79f9-48f1-b654-d7a76d6366d3'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:31:08.596577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.597979 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-edb09d98-e5dc-48e7-9abd-cb8ed4bc74ff tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0547831 Dec 10 14:31:08.600171 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58966) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:08.619770 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Releasing vlan 364 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:31:08.620195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:31:08.624515 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:31:08.667211 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac259f2f-760a-48e4-a821-b046633c6aa7 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:08.692988 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d169698-0fc4-463a-944c-a561c3fac2e6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:08.696673 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0d169698-0fc4-463a-944c-a561c3fac2e6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0933547 Dec 10 14:31:08.698631 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58968) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:08.752038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 72295bec-6b99-46e8-aeef-4884e73a5b84 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:08.768967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75ce9cd1-f8c7-46fc-9037-e9c39cf1f768 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:08.770816 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-75ce9cd1-f8c7-46fc-9037-e9c39cf1f768 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0701287 Dec 10 14:31:08.773329 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58970) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:08.793202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.804342 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.808608 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/networks/b5aecaaf-096f-4fbf-9712-7c43f5e14bdc HTTP/1.1" status: 204 len: 168 time: 1.2381487 Dec 10 14:31:08.818927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58972) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:08.821117 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8e1924f3-920d-4e02-8a9e-8eab5941f524 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0466776 Dec 10 14:31:08.825555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-498ee6c6-7281-461f-9be5-6039b3c6b9b6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-922062126', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:08.829234 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58974) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:08.829234 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19d1775-7f42-450c-a70b-ae10d19e4602 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Network': ['ID=b5aecaaf-096f-4fbf-9712-7c43f5e14bdc,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:08.835627 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'slaac'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:08.946427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-498ee6c6-7281-461f-9be5-6039b3c6b9b6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:08.947750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-498ee6c6-7281-461f-9be5-6039b3c6b9b6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.008379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-498ee6c6-7281-461f-9be5-6039b3c6b9b6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.010205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.044642 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:09.050942 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.074077 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-498ee6c6-7281-461f-9be5-6039b3c6b9b6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.086295 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-84715bf1-feb4-4132-8741-5caf3fac1541 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.122594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 72295bec-6b99-46e8-aeef-4884e73a5b84 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:09.122984 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.157051 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-498ee6c6-7281-461f-9be5-6039b3c6b9b6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.159063 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-498ee6c6-7281-461f-9be5-6039b3c6b9b6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 698 time: 0.3366523 Dec 10 14:31:09.161764 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58976) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:09.168449 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'network': {'name': 'tempest-RoutersTest-721754873'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:09.196818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-84715bf1-feb4-4132-8741-5caf3fac1541 None None] For port 72295bec-6b99-46e8-aeef-4884e73a5b84, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=72295bec-6b99-46e8-aeef-4884e73a5b84,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:09.200936 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba74e357-1b67-4146-aeed-4df7405f0d8d None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:09.258699 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:09.263134 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.276254 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-84715bf1-feb4-4132-8741-5caf3fac1541 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.426119 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c02a9ffb-e5be-4373-b300-916aba7d4c02 None None] Could not find standard attr ID for object eb2c4627-4ceb-4bc1-bc86-02cc548051a0. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:31:09.446046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84715bf1-feb4-4132-8741-5caf3fac1541 None None] Pushing event updated for resources: {'Port': ['ID=72295bec-6b99-46e8-aeef-4884e73a5b84,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:09.479076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ba74e357-1b67-4146-aeed-4df7405f0d8d None None] Deleting port 72295bec-6b99-46e8-aeef-4884e73a5b84 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:09.479476 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ba74e357-1b67-4146-aeed-4df7405f0d8d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.541909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c6d66425-4836-48bd-9f70-e26911e8d4df no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:09.549164 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:31:09.572771 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: c6d66425-4836-48bd-9f70-e26911e8d4df {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:09.573127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device c6d66425-4836-48bd-9f70-e26911e8d4df not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:09.631836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ba74e357-1b67-4146-aeed-4df7405f0d8d None None] For port 72295bec-6b99-46e8-aeef-4884e73a5b84, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=72295bec-6b99-46e8-aeef-4884e73a5b84,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:09.632580 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ba74e357-1b67-4146-aeed-4df7405f0d8d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.649693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ba74e357-1b67-4146-aeed-4df7405f0d8d None None] Calling delete_port for 72295bec-6b99-46e8-aeef-4884e73a5b84 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:09.681119 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-311131d4-83f4-4412-97db-ff058c46c93f req-5568a44b-f505-49bf-992b-93d10621f1e9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:09.685960 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-311131d4-83f4-4412-97db-ff058c46c93f req-5568a44b-f505-49bf-992b-93d10621f1e9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 945 time: 0.2142155 Dec 10 14:31:09.710020 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] vlan segment allocate from pool success with {'vlan_id': 352, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:31:09.719895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.720240 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added segment 4f31cd72-d151-4e97-990e-ffc32e237a7c of type vlan for network 4c636d8e-3e22-4f05-9af4-2ab71943989a Dec 10 14:31:09.763716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.783846 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-311131d4-83f4-4412-97db-ff058c46c93f req-df5abdf9-4224-4f53-accb-3bb607879204 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0920341 Dec 10 14:31:09.833181 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ba74e357-1b67-4146-aeed-4df7405f0d8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.858398 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba74e357-1b67-4146-aeed-4df7405f0d8d None None] Pushing event deleted for resources: {'Port': ['ID=72295bec-6b99-46e8-aeef-4884e73a5b84,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:09.863905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba74e357-1b67-4146-aeed-4df7405f0d8d None None] No DVR routers for this DVR port 72295bec-6b99-46e8-aeef-4884e73a5b84 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:09.867177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.868765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.ipam_pluggable_backend [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Port 72295bec-6b99-46e8-aeef-4884e73a5b84 was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=103811) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:573}} Dec 10 14:31:09.869152 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.ipam_pluggable_backend [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Reverting IP allocation for 2001:db8::f816:3eff:fe1b:7a4a {{(pid=103811) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:575}} Dec 10 14:31:09.873113 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:09.873756 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.883295 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.ipam_pluggable_backend [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Reverting IP allocation failed for 2001:db8::f816:3eff:fe1b:7a4a {{(pid=103811) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:581}} Dec 10 14:31:09.884875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.941676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:09.946721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:09.950211 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:09.950891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:09.957111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-856128a3-5b44-45fb-a9a6-80af4f9d0e8c None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:09.964717 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=4efc5a0d-e845-438e-bbdd-a8b2bfcc3f27,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:09.964883 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Network': ['ID=4c636d8e-3e22-4f05-9af4-2ab71943989a,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:09.975231 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.975667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.976017 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.976491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.976833 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.977166 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.977518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.977846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.978179 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.978498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.978821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.979144 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:09.979463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:10.005146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 4c636d8e-3e22-4f05-9af4-2ab71943989a details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:31:10.019194 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3569d40f-ee53-488d-838f-4807217323b9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.8561003 Dec 10 14:31:10.022044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58982) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:10.029652 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'subnet': {'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:10.092824 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-378eff7c-861b-4d4a-82a0-f5322de6f6a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 824 time: 1.2632804 Dec 10 14:31:10.093774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58984) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:10.100672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:9a:5b:e1', 'name': 'tempest-NetworksTestDHCPv6-244027038'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:10.126335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '4efc5a0d-e845-438e-bbdd-a8b2bfcc3f27'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:10.128111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.198444 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:10.202115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.272481 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:10.277672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.285526 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Allocated IP 2001:db8::f816:3eff:fe7c:659a (cdc891b5-3e75-4d62-a51b-0f84be9af82d/4efc5a0d-e845-438e-bbdd-a8b2bfcc3f27/921ac103-056a-4dad-baff-6e0957274065) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:10.305771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port 2b50bbf1-32b1-49bd-8448-39c99e248803 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:31:10.457769 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.494549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.517651 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.575670 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:10.578832 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:10.582741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:10.590292 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fe9a:5be1 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/4efc5a0d-e845-438e-bbdd-a8b2bfcc3f27/2b50bbf1-32b1-49bd-8448-39c99e248803) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:10.595273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Subnet': ['ID=38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:10.596911 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Pushing event updated for resources: {'Port': ['ID=921ac103-056a-4dad-baff-6e0957274065,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:10.616979 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Checking segment: {'id': '4f31cd72-d151-4e97-990e-ffc32e237a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:10.617555 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network hostable DHCP agents. Network: 4c636d8e-3e22-4f05-9af4-2ab71943989a, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:31:10.684222 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Attempting to bind port 921ac103-056a-4dad-baff-6e0957274065 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:10.684835 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Attempting to bind port 921ac103-056a-4dad-baff-6e0957274065 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:10.685202 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Attempting to bind port 921ac103-056a-4dad-baff-6e0957274065 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:10.690747 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:10.691419 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:10.691731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.692141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:10.692619 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Bound port: 921ac103-056a-4dad-baff-6e0957274065, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:10.693003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.707212 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 4c636d8e-3e22-4f05-9af4-2ab71943989a is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:31:10.708643 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 72295bec-6b99-46e8-aeef-4884e73a5b84 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:10.749989 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 72295bec-6b99-46e8-aeef-4884e73a5b84 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:10.750353 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 72295bec-6b99-46e8-aeef-4884e73a5b84 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:10.776098 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.778438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] For port 921ac103-056a-4dad-baff-6e0957274065, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:10.782425 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] For port 921ac103-056a-4dad-baff-6e0957274065, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=921ac103-056a-4dad-baff-6e0957274065,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:10.791673 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 4c636d8e-3e22-4f05-9af4-2ab71943989a) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:10.796143 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:10.797404 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.803207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a235259e-66aa-4172-9cbe-bbbadba531ef None None] Network 4c636d8e-3e22-4f05-9af4-2ab71943989a requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:10.869508 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:31:10.880806 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.896251 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.901832 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5bb33e10-5d04-4b0c-95ff-8eb892379f64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8777828 Dec 10 14:31:10.904583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 58990) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:10.964753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:10.968321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:10.970765 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-4c636d8e-3e22-4f05-9af4-2ab71943989a', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:10.971642 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:10.972918 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:10.974402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2740ffac-524b-473a-9588-7752a3bc6ae8 None None] Pushing event updated for resources: {'Port': ['ID=921ac103-056a-4dad-baff-6e0957274065,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:10.976334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7945a500-2838-4ca0-ae84-fbe907a69824 req-6d6b9d72-3ac1-45b6-90ba-ed698c4e6123 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:10.977244 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7945a500-2838-4ca0-ae84-fbe907a69824 req-6d6b9d72-3ac1-45b6-90ba-ed698c4e6123 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 945 time: 0.1186736 Dec 10 14:31:10.986322 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:10.987252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.005765 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=2b50bbf1-32b1-49bd-8448-39c99e248803,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:11.061779 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ee69afb7-3e70-4d3e-b51b-e65cc6ff9f66 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 0.9658580 Dec 10 14:31:11.062695 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58992) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:11.121507 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fce58d3-df0b-4ade-bc25-4aa54769ecda tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:11.128331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fce58d3-df0b-4ade-bc25-4aa54769ecda tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:11.133327 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1fce58d3-df0b-4ade-bc25-4aa54769ecda tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.0694222 Dec 10 14:31:11.134200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58994) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:11.164847 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7945a500-2838-4ca0-ae84-fbe907a69824 req-c84582e4-a8d7-447a-85b6-75a12e066bc8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1400301 Dec 10 14:31:11.204907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Allocated IP 172.20.0.2 (4c636d8e-3e22-4f05-9af4-2ab71943989a/38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d/41cb962f-dc16-46ed-acc5-1f45dea7291f) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:11.289951 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-044fea0c-fb12-4699-911a-cbeb96195f69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 2b50bbf1-32b1-49bd-8448-39c99e248803 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:11.290302 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-044fea0c-fb12-4699-911a-cbeb96195f69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.363239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.431069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-044fea0c-fb12-4699-911a-cbeb96195f69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.445705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-044fea0c-fb12-4699-911a-cbeb96195f69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 2b50bbf1-32b1-49bd-8448-39c99e248803 owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:11.468085 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.570201 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.611879 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Network 4c636d8e-3e22-4f05-9af4-2ab71943989a is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:11.614600 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:11.618760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:11.661980 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Pushing event updated for resources: {'Port': ['ID=41cb962f-dc16-46ed-acc5-1f45dea7291f,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:11.673036 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-044fea0c-fb12-4699-911a-cbeb96195f69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.679468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.20.0.1 (4c636d8e-3e22-4f05-9af4-2ab71943989a/38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d/16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:11.704359 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Attempting to bind port 41cb962f-dc16-46ed-acc5-1f45dea7291f on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:11.704960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Attempting to bind port 41cb962f-dc16-46ed-acc5-1f45dea7291f by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '4f31cd72-d151-4e97-990e-ffc32e237a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:11.705234 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Attempting to bind port 41cb962f-dc16-46ed-acc5-1f45dea7291f on network 4c636d8e-3e22-4f05-9af4-2ab71943989a {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:11.710779 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:11.711171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Checking segment: {'id': '4f31cd72-d151-4e97-990e-ffc32e237a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:11.711630 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.712030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Bound using segment: {'id': '4f31cd72-d151-4e97-990e-ffc32e237a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:11.712502 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Bound port: 41cb962f-dc16-46ed-acc5-1f45dea7291f, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f31cd72-d151-4e97-990e-ffc32e237a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:11.712885 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.735539 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-044fea0c-fb12-4699-911a-cbeb96195f69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.739927 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-044fea0c-fb12-4699-911a-cbeb96195f69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/2b50bbf1-32b1-49bd-8448-39c99e248803 HTTP/1.1" status: 204 len: 168 time: 0.6043487 Dec 10 14:31:11.741057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-044fea0c-fb12-4699-911a-cbeb96195f69 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=2b50bbf1-32b1-49bd-8448-39c99e248803,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:11.743995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 58998) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:11.797914 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] For port 41cb962f-dc16-46ed-acc5-1f45dea7291f, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:11.804939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] For port 41cb962f-dc16-46ed-acc5-1f45dea7291f, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=41cb962f-dc16-46ed-acc5-1f45dea7291f,segment=NetworkSegment(4f31cd72-d151-4e97-990e-ffc32e237a7c),segment_id=4f31cd72-d151-4e97-990e-ffc32e237a7c)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:11.807793 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af1b26ba-0dad-41a5-90a4-ebf9d4709f1a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:11.809486 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af1b26ba-0dad-41a5-90a4-ebf9d4709f1a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:11.814031 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-af1b26ba-0dad-41a5-90a4-ebf9d4709f1a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1454 time: 0.0664535 Dec 10 14:31:11.814599 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59000) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:11.834095 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 70717ebc-79f9-48f1-b654-d7a76d6366d3 up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:11.881534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.919188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-82a1ecf0-90e5-43bf-a13c-0870d5eda3f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 4efc5a0d-e845-438e-bbdd-a8b2bfcc3f27 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:11.926161 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:11.926391 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-82a1ecf0-90e5-43bf-a13c-0870d5eda3f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.033800 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port 70717ebc-79f9-48f1-b654-d7a76d6366d3 completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:31:12.045905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-82a1ecf0-90e5-43bf-a13c-0870d5eda3f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.047662 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port 70717ebc-79f9-48f1-b654-d7a76d6366d3 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:12.048402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.113372 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6ab90b2-ab81-4161-ade3-6f94a7598cce None None] Pushing event updated for resources: {'Port': ['ID=41cb962f-dc16-46ed-acc5-1f45dea7291f,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:12.235756 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.293467 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-82a1ecf0-90e5-43bf-a13c-0870d5eda3f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.296475 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:31:12.302505 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a2571ed-0412-4c4d-808b-15d543762933" -d '{"events": [{"server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "name": "network-vif-plugged", "status": "completed", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:31:12.361961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 70717ebc-79f9-48f1-b654-d7a76d6366d3, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=70717ebc-79f9-48f1-b654-d7a76d6366d3,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:12.421939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.465813 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d649c91-3a82-4e4e-ac7d-009f58207878 req-730b926f-e22d-4fc0-b928-dfd095dd2db4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:12.469786 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9d649c91-3a82-4e4e-ac7d-009f58207878 req-730b926f-e22d-4fc0-b928-dfd095dd2db4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 945 time: 0.0761104 Dec 10 14:31:12.473541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-82a1ecf0-90e5-43bf-a13c-0870d5eda3f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.514004 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.514258 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-82a1ecf0-90e5-43bf-a13c-0870d5eda3f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.518840 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-82a1ecf0-90e5-43bf-a13c-0870d5eda3f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/4efc5a0d-e845-438e-bbdd-a8b2bfcc3f27 HTTP/1.1" status: 204 len: 168 time: 0.7032533 Dec 10 14:31:12.529149 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59008) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:12.530353 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=70717ebc-79f9-48f1-b654-d7a76d6366d3,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:12.543717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:31:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa9f887e-c121-4299-807f-dbaa8ab6a990 x-openstack-request-id: req-aa9f887e-c121-4299-807f-dbaa8ab6a990 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:31:12.545593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "name": "network-vif-plugged", "status": "completed", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:31:12.545953 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-aa9f887e-c121-4299-807f-dbaa8ab6a990 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:31:12.546467 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'code': 200} Dec 10 14:31:12.605192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82a1ecf0-90e5-43bf-a13c-0870d5eda3f2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=4efc5a0d-e845-438e-bbdd-a8b2bfcc3f27,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:12.631435 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-baada698-ec6d-4558-8689-aae054fc5483 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0894320 Dec 10 14:31:12.634319 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59010) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:12.642070 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:12.776805 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-131c6dfa-0567-4fab-94e5-67844fed582a None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:12.790805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 4c636d8e-3e22-4f05-9af4-2ab71943989a is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:12.806133 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:12.814705 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:12.845925 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:12.887098 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9d649c91-3a82-4e4e-ac7d-009f58207878 req-c073b7a1-5e46-4ba3-8b73-2b37ea84dac4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4028857 Dec 10 14:31:12.906597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.934032 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 41cb962f-dc16-46ed-acc5-1f45dea7291f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:12.976422 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:12.978156 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c2165183-d270-4280-a678-f82a7096e56d None None] Provisioning complete for port 921ac103-056a-4dad-baff-6e0957274065 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:12.978545 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c2165183-d270-4280-a678-f82a7096e56d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:12.980867 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.070199 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9206a3-3751-47f9-8792-1f77964fbf1b req-ef6c48d3-ef22-418c-8b9e-fef9d52700fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:13.071776 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4c9206a3-3751-47f9-8792-1f77964fbf1b req-ef6c48d3-ef22-418c-8b9e-fef9d52700fe service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 1099 time: 0.1756737 Dec 10 14:31:13.091467 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 41cb962f-dc16-46ed-acc5-1f45dea7291f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:13.091467 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.118637 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c2165183-d270-4280-a678-f82a7096e56d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.135336 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8ae1f89-8cfa-4a05-9efa-503ea4157913 None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:13.148499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.157331 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-4c9206a3-3751-47f9-8792-1f77964fbf1b req-d3dd02bd-c155-4512-b260-7abb21480e5a service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0771823 Dec 10 14:31:13.407608 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c2165183-d270-4280-a678-f82a7096e56d None None] For port 921ac103-056a-4dad-baff-6e0957274065, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=921ac103-056a-4dad-baff-6e0957274065,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:13.448947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.492261 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 41cb962f-dc16-46ed-acc5-1f45dea7291f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=41cb962f-dc16-46ed-acc5-1f45dea7291f,segment=NetworkSegment(4f31cd72-d151-4e97-990e-ffc32e237a7c),segment_id=4f31cd72-d151-4e97-990e-ffc32e237a7c)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:13.496763 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c2165183-d270-4280-a678-f82a7096e56d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.532114 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b8ae1f89-8cfa-4a05-9efa-503ea4157913 None None] Deleting port 921ac103-056a-4dad-baff-6e0957274065 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:13.532649 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b8ae1f89-8cfa-4a05-9efa-503ea4157913 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.564842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.576514 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.objects.ports [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103810) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:31:13.601230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.602386 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 921ac103-056a-4dad-baff-6e0957274065 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:13.621727 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.651005 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2165183-d270-4280-a678-f82a7096e56d None None] Pushing event updated for resources: {'Port': ['ID=921ac103-056a-4dad-baff-6e0957274065,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:13.717312 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7650b55b-8197-4c5d-938f-17059cebcf79 None None] Network 4c636d8e-3e22-4f05-9af4-2ab71943989a requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:13.749409 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.752163 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:13.792803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b8ae1f89-8cfa-4a05-9efa-503ea4157913 None None] For port 921ac103-056a-4dad-baff-6e0957274065, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=921ac103-056a-4dad-baff-6e0957274065,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:13.793461 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b8ae1f89-8cfa-4a05-9efa-503ea4157913 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.802893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=41cb962f-dc16-46ed-acc5-1f45dea7291f,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:13.822312 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b8ae1f89-8cfa-4a05-9efa-503ea4157913 None None] Calling delete_port for 921ac103-056a-4dad-baff-6e0957274065 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:13.854165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 921ac103-056a-4dad-baff-6e0957274065 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:13.854541 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.862405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:13.869923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 4c636d8e-3e22-4f05-9af4-2ab71943989a is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:13.871499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:13.936024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-aa4cf246-da88-4d37-bffd-6c5d15937a60 None None] Provisioning complete for port 41cb962f-dc16-46ed-acc5-1f45dea7291f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:13.936398 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-aa4cf246-da88-4d37-bffd-6c5d15937a60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.079972 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97492ba5-baef-4706-8628-01c86ce46d20 req-a6057c56-6407-4255-872d-4e960dac6a7a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:14.085132 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97492ba5-baef-4706-8628-01c86ce46d20 req-a6057c56-6407-4255-872d-4e960dac6a7a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 946 time: 0.0877862 Dec 10 14:31:14.146542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] For port 921ac103-056a-4dad-baff-6e0957274065, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=921ac103-056a-4dad-baff-6e0957274065,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:14.165406 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97492ba5-baef-4706-8628-01c86ce46d20 req-112556b4-433b-4848-85ea-3c6a2432c1fc tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0729499 Dec 10 14:31:14.204775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:31:14.221610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.277643 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.277643 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.315358 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:14.326583 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:14.331982 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6fcee5cf-02f4-4e83-a129-85c0facde65c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4266927 Dec 10 14:31:14.334666 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59018) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:14.341266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:14.342129 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:14.346216 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b8ae1f89-8cfa-4a05-9efa-503ea4157913 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.352572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'network': {'name': 'tempest-RoutersTest-1136745129'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:14.360615 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:14.364650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:14.367783 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:14.368392 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.408844 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=03d2b436-cf6c-409b-a7fc-6483f1285ff0,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:14.412455 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=921ac103-056a-4dad-baff-6e0957274065,revision_number=6']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:14.464539 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8ae1f89-8cfa-4a05-9efa-503ea4157913 None None] Pushing event deleted for resources: {'Port': ['ID=921ac103-056a-4dad-baff-6e0957274065,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:14.467738 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:14.470056 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8ae1f89-8cfa-4a05-9efa-503ea4157913 None None] No DVR routers for this DVR port 921ac103-056a-4dad-baff-6e0957274065 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:14.473808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.497566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1148194-d418-4913-a55e-cde2c0d7a33f None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:14.503881 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f0b55a4d-e444-4371-a801-918d029d22e7 None None] Provisioning complete for port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:14.504261 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0b55a4d-e444-4371-a801-918d029d22e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.515204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] vlan segment allocate from pool success with {'vlan_id': 398, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:31:14.528901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.529323 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added segment c5ef3d30-2c43-48b0-94dc-aa33c15b3435 of type vlan for network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb Dec 10 14:31:14.544767 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:14.567237 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-58505811-1640-4c10-ad64-109036255920 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 1.9315283 Dec 10 14:31:14.577481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.578979 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59020) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:14.584166 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:9b:01:73', 'name': 'tempest-NetworksTestDHCPv6-1312056759'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:14.636960 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f0b55a4d-e444-4371-a801-918d029d22e7 None None] Port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:14.690301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.702548 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:14.706163 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.750488 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f0b55a4d-e444-4371-a801-918d029d22e7 None None] Provisioning complete for port 41cb962f-dc16-46ed-acc5-1f45dea7291f triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:14.750952 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0b55a4d-e444-4371-a801-918d029d22e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.765846 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 41cb962f-dc16-46ed-acc5-1f45dea7291f up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:14.828990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Network': ['ID=6ca4d5d6-7b36-4002-97c2-7e235cdda7bb,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:14.856607 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:31:14.858709 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '03d2b436-cf6c-409b-a7fc-6483f1285ff0'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:14.860171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:14.871403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:14.933780 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-926ef3dd-e4e9-4ae0-9c68-10dcfdcba6a6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.5953999 Dec 10 14:31:14.935124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59024) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:14.941511 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'subnet': {'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:15.022600 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.048071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port e958ee16-eed1-4b00-aa2b-744bf60e902b yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:31:15.121068 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 41cb962f-dc16-46ed-acc5-1f45dea7291f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:15.121469 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.140100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:15.143731 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.180214 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fe9b:173 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/03d2b436-cf6c-409b-a7fc-6483f1285ff0/e958ee16-eed1-4b00-aa2b-744bf60e902b) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:15.201808 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:13Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:13Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:15.253146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:15.253822 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Updating router dd925215-16e0-45b2-afbb-d31a45079594 port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:31:15.310373 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.326525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-03b196b5-6346-45c4-abe1-220d64622c99 None None] Provisioning complete for port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:15.327604 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-03b196b5-6346-45c4-abe1-220d64622c99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.393919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-914e0deb-fabb-40c7-aa3e-34259b31aec2 req-49520e37-0d1c-4048-b859-f9d048153652 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:15.395463 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-914e0deb-fabb-40c7-aa3e-34259b31aec2 req-49520e37-0d1c-4048-b859-f9d048153652 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 946 time: 0.0916588 Dec 10 14:31:15.405545 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.429501 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 921ac103-056a-4dad-baff-6e0957274065 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:15.464931 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-914e0deb-fabb-40c7-aa3e-34259b31aec2 req-72fe0d8b-bd14-4c84-9cae-e4a78d793c01 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0551922 Dec 10 14:31:15.507984 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.519190 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.574635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:15.578867 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:15.582836 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:15.588929 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:15.589936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.609390 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=e958ee16-eed1-4b00-aa2b-744bf60e902b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:15.623122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 921ac103-056a-4dad-baff-6e0957274065 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:15.623470 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 921ac103-056a-4dad-baff-6e0957274065 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:15.649060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-03b196b5-6346-45c4-abe1-220d64622c99 None None] Port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:15.662457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Subnet': ['ID=fe3af855-3e1f-467b-9262-60423a9eaedc,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:15.666085 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Checking segment: {'id': 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:15.666454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network hostable DHCP agents. Network: 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:31:15.682293 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a149798b-7a5c-4e99-a201-21917922544c req-b28af0e0-5450-438d-b241-e7833da3d176 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:15.683825 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a149798b-7a5c-4e99-a201-21917922544c req-b28af0e0-5450-438d-b241-e7833da3d176 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 946 time: 0.1143136 Dec 10 14:31:15.704748 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f08990ee-bc32-49ad-bf6b-fe777bf3d851 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.1245606 Dec 10 14:31:15.708035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59030) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:15.737284 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Allocated IP 2001:db8::f816:3eff:fee4:367a (cdc891b5-3e75-4d62-a51b-0f84be9af82d/03d2b436-cf6c-409b-a7fc-6483f1285ff0/5b0a5783-7493-419b-99e0-9b8a40c88bd5) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:15.762898 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a149798b-7a5c-4e99-a201-21917922544c req-c33a6790-87a1-4f69-8d54-fe4533fbe0ff tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0717931 Dec 10 14:31:15.774374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a604fa2-7ace-4620-aeb1-e79292ea0f0d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:15.776195 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2a604fa2-7ace-4620-aeb1-e79292ea0f0d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 945 time: 0.0656090 Dec 10 14:31:15.778908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59032) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:15.790331 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:31:15.798338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59034) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:15.866873 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ca12568-3b42-4a21-b08f-8795ad553a10 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:15.871817 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7ca12568-3b42-4a21-b08f-8795ad553a10 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 1094 time: 0.0723770 Dec 10 14:31:15.872463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59036) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:15.877656 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address': '172.20.0.10'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:15.883263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-d25a6d67-d936-41f4-b04b-8fa33625520e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port e958ee16-eed1-4b00-aa2b-744bf60e902b {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:15.883683 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d25a6d67-d936-41f4-b04b-8fa33625520e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.902254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:15.908991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:15.909169 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:15.918404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7ada301-184b-4686-9564-b4d1f31d804c None None] Network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:15.974811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.019069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d25a6d67-d936-41f4-b04b-8fa33625520e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.034862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-d25a6d67-d936-41f4-b04b-8fa33625520e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for e958ee16-eed1-4b00-aa2b-744bf60e902b owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:16.097383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.098384 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a7aea843-652e-41bd-893b-ef945bc8bdad tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1617599 Dec 10 14:31:16.098540 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.101114 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59040) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:16.128502 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.170333 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:16.173255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.199219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.233404 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.248415 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:16.253882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:16.258660 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:16.274343 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Pushing event updated for resources: {'Port': ['ID=5b0a5783-7493-419b-99e0-9b8a40c88bd5,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:16.398792 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a381c4-ab10-4b37-8dea-1f4ab8b5e3e8 None None] Pushing event updated for resources: {'Port': ['ID=16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:16.403593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Attempting to bind port 5b0a5783-7493-419b-99e0-9b8a40c88bd5 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:16.404255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Attempting to bind port 5b0a5783-7493-419b-99e0-9b8a40c88bd5 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:16.404678 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Attempting to bind port 5b0a5783-7493-419b-99e0-9b8a40c88bd5 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:16.411328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Attempting to bind port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:16.411708 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Attempting to bind port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '4f31cd72-d151-4e97-990e-ffc32e237a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:16.412073 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Attempting to bind port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 on network 4c636d8e-3e22-4f05-9af4-2ab71943989a {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:16.414394 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:16.414773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:16.415185 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.415575 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:16.416053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Bound port: 5b0a5783-7493-419b-99e0-9b8a40c88bd5, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:16.416440 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.432220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:16.432893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Checking segment: {'id': '4f31cd72-d151-4e97-990e-ffc32e237a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:16.433012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.433390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Bound using segment: {'id': '4f31cd72-d151-4e97-990e-ffc32e237a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:16.433883 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Bound port: 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f31cd72-d151-4e97-990e-ffc32e237a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 352, 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:16.434294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.501314 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.535226 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] For port 5b0a5783-7493-419b-99e0-9b8a40c88bd5, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:16.539473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] For port 5b0a5783-7493-419b-99e0-9b8a40c88bd5, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5b0a5783-7493-419b-99e0-9b8a40c88bd5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:16.543286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] For port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:16.546211 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] For port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3,segment=NetworkSegment(4f31cd72-d151-4e97-990e-ffc32e237a7c),segment_id=4f31cd72-d151-4e97-990e-ffc32e237a7c)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:16.577761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-da4146d5-832d-46af-bd93-25f39154c2d0 None None] Provisioning complete for port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:16.578234 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-da4146d5-832d-46af-bd93-25f39154c2d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.613098 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-da4146d5-832d-46af-bd93-25f39154c2d0 None None] Port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:16.707346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d25a6d67-d936-41f4-b04b-8fa33625520e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.751095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d25a6d67-d936-41f4-b04b-8fa33625520e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=e958ee16-eed1-4b00-aa2b-744bf60e902b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:16.777721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d25a6d67-d936-41f4-b04b-8fa33625520e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.781860 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d25a6d67-d936-41f4-b04b-8fa33625520e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/e958ee16-eed1-4b00-aa2b-744bf60e902b HTTP/1.1" status: 204 len: 168 time: 1.0011551 Dec 10 14:31:16.785096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59042) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:16.839207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Allocated IP 172.21.0.2 (6ca4d5d6-7b36-4002-97c2-7e235cdda7bb/fe3af855-3e1f-467b-9262-60423a9eaedc/e51caa04-e910-4600-b070-6e1ec445d80a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:16.845973 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2921e286-2da4-45d4-81d5-876ad1aa449c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:16.847632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2921e286-2da4-45d4-81d5-876ad1aa449c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:16.851542 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2921e286-2da4-45d4-81d5-876ad1aa449c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1465 time: 0.0629661 Dec 10 14:31:16.852651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59044) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:16.908054 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.26.2.252 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/51f5cb26-c855-4e4d-ba72-420baf876e75) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:16.927686 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-6d8b9af4-0f62-4a4a-9f8c-738ad2d879f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 03d2b436-cf6c-409b-a7fc-6483f1285ff0 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:16.930932 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d8b9af4-0f62-4a4a-9f8c-738ad2d879f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:16.996563 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d8b9af4-0f62-4a4a-9f8c-738ad2d879f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.016531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.040404 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.330830 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.340144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d8b9af4-0f62-4a4a-9f8c-738ad2d879f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.376716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.380398 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.390044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.424754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc601537-df01-4db9-af6a-1c1ba20cf678 None None] Pushing event updated for resources: {'Port': ['ID=5b0a5783-7493-419b-99e0-9b8a40c88bd5,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:17.435619 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:17.438716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:17.439356 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:17.497361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:17.518314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d8b9af4-0f62-4a4a-9f8c-738ad2d879f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.546094 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6d8b9af4-0f62-4a4a-9f8c-738ad2d879f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.551170 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:17.554319 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.21.0.1 (6ca4d5d6-7b36-4002-97c2-7e235cdda7bb/fe3af855-3e1f-467b-9262-60423a9eaedc/8b1692f7-7d73-4252-a67c-da171444a8b3) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:17.555898 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6d8b9af4-0f62-4a4a-9f8c-738ad2d879f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/03d2b436-cf6c-409b-a7fc-6483f1285ff0 HTTP/1.1" status: 204 len: 168 time: 0.7027049 Dec 10 14:31:17.615558 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59056) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:17.629095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d8b9af4-0f62-4a4a-9f8c-738ad2d879f7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=03d2b436-cf6c-409b-a7fc-6483f1285ff0,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:17.681628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Pushing event updated for resources: {'Port': ['ID=e51caa04-e910-4600-b070-6e1ec445d80a,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:17.745067 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:17.760893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:17.778615 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:17.783261 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d1d95817-c761-414d-a7fb-9fc83042cb0f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1636863 Dec 10 14:31:17.783822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=51f5cb26-c855-4e4d-ba72-420baf876e75,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:17.784037 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59058) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:17.790261 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.804395 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:17.857464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Attempting to bind port e51caa04-e910-4600-b070-6e1ec445d80a on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:17.857464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Attempting to bind port e51caa04-e910-4600-b070-6e1ec445d80a by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:17.857913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Attempting to bind port e51caa04-e910-4600-b070-6e1ec445d80a on network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:17.870637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ee777f9-9d14-45ef-be85-28839639028c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:17.871806 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:17.872127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Checking segment: {'id': 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:17.872536 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.872986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Bound using segment: {'id': 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:17.875946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Bound port: e51caa04-e910-4600-b070-6e1ec445d80a, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:17.875946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:17.876706 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4ee777f9-9d14-45ef-be85-28839639028c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0916317 Dec 10 14:31:17.877534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59060) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:17.958638 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3927aac9-de86-41ba-9f05-7de55c530e08 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:17.968170 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3927aac9-de86-41ba-9f05-7de55c530e08 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0894001 Dec 10 14:31:17.971334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59062) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:18.017932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:18.024638 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a381c4-ab10-4b37-8dea-1f4ab8b5e3e8 None None] Pushing event updated for resources: {'Port': ['ID=16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:18.034407 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] For port e51caa04-e910-4600-b070-6e1ec445d80a, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:18.043521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-13b3c087-f9ce-4cac-8f60-0a930ff95cb9 None None] Provisioning complete for port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:18.043521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-13b3c087-f9ce-4cac-8f60-0a930ff95cb9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:18.043775 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ba1532d8-9dc6-49f1-ba74-c6e90d316421 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0679157 Dec 10 14:31:18.047337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59064) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:18.052804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:18.079745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] For port e51caa04-e910-4600-b070-6e1ec445d80a, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e51caa04-e910-4600-b070-6e1ec445d80a,segment=NetworkSegment(c5ef3d30-2c43-48b0-94dc-aa33c15b3435),segment_id=c5ef3d30-2c43-48b0-94dc-aa33c15b3435)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:18.084444 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:18.094329 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:18.100718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:18.165657 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=8b1692f7-7d73-4252-a67c-da171444a8b3,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:18.172502 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:18.202789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:18.289719 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:18.293348 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:18.316224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-13b3c087-f9ce-4cac-8f60-0a930ff95cb9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:18.592180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Pushing event updated for resources: {'Port': ['ID=e51caa04-e910-4600-b070-6e1ec445d80a,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:18.615087 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.615446 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.621030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1562f1dd-809f-4d8b-a008-84feb41a1333 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:18.655259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-13b3c087-f9ce-4cac-8f60-0a930ff95cb9 None None] For port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3,segment=NetworkSegment(4f31cd72-d151-4e97-990e-ffc32e237a7c),segment_id=4f31cd72-d151-4e97-990e-ffc32e237a7c)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:18.683528 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:13Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:16Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:18.759953 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-255f956a-f61a-4019-9aa6-5ab6b09d556c None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:13Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:16Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:18.763063 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-13b3c087-f9ce-4cac-8f60-0a930ff95cb9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:18.873330 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:18.898693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5b0a5783-7493-419b-99e0-9b8a40c88bd5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:18.944344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:18.953485 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:18.961294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13b3c087-f9ce-4cac-8f60-0a930ff95cb9 None None] Pushing event updated for resources: {'Port': ['ID=16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:18.986679 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=12abe0f7-269a-43bb-b17c-2229d58e220c,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:18.989728 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:18.990533 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:18.998927 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 5b0a5783-7493-419b-99e0-9b8a40c88bd5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:18.999322 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:19.090135 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-31f7576c-1f7f-4df9-ada9-f386f6d3883f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0415194 Dec 10 14:31:19.091038 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59076) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:19.103307 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:ef:e9:e0', 'name': 'tempest-NetworksTestDHCPv6-1811128417'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:19.136445 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:19.185127 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c15b170f-cb65-4235-9f6e-889f5b206ba6 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:19.216497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 5b0a5783-7493-419b-99e0-9b8a40c88bd5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5b0a5783-7493-419b-99e0-9b8a40c88bd5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:19.294079 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:19.302262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-e549903f-edb5-4a31-8b3d-36aec16a58cb None None] Provisioning complete for port 5b0a5783-7493-419b-99e0-9b8a40c88bd5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:19.302750 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-e549903f-edb5-4a31-8b3d-36aec16a58cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:19.413197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=5b0a5783-7493-419b-99e0-9b8a40c88bd5,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:19.432669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:19.443490 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:19.610838 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:19.644821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port 568e9d99-040f-47f0-a44d-8cfc6266e033 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:31:19.652259 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:19.801515 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:19.864669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::186 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/12abe0f7-269a-43bb-b17c-2229d58e220c/568e9d99-040f-47f0-a44d-8cfc6266e033) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:19.970608 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57e90a87-91c2-42f1-9393-4cbe8ee9131a None None] Network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:20.110096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.119569 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-995c4d9e-7863-4dec-b31f-3b219ea12e85 None None] Provisioning complete for port 5b0a5783-7493-419b-99e0-9b8a40c88bd5 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:20.119954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-995c4d9e-7863-4dec-b31f-3b219ea12e85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.146045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.239877 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.261984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.264410 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-995c4d9e-7863-4dec-b31f-3b219ea12e85 None None] Provisioning complete for port e51caa04-e910-4600-b070-6e1ec445d80a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:20.274070 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-995c4d9e-7863-4dec-b31f-3b219ea12e85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.324806 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.382802 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.417024 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:20.420246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-995c4d9e-7863-4dec-b31f-3b219ea12e85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.432641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:20.441990 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:20.456742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:20.465172 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.475200 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=51f5cb26-c855-4e4d-ba72-420baf876e75,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:20.489224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-995c4d9e-7863-4dec-b31f-3b219ea12e85 None None] For port e51caa04-e910-4600-b070-6e1ec445d80a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e51caa04-e910-4600-b070-6e1ec445d80a,segment=NetworkSegment(c5ef3d30-2c43-48b0-94dc-aa33c15b3435),segment_id=c5ef3d30-2c43-48b0-94dc-aa33c15b3435)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:20.504669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=568e9d99-040f-47f0-a44d-8cfc6266e033,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:20.554040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.556128 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.564659 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-995c4d9e-7863-4dec-b31f-3b219ea12e85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.620294 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-426c8500-c088-45d5-b074-46e2c4ff71d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 1.5257511 Dec 10 14:31:20.620558 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59082) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:20.645144 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=8b1692f7-7d73-4252-a67c-da171444a8b3,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:20.736464 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2169ba6-300b-4a02-b25c-0eab2c9983d3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:20.751053 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2169ba6-300b-4a02-b25c-0eab2c9983d3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:20.755491 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b2169ba6-300b-4a02-b25c-0eab2c9983d3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1592 time: 0.1316252 Dec 10 14:31:20.755970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59084) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:20.759207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-995c4d9e-7863-4dec-b31f-3b219ea12e85 None None] Pushing event updated for resources: {'Port': ['ID=e51caa04-e910-4600-b070-6e1ec445d80a,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:20.780801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f85b8a29-1eed-4c48-b652-8d8359ef417a None None] Provisioning complete for port e51caa04-e910-4600-b070-6e1ec445d80a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:20.781858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f85b8a29-1eed-4c48-b652-8d8359ef417a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:20.966303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f85b8a29-1eed-4c48-b652-8d8359ef417a None None] Provisioning complete for port 8b1692f7-7d73-4252-a67c-da171444a8b3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:20.966854 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f85b8a29-1eed-4c48-b652-8d8359ef417a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.003174 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-786c6efb-f3b2-4fe2-9560-713fa306702b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 568e9d99-040f-47f0-a44d-8cfc6266e033 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:21.003514 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-786c6efb-f3b2-4fe2-9560-713fa306702b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.035039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f85b8a29-1eed-4c48-b652-8d8359ef417a None None] Port 8b1692f7-7d73-4252-a67c-da171444a8b3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:21.037307 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Floating IP bec1b40f-2e80-44c7-a266-a325b8e10dc0 associated. External IP: 172.26.2.252, port: 70717ebc-79f9-48f1-b654-d7a76d6366d3. Dec 10 14:31:21.046716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f85b8a29-1eed-4c48-b652-8d8359ef417a None None] Could not find standard attr ID for object 2b50bbf1-32b1-49bd-8448-39c99e248803. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:31:21.133053 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:21.139107 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:21.151093 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:21.209686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9edd148a-6f6b-48a8-845b-2ab2b280e60e None None] Could not find standard attr ID for object e958ee16-eed1-4b00-aa2b-744bf60e902b. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:31:21.228022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-786c6efb-f3b2-4fe2-9560-713fa306702b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.251816 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-786c6efb-f3b2-4fe2-9560-713fa306702b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 568e9d99-040f-47f0-a44d-8cfc6266e033 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:21.272946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:21.273665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.383062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-34967bba-6654-4f58-9257-c3b437e5711d None None] Provisioning complete for port 8b1692f7-7d73-4252-a67c-da171444a8b3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:21.383062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-34967bba-6654-4f58-9257-c3b437e5711d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.442990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:21.516688 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-34967bba-6654-4f58-9257-c3b437e5711d None None] Port 8b1692f7-7d73-4252-a67c-da171444a8b3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:21.522433 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5b0a5783-7493-419b-99e0-9b8a40c88bd5 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:21.558319 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-786c6efb-f3b2-4fe2-9560-713fa306702b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.586486 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 5b0a5783-7493-419b-99e0-9b8a40c88bd5 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:21.586873 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.602239 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786c6efb-f3b2-4fe2-9560-713fa306702b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=568e9d99-040f-47f0-a44d-8cfc6266e033,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:21.639584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-786c6efb-f3b2-4fe2-9560-713fa306702b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.643949 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-786c6efb-f3b2-4fe2-9560-713fa306702b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/568e9d99-040f-47f0-a44d-8cfc6266e033 HTTP/1.1" status: 204 len: 168 time: 0.8862760 Dec 10 14:31:21.646558 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59092) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:21.673347 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-953924f9-c214-4191-8ace-19e985287644 None None] Could not find standard attr ID for object 568e9d99-040f-47f0-a44d-8cfc6266e033. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:31:21.673984 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:21.683454 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c9037948-9144-4348-994e-50f7ed012d6b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5811987 Dec 10 14:31:21.684071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59098) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:21.685915 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:21.689362 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-953924f9-c214-4191-8ace-19e985287644 None None] Provisioning complete for port 8b1692f7-7d73-4252-a67c-da171444a8b3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:21.689770 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-953924f9-c214-4191-8ace-19e985287644 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.690065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'network': {'name': 'tempest-RoutersTest-1432688751'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:21.704510 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router ff0346ca-999c-400f-8b50-ce9d0945eb30 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:21.705894 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:21.706704 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:21.760225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73bb66e5-0bb4-4264-866f-7605765771a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:21.762523 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73bb66e5-0bb4-4264-866f-7605765771a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:21.764426 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-73bb66e5-0bb4-4264-866f-7605765771a3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1451 time: 0.1167068 Dec 10 14:31:21.767937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59100) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:21.792801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-953924f9-c214-4191-8ace-19e985287644 None None] Port 8b1692f7-7d73-4252-a67c-da171444a8b3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:21.806825 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e51caa04-e910-4600-b070-6e1ec445d80a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:21.826872 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:21.830522 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.889150 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port e51caa04-e910-4600-b070-6e1ec445d80a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:21.889581 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:21.890635 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-fc49c35b-575d-4b20-8a47-220317c9e5fd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 12abe0f7-269a-43bb-b17c-2229d58e220c {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:21.904900 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fc49c35b-575d-4b20-8a47-220317c9e5fd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.000120 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fc49c35b-575d-4b20-8a47-220317c9e5fd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.035200 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:22.097443 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fc49c35b-575d-4b20-8a47-220317c9e5fd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.260821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fc49c35b-575d-4b20-8a47-220317c9e5fd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.309937 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:19Z', 'revision_number': 3, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:20Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:22.317002 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc49c35b-575d-4b20-8a47-220317c9e5fd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=12abe0f7-269a-43bb-b17c-2229d58e220c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:22.340831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] vlan segment allocate from pool success with {'vlan_id': 368, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:31:22.358147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.358482 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added segment 862dac17-fd37-49f1-a3d3-c637bc135f24 of type vlan for network 410c00ab-fbb1-49af-81bd-d3d499d7757d Dec 10 14:31:22.362192 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fc49c35b-575d-4b20-8a47-220317c9e5fd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.362384 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90d405b8-e510-46fe-bd70-5ee4993b6c14 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:22.368859 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fc49c35b-575d-4b20-8a47-220317c9e5fd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/12abe0f7-269a-43bb-b17c-2229d58e220c HTTP/1.1" status: 204 len: 168 time: 0.5991259 Dec 10 14:31:22.370739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59102) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:22.378277 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:22.378277 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Updating router dd925215-16e0-45b2-afbb-d31a45079594 port 8b1692f7-7d73-4252-a67c-da171444a8b3 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:31:22.378521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:22.414131 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.428427 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3be210f0-bcc0-473d-b301-389f6bacd681 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0564132 Dec 10 14:31:22.431240 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59104) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:22.434158 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] Sync routers for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:22.464544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:22.465146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:22.482556 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.554760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.622111 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9e0a21cf-6092-41f9-a627-8dc98f2a1226 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 6.7461188 Dec 10 14:31:22.622111 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:31:22.625973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cec38489-0ade-46d3-8b89-9eaed1914572" -d '{"events": [{"name": "network-changed", "server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:31:22.636366 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59108) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:22.721138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:31:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55e7167d-a9d8-43ab-be6d-1e1e83ce7f2f x-openstack-request-id: req-55e7167d-a9d8-43ab-be6d-1e1e83ce7f2f {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:31:22.722032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:31:22.722530 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:22.736712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-55e7167d-a9d8-43ab-be6d-1e1e83ce7f2f {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:31:22.737497 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'status': 'completed', 'code': 200} Dec 10 14:31:22.751128 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.758233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:22.759579 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.774759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e51caa04-e910-4600-b070-6e1ec445d80a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:22.846352 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51a33fc8-d3bd-4523-9765-5cb5399d39d4 None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:22.888803 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Network': ['ID=410c00ab-fbb1-49af-81bd-d3d499d7757d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:22.903078 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-98ab6033-6040-4097-8f88-d31d3657e750 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 1.2177978 Dec 10 14:31:22.913469 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59112) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:22.915408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-da4e3225-6a25-4ba1-bcef-f896fe82c781 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:22.917392 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-da4e3225-6a25-4ba1-bcef-f896fe82c781 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 1099 time: 0.1456223 Dec 10 14:31:22.923275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'subnet': {'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'cidr': '172.22.0.0/28', 'ip_version': 4, 'gateway_ip': '172.22.0.1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:22.953551 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:22.955370 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-448b03ff-1eeb-47da-b749-9b519155b76d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:22.956901 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-448b03ff-1eeb-47da-b749-9b519155b76d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.5246532 Dec 10 14:31:22.961888 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59114) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:22.990561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 410c00ab-fbb1-49af-81bd-d3d499d7757d details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:31:23.014003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50ddf49a-e2c3-47c9-bb22-591a0492a609 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:23.017481 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-50ddf49a-e2c3-47c9-bb22-591a0492a609 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0532479 Dec 10 14:31:23.019503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59116) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:23.044591 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.053048 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-68362d91-4229-411e-9588-84fe669ea7c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/bec1b40f-2e80-44c7-a266-a325b8e10dc0 HTTP/1.1" status: 200 len: 992 time: 0.4151647 Dec 10 14:31:23.146623 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cdd4f598-94cd-4450-b9e5-b1f696ca717e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1258798 Dec 10 14:31:23.147892 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59118) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:23.158473 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:23.162937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port e51caa04-e910-4600-b070-6e1ec445d80a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:23.163319 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.180255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:23.184109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.193680 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-2d90d041-5641-4156-affc-05fd8212c575 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:23.195209 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-2d90d041-5641-4156-affc-05fd8212c575 service neutron] 10.222.0.39 "GET /v2.0/networks?id=6227fea4-3842-4a83-a78f-a5ec3bccdb07 HTTP/1.1" status: 200 len: 897 time: 0.1812963 Dec 10 14:31:23.244157 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Attempting to bind port 8b1692f7-7d73-4252-a67c-da171444a8b3 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:23.244685 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Attempting to bind port 8b1692f7-7d73-4252-a67c-da171444a8b3 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:23.245148 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Attempting to bind port 8b1692f7-7d73-4252-a67c-da171444a8b3 on network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:23.267635 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:23.268191 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Checking segment: {'id': 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:23.268697 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.269192 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Bound using segment: {'id': 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:23.269807 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Bound port: 8b1692f7-7d73-4252-a67c-da171444a8b3, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:23.270301 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.389700 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] For port 8b1692f7-7d73-4252-a67c-da171444a8b3, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:23.394105 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] For port 8b1692f7-7d73-4252-a67c-da171444a8b3, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8b1692f7-7d73-4252-a67c-da171444a8b3,segment=NetworkSegment(c5ef3d30-2c43-48b0-94dc-aa33c15b3435),segment_id=c5ef3d30-2c43-48b0-94dc-aa33c15b3435)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:23.396647 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55432f91-9f97-4e37-a6cd-22e46c1bf5b7 None None] Pushing event updated for resources: {'Port': ['ID=8b1692f7-7d73-4252-a67c-da171444a8b3,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:23.427226 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:23.430802 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.444683 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-51a33fc8-d3bd-4523-9765-5cb5399d39d4 None None] Deleting port 5b0a5783-7493-419b-99e0-9b8a40c88bd5 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:23.445266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-51a33fc8-d3bd-4523-9765-5cb5399d39d4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.447323 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-04ee4219-c808-4d35-9ce1-f88f4f36b6b9 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=70717ebc-79f9-48f1-b654-d7a76d6366d3 HTTP/1.1" status: 200 len: 1000 time: 0.2163627 Dec 10 14:31:23.496225 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.537291 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-ad09b101-e41a-4ff6-ada9-db106d2fa565 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:23.542278 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-ad09b101-e41a-4ff6-ada9-db106d2fa565 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=06dce599-7e77-4ea6-a2ef-4939d220952a HTTP/1.1" status: 200 len: 835 time: 0.0848083 Dec 10 14:31:23.585971 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-51a33fc8-d3bd-4523-9765-5cb5399d39d4 None None] For port 5b0a5783-7493-419b-99e0-9b8a40c88bd5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5b0a5783-7493-419b-99e0-9b8a40c88bd5,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:23.586375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-51a33fc8-d3bd-4523-9765-5cb5399d39d4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.616635 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-51a33fc8-d3bd-4523-9765-5cb5399d39d4 None None] Calling delete_port for 5b0a5783-7493-419b-99e0-9b8a40c88bd5 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:23.620952 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-62f0841b-b9cf-414e-b9bd-e259f3a79ff1 None None] Provisioning complete for port 8b1692f7-7d73-4252-a67c-da171444a8b3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:23.621338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-62f0841b-b9cf-414e-b9bd-e259f3a79ff1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.637066 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55432f91-9f97-4e37-a6cd-22e46c1bf5b7 None None] Pushing event updated for resources: {'Port': ['ID=8b1692f7-7d73-4252-a67c-da171444a8b3,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:23.644262 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:23.644262 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:23.865704 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': 'bec1b40f-2e80-44c7-a266-a325b8e10dc0', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.252', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'port_id': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1262, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'mac_address': 'fa:16:3e:56:68:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:31:18Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 0, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a740df5b-822f-40aa-a293-e69ac39e4777', 'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:f7:ab:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_interface', 'standard_attr_id': 1186, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:38Z', 'updated_at': '2021-12-10T14:30:47Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:23.877285 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:23.911072 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] Checking router: ff0346ca-999c-400f-8b50-ce9d0945eb30 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:23.918606 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-62f0841b-b9cf-414e-b9bd-e259f3a79ff1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:23.927162 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-b7059ed0-cfca-4e03-85b8-9e761fd3c5ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:23.928666 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-b7059ed0-cfca-4e03-85b8-9e761fd3c5ff service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=6227fea4-3842-4a83-a78f-a5ec3bccdb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1369271 Dec 10 14:31:23.934111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:23.934935 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:23.978731 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-51a33fc8-d3bd-4523-9765-5cb5399d39d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:24.008919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-62f0841b-b9cf-414e-b9bd-e259f3a79ff1 None None] For port 8b1692f7-7d73-4252-a67c-da171444a8b3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8b1692f7-7d73-4252-a67c-da171444a8b3,segment=NetworkSegment(c5ef3d30-2c43-48b0-94dc-aa33c15b3435),segment_id=c5ef3d30-2c43-48b0-94dc-aa33c15b3435)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:24.031572 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a33fc8-d3bd-4523-9765-5cb5399d39d4 None None] Pushing event deleted for resources: {'Port': ['ID=5b0a5783-7493-419b-99e0-9b8a40c88bd5,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:24.040897 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51a33fc8-d3bd-4523-9765-5cb5399d39d4 None None] No DVR routers for this DVR port 5b0a5783-7493-419b-99e0-9b8a40c88bd5 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:24.079539 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59122) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:24.092491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:24.107288 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:31:24.116099 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-62f0841b-b9cf-414e-b9bd-e259f3a79ff1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:24.187962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f0841b-b9cf-414e-b9bd-e259f3a79ff1 None None] Pushing event updated for resources: {'Port': ['ID=8b1692f7-7d73-4252-a67c-da171444a8b3,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:24.194486 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:24.208198 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:19Z', 'revision_number': 3, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:24.264245 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:24.270896 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f64265b3-0036-4009-af48-06f07d2af685 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/bec1b40f-2e80-44c7-a266-a325b8e10dc0 HTTP/1.1" status: 200 len: 992 time: 0.1596944 Dec 10 14:31:24.272905 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ddf5a4-477a-48fb-92f9-7462e484c562 None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:19Z', 'revision_number': 3, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:24.310535 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3aa752df-6359-41b1-aa70-faa118443ea2 None None] Provisioning complete for port 8b1692f7-7d73-4252-a67c-da171444a8b3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:24.311187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3aa752df-6359-41b1-aa70-faa118443ea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:24.341162 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Subnet': ['ID=bdb71fa9-24b8-43a7-870b-8e041ade82e5,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:24.349909 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-f04381ae-1e40-428b-ac90-7465cd36a33b service neutron] 10.222.0.39 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4013271 Dec 10 14:31:24.355639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:24.362425 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:24.366168 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:24.367457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:24.390488 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fa15434-260a-4bf4-8200-172b1a8adc49 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:24.395786 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Checking segment: {'id': '862dac17-fd37-49f1-a3d3-c637bc135f24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:24.396260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network hostable DHCP agents. Network: 410c00ab-fbb1-49af-81bd-d3d499d7757d, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:31:24.397790 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:24.491461 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-10b6d01e-69ae-4981-a08a-31f8318cc6b8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.3407884 Dec 10 14:31:24.494266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59124) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:24.504343 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c04d4eb3-4d38-40cc-9986-4c8357270bc5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:24.512052 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-cec38489-0ade-46d3-8b89-9eaed1914572 req-8d90449d-baf8-4d81-9264-7464f6ea9e38 service neutron] 10.222.0.39 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1396406 Dec 10 14:31:24.558771 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 410c00ab-fbb1-49af-81bd-d3d499d7757d is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:31:24.672604 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 410c00ab-fbb1-49af-81bd-d3d499d7757d) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:24.676669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:24.677278 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:24.713220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:24.715719 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:24.717881 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b5a6dbe-61c6-4e5c-aa17-435fa96e0d57 None None] Network 410c00ab-fbb1-49af-81bd-d3d499d7757d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:24.730276 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c04d4eb3-4d38-40cc-9986-4c8357270bc5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:24.735031 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c04d4eb3-4d38-40cc-9986-4c8357270bc5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:24.806872 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e5e1b548-d5f0-4a99-a754-5659672ee7cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8883367 Dec 10 14:31:24.810547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59128) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:24.837768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8b1692f7-7d73-4252-a67c-da171444a8b3 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:24.894674 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.ipam_backend_mixin [None req-c04d4eb3-4d38-40cc-9986-4c8357270bc5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c (CIDR: 2001:db8::/64) Dec 10 14:31:24.987889 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-c04d4eb3-4d38-40cc-9986-4c8357270bc5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:31:24.989190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c04d4eb3-4d38-40cc-9986-4c8357270bc5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:25.014773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 8b1692f7-7d73-4252-a67c-da171444a8b3 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:25.015849 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.098741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': 'bec1b40f-2e80-44c7-a266-a325b8e10dc0', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.252', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'port_id': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1262, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'mac_address': 'fa:16:3e:56:68:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:31:18Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 0, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a740df5b-822f-40aa-a293-e69ac39e4777', 'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:f7:ab:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_interface', 'standard_attr_id': 1186, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:38Z', 'updated_at': '2021-12-10T14:30:47Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:25.105628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-410c00ab-fbb1-49af-81bd-d3d499d7757d', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:25.106724 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.142417 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c04d4eb3-4d38-40cc-9986-4c8357270bc5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.6462536 Dec 10 14:31:25.143042 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59130) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:25.148808 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:25.160106 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55a71c28-4ee8-4019-b6c3-349ee2d35330 None None] The sync data for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv is: [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': 'bec1b40f-2e80-44c7-a266-a325b8e10dc0', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.252', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'port_id': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1262, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'mac_address': 'fa:16:3e:56:68:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:31:18Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 0, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a740df5b-822f-40aa-a293-e69ac39e4777', 'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:f7:ab:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_interface', 'standard_attr_id': 1186, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:38Z', 'updated_at': '2021-12-10T14:30:47Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:25.180152 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Allocated IP 2001:db8::f816:3eff:fe79:ae87 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c/6d03d3e5-0478-4f04-ac3a-c078a9503b25) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:25.254338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.292585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59132) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:25.390043 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c89e51b3-e8bd-4030-a667-1cd925d6f0af tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/bec1b40f-2e80-44c7-a266-a325b8e10dc0 HTTP/1.1" status: 200 len: 992 time: 0.0953629 Dec 10 14:31:25.477639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:25.477828 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7054baff-d9d9-44ea-acee-e5b45e7a6e2e None None] New status for floating IP bec1b40f-2e80-44c7-a266-a325b8e10dc0: ACTIVE {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:31:25.482126 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.616737 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Allocated IP 172.22.0.2 (410c00ab-fbb1-49af-81bd-d3d499d7757d/bdb71fa9-24b8-43a7-870b-8e041ade82e5/e41be62f-58d8-4ece-a8c7-cd68ac2283ad) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:25.643540 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5b0a5783-7493-419b-99e0-9b8a40c88bd5 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:25.684914 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.713497 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 5b0a5783-7493-419b-99e0-9b8a40c88bd5 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:25.714268 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5b0a5783-7493-419b-99e0-9b8a40c88bd5 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:25.811764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.821640 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.860365 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:25.863366 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:25.866961 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:25.881908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Pushing event updated for resources: {'Port': ['ID=6d03d3e5-0478-4f04-ac3a-c078a9503b25,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:25.918499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.931203 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Attempting to bind port 6d03d3e5-0478-4f04-ac3a-c078a9503b25 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:25.931594 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Attempting to bind port 6d03d3e5-0478-4f04-ac3a-c078a9503b25 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:25.931946 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Attempting to bind port 6d03d3e5-0478-4f04-ac3a-c078a9503b25 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:25.937467 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:25.937882 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:25.938317 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.938716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:25.939241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Bound port: 6d03d3e5-0478-4f04-ac3a-c078a9503b25, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:25.939627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.960101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:25.963583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:25.966776 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:25.967361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.983435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:25.987544 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=e33d88af-109d-47b0-9ff8-cd30ad64d35b,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:26.030228 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.22.0.1 (410c00ab-fbb1-49af-81bd-d3d499d7757d/bdb71fa9-24b8-43a7-870b-8e041ade82e5/becd6e20-27d8-4993-88df-ec45766cc810) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:26.042803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Network 410c00ab-fbb1-49af-81bd-d3d499d7757d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:26.048573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:26.051150 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:26.058639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] For port 6d03d3e5-0478-4f04-ac3a-c078a9503b25, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:26.064984 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Pushing event updated for resources: {'Port': ['ID=e41be62f-58d8-4ece-a8c7-cd68ac2283ad,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:26.078837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] For port 6d03d3e5-0478-4f04-ac3a-c078a9503b25, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6d03d3e5-0478-4f04-ac3a-c078a9503b25,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:26.126048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Attempting to bind port e41be62f-58d8-4ece-a8c7-cd68ac2283ad on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:26.126418 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Attempting to bind port e41be62f-58d8-4ece-a8c7-cd68ac2283ad by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '862dac17-fd37-49f1-a3d3-c637bc135f24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:26.126870 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Attempting to bind port e41be62f-58d8-4ece-a8c7-cd68ac2283ad on network 410c00ab-fbb1-49af-81bd-d3d499d7757d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:26.132375 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d7398ae4-76b6-4e29-9376-017a046f0de4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.9874523 Dec 10 14:31:26.135673 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59136) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:26.135803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:26.135803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Checking segment: {'id': '862dac17-fd37-49f1-a3d3-c637bc135f24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:26.135803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.136135 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Bound using segment: {'id': '862dac17-fd37-49f1-a3d3-c637bc135f24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:26.136340 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Bound port: e41be62f-58d8-4ece-a8c7-cd68ac2283ad, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '862dac17-fd37-49f1-a3d3-c637bc135f24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:26.136727 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.138115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:fd:11:2e', 'name': 'tempest-NetworksTestDHCPv6-1081447519'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:26.206597 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] For port e41be62f-58d8-4ece-a8c7-cd68ac2283ad, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:26.208008 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.209614 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] For port e41be62f-58d8-4ece-a8c7-cd68ac2283ad, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e41be62f-58d8-4ece-a8c7-cd68ac2283ad,segment=NetworkSegment(862dac17-fd37-49f1-a3d3-c637bc135f24),segment_id=862dac17-fd37-49f1-a3d3-c637bc135f24)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:26.238239 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.299021 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5688ec5-bb18-4e73-8e38-e2d3c76372c8 None None] Pushing event updated for resources: {'Port': ['ID=6d03d3e5-0478-4f04-ac3a-c078a9503b25,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:26.330278 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.375120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.393992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59138) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:26.409262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e8624a0-1bcf-40d2-8f77-136d62d3b480 None None] Pushing event updated for resources: {'Port': ['ID=e41be62f-58d8-4ece-a8c7-cd68ac2283ad,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:26.438034 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:26.444514 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 410c00ab-fbb1-49af-81bd-d3d499d7757d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:26.459573 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:26.496999 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-276667da-07a2-4095-af4a-68e85789b305 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/bec1b40f-2e80-44c7-a266-a325b8e10dc0 HTTP/1.1" status: 200 len: 994 time: 0.1012130 Dec 10 14:31:26.500164 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:26.533639 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=becd6e20-27d8-4993-88df-ec45766cc810,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:26.577142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.679809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.720811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port dc1759f7-0181-42e8-bec9-eb728ff441e1 yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:31:26.810372 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e41be62f-58d8-4ece-a8c7-cd68ac2283ad up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:26.865134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port e41be62f-58d8-4ece-a8c7-cd68ac2283ad triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:26.865392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.877140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.952345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:26.990083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port e41be62f-58d8-4ece-a8c7-cd68ac2283ad, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e41be62f-58d8-4ece-a8c7-cd68ac2283ad,segment=NetworkSegment(862dac17-fd37-49f1-a3d3-c637bc135f24),segment_id=862dac17-fd37-49f1-a3d3-c637bc135f24)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:27.056974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8:0:1::5f (cdc891b5-3e75-4d62-a51b-0f84be9af82d/e33d88af-109d-47b0-9ff8-cd30ad64d35b/dc1759f7-0181-42e8-bec9-eb728ff441e1) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:27.067764 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fefd:112e (cdc891b5-3e75-4d62-a51b-0f84be9af82d/6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c/dc1759f7-0181-42e8-bec9-eb728ff441e1) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:27.106470 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.107275 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6d03d3e5-0478-4f04-ac3a-c078a9503b25 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:27.189083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=e41be62f-58d8-4ece-a8c7-cd68ac2283ad,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:27.202143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 6d03d3e5-0478-4f04-ac3a-c078a9503b25 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:27.202143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.293314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.328925 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 6d03d3e5-0478-4f04-ac3a-c078a9503b25, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6d03d3e5-0478-4f04-ac3a-c078a9503b25,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:27.336274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.342145 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.411414 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02771c90-2fab-4c92-9719-c75f056825d4 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:27.468140 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b2035a59-23cd-46c7-8bef-c0b98127f9b1 None None] Provisioning complete for port 6d03d3e5-0478-4f04-ac3a-c078a9503b25 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:27.468515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b2035a59-23cd-46c7-8bef-c0b98127f9b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.473811 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.506652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.532379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.596415 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=6d03d3e5-0478-4f04-ac3a-c078a9503b25,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:27.600659 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.609594 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=becd6e20-27d8-4993-88df-ec45766cc810,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:27.613145 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:27.639489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:27.647379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:27.652448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:27.653151 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.717344 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ba3aebd-dc6b-4ed8-a335-427358321d81 None None] Update dhcp port {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': '6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c', 'ip_address': '2001:db8::f816:3eff:fe79:ae87'}, {'subnet_id': 'e33d88af-109d-47b0-9ff8-cd30ad64d35b'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': '6d03d3e5-0478-4f04-ac3a-c078a9503b25'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:31:27.720049 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=dc1759f7-0181-42e8-bec9-eb728ff441e1,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:27.751480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3ba3aebd-dc6b-4ed8-a335-427358321d81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:27.773235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network 410c00ab-fbb1-49af-81bd-d3d499d7757d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:27.775058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:27.826557 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59142) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:27.827114 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c6aaf3a9-7cbd-4d88-b9d4-8d37abfb2da2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 1.6924887 Dec 10 14:31:27.890089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:27.944422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-3ba3aebd-dc6b-4ed8-a335-427358321d81 None None] Allocated IP 2001:db8:0:1::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/e33d88af-109d-47b0-9ff8-cd30ad64d35b/6d03d3e5-0478-4f04-ac3a-c078a9503b25) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:27.970393 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-97427e5e-491b-43f4-9bd8-31b30681595d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port dc1759f7-0181-42e8-bec9-eb728ff441e1 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:27.971638 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-97427e5e-491b-43f4-9bd8-31b30681595d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.009538 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9861b31-6360-4163-a3d2-a3a9bedd3a93 None None] Network 410c00ab-fbb1-49af-81bd-d3d499d7757d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:28.013367 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:28.020130 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1131c72a-5654-4f7c-82c2-66a19af0056d tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2077794 Dec 10 14:31:28.022269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59146) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:28.028161 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'network': {'name': 'tempest-RoutersTest-1051959332'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:28.034140 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:28.082189 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-97427e5e-491b-43f4-9bd8-31b30681595d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.095807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-97427e5e-491b-43f4-9bd8-31b30681595d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for dc1759f7-0181-42e8-bec9-eb728ff441e1 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:28.107191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:28.107812 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:28.146704 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:28.150328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.176227 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-538ce6ff-cce7-48b8-b07c-47a4a51f4d78 None None] Provisioning complete for port e41be62f-58d8-4ece-a8c7-cd68ac2283ad triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:28.179820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-538ce6ff-cce7-48b8-b07c-47a4a51f4d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.184033 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] vlan segment allocate from pool success with {'vlan_id': 380, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:31:28.241848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3ba3aebd-dc6b-4ed8-a335-427358321d81 None None] For port 6d03d3e5-0478-4f04-ac3a-c078a9503b25, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6d03d3e5-0478-4f04-ac3a-c078a9503b25,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:28.301848 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:28.349767 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3ba3aebd-dc6b-4ed8-a335-427358321d81 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.369671 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-97427e5e-491b-43f4-9bd8-31b30681595d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.371835 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.372405 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added segment 279b58fb-1034-4cd3-88ef-6581d9b7ec4b of type vlan for network ee5f9492-3bad-4793-a310-3fef72320cd2 Dec 10 14:31:28.427924 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.430903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97427e5e-491b-43f4-9bd8-31b30681595d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=dc1759f7-0181-42e8-bec9-eb728ff441e1,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:28.464591 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-97427e5e-491b-43f4-9bd8-31b30681595d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.469010 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-97427e5e-491b-43f4-9bd8-31b30681595d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/dc1759f7-0181-42e8-bec9-eb728ff441e1 HTTP/1.1" status: 204 len: 168 time: 0.6403165 Dec 10 14:31:28.473203 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59148) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:28.474858 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3ba3aebd-dc6b-4ed8-a335-427358321d81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.539171 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4023760-cf59-492a-9d33-0ff3df08c8ea tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:28.543045 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f4023760-cf59-492a-9d33-0ff3df08c8ea tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0664940 Dec 10 14:31:28.543556 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59150) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:28.544245 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.550565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:28.551218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.611949 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9360d5f2-e7ea-493d-bae5-4fda69c578b1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:28.617591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59152) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:28.617825 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9360d5f2-e7ea-493d-bae5-4fda69c578b1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0730927 Dec 10 14:31:28.674090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Network': ['ID=ee5f9492-3bad-4793-a310-3fef72320cd2,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:28.689401 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0765277c-851c-47d2-83bf-3d3425c0d848 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:28.691443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0765277c-851c-47d2-83bf-3d3425c0d848 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:28.693105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0765277c-851c-47d2-83bf-3d3425c0d848 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:28.695057 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0765277c-851c-47d2-83bf-3d3425c0d848 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.0763552 Dec 10 14:31:28.698233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59154) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:28.734930 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-718a6520-8a1c-4029-8101-dfa2dab31b3b tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.7098200 Dec 10 14:31:28.737282 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59156) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:28.745543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'subnet': {'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2', 'cidr': '172.23.0.0/28', 'ip_version': 4, 'gateway_ip': '172.23.0.1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:28.762079 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network ee5f9492-3bad-4793-a310-3fef72320cd2 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:31:28.765653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e41be62f-58d8-4ece-a8c7-cd68ac2283ad up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:28.766962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-8a28eef3-4b24-4d80-8620-9e6378f2bdc1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:28.770704 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a28eef3-4b24-4d80-8620-9e6378f2bdc1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.818637 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a28eef3-4b24-4d80-8620-9e6378f2bdc1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.877534 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ba3aebd-dc6b-4ed8-a335-427358321d81 None None] Pushing event updated for resources: {'Port': ['ID=6d03d3e5-0478-4f04-ac3a-c078a9503b25,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:28.915567 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d7c49395-b4c6-48c9-8d01-80df9e44c059 None None] Provisioning complete for port becd6e20-27d8-4993-88df-ec45766cc810 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:28.915919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d7c49395-b4c6-48c9-8d01-80df9e44c059 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.928238 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a28eef3-4b24-4d80-8620-9e6378f2bdc1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:28.954967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Made reservation on behalf of f89dac3cc3eb4260b99c6e932dee7a4f for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:28.962315 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.017281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-d7c49395-b4c6-48c9-8d01-80df9e44c059 None None] Port becd6e20-27d8-4993-88df-ec45766cc810 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:29.027509 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port e41be62f-58d8-4ece-a8c7-cd68ac2283ad triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:29.027932 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.070059 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-d7c49395-b4c6-48c9-8d01-80df9e44c059 None None] Provisioning complete for port e41be62f-58d8-4ece-a8c7-cd68ac2283ad triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:29.070717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d7c49395-b4c6-48c9-8d01-80df9e44c059 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.118717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a28eef3-4b24-4d80-8620-9e6378f2bdc1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.152739 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:26Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:27Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:29.168696 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8a28eef3-4b24-4d80-8620-9e6378f2bdc1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.172791 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8a28eef3-4b24-4d80-8620-9e6378f2bdc1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c HTTP/1.1" status: 204 len: 168 time: 0.4741302 Dec 10 14:31:29.174232 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a28eef3-4b24-4d80-8620-9e6378f2bdc1 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:29.176006 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59160) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:29.204141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:29.204985 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Updating router dd925215-16e0-45b2-afbb-d31a45079594 port becd6e20-27d8-4993-88df-ec45766cc810 binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:31:29.258083 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-8b2a6075-2130-48fd-9b7a-0279d46b5e6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet e33d88af-109d-47b0-9ff8-cd30ad64d35b {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:29.261812 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8b2a6075-2130-48fd-9b7a-0279d46b5e6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.299358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.311282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8b2a6075-2130-48fd-9b7a-0279d46b5e6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.330845 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6d03d3e5-0478-4f04-ac3a-c078a9503b25 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:29.415160 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8b2a6075-2130-48fd-9b7a-0279d46b5e6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.432794 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.492356 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 6d03d3e5-0478-4f04-ac3a-c078a9503b25 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:29.493219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.501988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-2d61f991-1ec0-41da-8064-d5c26823f961 None None] Provisioning complete for port becd6e20-27d8-4993-88df-ec45766cc810 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:29.501988 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2d61f991-1ec0-41da-8064-d5c26823f961 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.508344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Subnet': ['ID=9aabfbd5-ccd5-46d5-bfae-7b4051632ae9,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:29.520227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Checking segment: {'id': '279b58fb-1034-4cd3-88ef-6581d9b7ec4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:29.520227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network hostable DHCP agents. Network: ee5f9492-3bad-4793-a310-3fef72320cd2, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:31:29.610591 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8b2a6075-2130-48fd-9b7a-0279d46b5e6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.619281 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2d61f991-1ec0-41da-8064-d5c26823f961 None None] Port becd6e20-27d8-4993-88df-ec45766cc810 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:29.645956 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2a6075-2130-48fd-9b7a-0279d46b5e6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=e33d88af-109d-47b0-9ff8-cd30ad64d35b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:29.648018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8b2a6075-2130-48fd-9b7a-0279d46b5e6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.653735 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8b2a6075-2130-48fd-9b7a-0279d46b5e6f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/e33d88af-109d-47b0-9ff8-cd30ad64d35b HTTP/1.1" status: 204 len: 168 time: 0.4705172 Dec 10 14:31:29.654063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59162) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:29.666542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network ee5f9492-3bad-4793-a310-3fef72320cd2 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:31:29.668033 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6d38c57-bef0-40ec-8eb0-a23e48529338 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:29.697672 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a7612afa-766c-4330-a2d0-c7bc7558b27f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0423768 Dec 10 14:31:29.700549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59164) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:29.705723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:29.757974 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b289a52b-4c74-4b50-86b9-d0e18d6a9230 None None] Could not find standard attr ID for object dc1759f7-0181-42e8-bec9-eb728ff441e1. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:31:29.784784 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, ee5f9492-3bad-4793-a310-3fef72320cd2) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:29.789769 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:29.790375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.812511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f6ae849-2361-4fac-92df-1fc2caf4e52b None None] Network ee5f9492-3bad-4793-a310-3fef72320cd2 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:29.843598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b289a52b-4c74-4b50-86b9-d0e18d6a9230 None None] Provisioning complete for port 6d03d3e5-0478-4f04-ac3a-c078a9503b25 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:29.843910 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b289a52b-4c74-4b50-86b9-d0e18d6a9230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.899428 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:29.907863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:29.911974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.013248 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-ee5f9492-3bad-4793-a310-3fef72320cd2', 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2', 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'fixed_ips': [{'subnet_id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:30.014236 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.016247 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ad077a1-f514-499d-a994-2ab9650b942e None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:30.035825 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.054335 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c6a82c0c-9197-4c03-a17e-c98efb33cc2c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3165109 Dec 10 14:31:30.056986 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59166) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:30.195109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d9aec1-f84f-4ab3-9fac-53d5bc6004b9 None None] Pushing event updated for resources: {'Port': ['ID=becd6e20-27d8-4993-88df-ec45766cc810,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:30.284704 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Attempting to bind port becd6e20-27d8-4993-88df-ec45766cc810 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:30.285077 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Attempting to bind port becd6e20-27d8-4993-88df-ec45766cc810 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '862dac17-fd37-49f1-a3d3-c637bc135f24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:30.285459 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Attempting to bind port becd6e20-27d8-4993-88df-ec45766cc810 on network 410c00ab-fbb1-49af-81bd-d3d499d7757d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:30.296049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6ad077a1-f514-499d-a994-2ab9650b942e None None] Deleting port 6d03d3e5-0478-4f04-ac3a-c078a9503b25 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:30.296637 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6ad077a1-f514-499d-a994-2ab9650b942e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.300139 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:30.300515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Checking segment: {'id': '862dac17-fd37-49f1-a3d3-c637bc135f24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:30.301011 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.301411 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Bound using segment: {'id': '862dac17-fd37-49f1-a3d3-c637bc135f24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:30.301976 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Bound port: becd6e20-27d8-4993-88df-ec45766cc810, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '862dac17-fd37-49f1-a3d3-c637bc135f24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:30.302366 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.354728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Allocated IP 172.23.0.2 (ee5f9492-3bad-4793-a310-3fef72320cd2/9aabfbd5-ccd5-46d5-bfae-7b4051632ae9/952ccf00-78d7-4b96-a451-67a2a604e49e) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:30.396414 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.objects.ports [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103811) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:31:30.697096 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.726560 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 6d03d3e5-0478-4f04-ac3a-c078a9503b25 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:30.740229 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-6ad077a1-f514-499d-a994-2ab9650b942e None None] For port 6d03d3e5-0478-4f04-ac3a-c078a9503b25, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6d03d3e5-0478-4f04-ac3a-c078a9503b25,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:30.740637 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6ad077a1-f514-499d-a994-2ab9650b942e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.780628 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-86c7ca3d-3a21-434e-aa23-51620d7a6b26 None None] Provisioning complete for port becd6e20-27d8-4993-88df-ec45766cc810 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:30.781273 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-86c7ca3d-3a21-434e-aa23-51620d7a6b26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.813619 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] For port becd6e20-27d8-4993-88df-ec45766cc810, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:30.819906 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.822880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-6ad077a1-f514-499d-a994-2ab9650b942e None None] Calling delete_port for 6d03d3e5-0478-4f04-ac3a-c078a9503b25 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:30.859177 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] For port becd6e20-27d8-4993-88df-ec45766cc810, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=becd6e20-27d8-4993-88df-ec45766cc810,segment=NetworkSegment(862dac17-fd37-49f1-a3d3-c637bc135f24),segment_id=862dac17-fd37-49f1-a3d3-c637bc135f24)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:30.882263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] For port 6d03d3e5-0478-4f04-ac3a-c078a9503b25, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=6d03d3e5-0478-4f04-ac3a-c078a9503b25,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:30.914874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:30.918319 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-86c7ca3d-3a21-434e-aa23-51620d7a6b26 None None] Port becd6e20-27d8-4993-88df-ec45766cc810 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:30.993871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.052779 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.072627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.090075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.091116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.119645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:31.120312 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:31.122142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d9aec1-f84f-4ab3-9fac-53d5bc6004b9 None None] Pushing event updated for resources: {'Port': ['ID=becd6e20-27d8-4993-88df-ec45766cc810,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:31.126611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.168909 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:31.177915 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:31.181763 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:31.181938 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.211992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=82897941-f3a3-48d3-9e59-660221fe85ab,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:31.221481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=6d03d3e5-0478-4f04-ac3a-c078a9503b25,revision_number=8']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:31.235943 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.243888 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-6ad077a1-f514-499d-a994-2ab9650b942e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.276134 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Allocated IP 172.23.0.1 (ee5f9492-3bad-4793-a310-3fef72320cd2/9aabfbd5-ccd5-46d5-bfae-7b4051632ae9/f9198d48-ae44-400e-b53a-e91befe1bfc3) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:31.316751 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7e3fb484-50fc-4518-aab4-00f73223d109 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.6147032 Dec 10 14:31:31.317002 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:31.319327 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59172) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:31.324673 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f5ba1a3b-7b49-4546-be3e-7e1de93bf0fc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:31.337608 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Network ee5f9492-3bad-4793-a310-3fef72320cd2 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:31.363010 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ad077a1-f514-499d-a994-2ab9650b942e None None] No DVR routers for this DVR port 6d03d3e5-0478-4f04-ac3a-c078a9503b25 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:31.380238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:31.382258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:31.384208 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Pushing event updated for resources: {'Port': ['ID=952ccf00-78d7-4b96-a451-67a2a604e49e,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:31.403107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c85e820-eff4-46cf-9c21-a4a03ad340bd None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:31.433726 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.476274 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ad077a1-f514-499d-a994-2ab9650b942e None None] Pushing event deleted for resources: {'Port': ['ID=6d03d3e5-0478-4f04-ac3a-c078a9503b25,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:31.526424 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3d024c35-c544-42e5-85d3-baeeeb850e46 None None] Provisioning complete for port becd6e20-27d8-4993-88df-ec45766cc810 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:31.526802 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3d024c35-c544-42e5-85d3-baeeeb850e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.557596 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5ba1a3b-7b49-4546-be3e-7e1de93bf0fc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:31.561158 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f5ba1a3b-7b49-4546-be3e-7e1de93bf0fc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.597349 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.632390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Attempting to bind port 952ccf00-78d7-4b96-a451-67a2a604e49e on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:31.632742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Attempting to bind port 952ccf00-78d7-4b96-a451-67a2a604e49e by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '279b58fb-1034-4cd3-88ef-6581d9b7ec4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:31.633199 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Attempting to bind port 952ccf00-78d7-4b96-a451-67a2a604e49e on network ee5f9492-3bad-4793-a310-3fef72320cd2 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:31.645003 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network ee5f9492-3bad-4793-a310-3fef72320cd2 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:31.650618 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:31.656273 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:31.661317 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:31.664871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Checking segment: {'id': '279b58fb-1034-4cd3-88ef-6581d9b7ec4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:31.664871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.664871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Bound using segment: {'id': '279b58fb-1034-4cd3-88ef-6581d9b7ec4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:31.664871 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Bound port: 952ccf00-78d7-4b96-a451-67a2a604e49e, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '279b58fb-1034-4cd3-88ef-6581d9b7ec4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:31.665290 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.ipam_backend_mixin [None req-f5ba1a3b-7b49-4546-be3e-7e1de93bf0fc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 82897941-f3a3-48d3-9e59-660221fe85ab (CIDR: 2001:db8::/64) Dec 10 14:31:31.665391 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.681318 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=f9198d48-ae44-400e-b53a-e91befe1bfc3,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:31.707087 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.730022 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-f5ba1a3b-7b49-4546-be3e-7e1de93bf0fc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:31:31.730525 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f5ba1a3b-7b49-4546-be3e-7e1de93bf0fc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:31.747407 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': '82897941-f3a3-48d3-9e59-660221fe85ab'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:31.748266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.846370 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f5ba1a3b-7b49-4546-be3e-7e1de93bf0fc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5258315 Dec 10 14:31:31.849213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59174) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:31.854751 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:31.903724 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] For port 952ccf00-78d7-4b96-a451-67a2a604e49e, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:31.911321 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.924206 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3d024c35-c544-42e5-85d3-baeeeb850e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:31.941836 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] For port 952ccf00-78d7-4b96-a451-67a2a604e49e, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=952ccf00-78d7-4b96-a451-67a2a604e49e,segment=NetworkSegment(279b58fb-1034-4cd3-88ef-6581d9b7ec4b),segment_id=279b58fb-1034-4cd3-88ef-6581d9b7ec4b)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:32.005859 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:26Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:30Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:32.012825 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3d024c35-c544-42e5-85d3-baeeeb850e46 None None] For port becd6e20-27d8-4993-88df-ec45766cc810, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=becd6e20-27d8-4993-88df-ec45766cc810,segment=NetworkSegment(862dac17-fd37-49f1-a3d3-c637bc135f24),segment_id=862dac17-fd37-49f1-a3d3-c637bc135f24)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:32.046160 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a805e4b9-8e4e-4111-ace2-f2378861d4d5 None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:26Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:30Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:32.055385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.057805 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Allocated IP 2001:db8::f816:3eff:fe6c:8dcb (cdc891b5-3e75-4d62-a51b-0f84be9af82d/82897941-f3a3-48d3-9e59-660221fe85ab/491c932a-01cc-4033-9b2b-66c2a961f7d4) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:32.089693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:32.107556 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.139901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3d024c35-c544-42e5-85d3-baeeeb850e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.226289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f598f5f-f05b-458c-b8cd-7a4bd2e3111c None None] Pushing event updated for resources: {'Port': ['ID=952ccf00-78d7-4b96-a451-67a2a604e49e,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:32.236329 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.327754 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.338222 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d024c35-c544-42e5-85d3-baeeeb850e46 None None] Pushing event updated for resources: {'Port': ['ID=becd6e20-27d8-4993-88df-ec45766cc810,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:32.413604 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.440096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.452034 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event updated for resources: {'Port': ['ID=f9198d48-ae44-400e-b53a-e91befe1bfc3,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:32.507036 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.563931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.576293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Network ee5f9492-3bad-4793-a310-3fef72320cd2 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:32.579044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:32.581742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:32.585305 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:32.589904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:32.598744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Pushing event updated for resources: {'Port': ['ID=491c932a-01cc-4033-9b2b-66c2a961f7d4,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:32.663074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:32.672862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:32.682008 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:32.688184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.720696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=1c664183-e9b0-41a3-b001-d85105118369,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:32.739881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:32.885253 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:32.886231 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 952ccf00-78d7-4b96-a451-67a2a604e49e up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:32.896688 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-758c67a1-c0e1-4513-b1c6-82f16cc9dd86 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8378716 Dec 10 14:31:32.932467 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59178) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:32.937167 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Attempting to bind port 491c932a-01cc-4033-9b2b-66c2a961f7d4 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:32.937598 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Attempting to bind port 491c932a-01cc-4033-9b2b-66c2a961f7d4 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:32.937973 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Attempting to bind port 491c932a-01cc-4033-9b2b-66c2a961f7d4 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:32.939833 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'routes': [{'nexthop': '172.20.0.2', 'destination': '172.20.0.0/28'}, {'nexthop': '172.21.0.2', 'destination': '172.21.0.0/28'}, {'nexthop': '172.22.0.2', 'destination': '172.22.0.0/28'}, {'nexthop': '172.23.0.2', 'destination': '172.23.0.0/28'}]}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:32.948523 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:32.948949 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:32.949439 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:32.949842 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:32.950332 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Bound port: 491c932a-01cc-4033-9b2b-66c2a961f7d4, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:32.950721 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:33.018786 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 952ccf00-78d7-4b96-a451-67a2a604e49e triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:33.034109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:33.059567 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] For port 491c932a-01cc-4033-9b2b-66c2a961f7d4, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:33.064522 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] For port 491c932a-01cc-4033-9b2b-66c2a961f7d4, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=491c932a-01cc-4033-9b2b-66c2a961f7d4,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:33.094382 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bc7b286d-9a9e-4fa3-92e6-512cdfd8d6bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2440016 Dec 10 14:31:33.097108 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59180) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:33.101984 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:a6:de:7d', 'name': 'tempest-NetworksTestDHCPv6-1968724059'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:33.115371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:33.144019 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ac3d17f5-526c-4e16-a087-15370eb414d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:33.154638 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 952ccf00-78d7-4b96-a451-67a2a604e49e, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=952ccf00-78d7-4b96-a451-67a2a604e49e,segment=NetworkSegment(279b58fb-1034-4cd3-88ef-6581d9b7ec4b),segment_id=279b58fb-1034-4cd3-88ef-6581d9b7ec4b)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:33.254850 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:33.307703 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:33.315022 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:33.315951 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device becd6e20-27d8-4993-88df-ec45766cc810 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:33.333700 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:33.336783 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:33.434205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0549c11-7713-46c7-9c22-eab05c053958 None None] Pushing event updated for resources: {'Port': ['ID=491c932a-01cc-4033-9b2b-66c2a961f7d4,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:33.490537 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:33.510272 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port becd6e20-27d8-4993-88df-ec45766cc810 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:33.510675 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:33.544908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=952ccf00-78d7-4b96-a451-67a2a604e49e,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:33.677624 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22848661-34fc-41ae-9463-47e133a9fb84 None None] Network ee5f9492-3bad-4793-a310-3fef72320cd2 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:33.808845 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0450f2b1-8071-4809-9b26-3b10eef55905 None None] Provisioning complete for port 952ccf00-78d7-4b96-a451-67a2a604e49e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:33.809214 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0450f2b1-8071-4809-9b26-3b10eef55905 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:33.865282 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added routes are [{'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 10 14:31:33.882476 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f9198d48-ae44-400e-b53a-e91befe1bfc3', 'name': '', 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:5c:fd:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1278, 'fixed_ips': [{'subnet_id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:30Z', 'updated_at': '2021-12-10T14:31:32Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:33.883644 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:33.911677 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:33.912044 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Updating router dd925215-16e0-45b2-afbb-d31a45079594 port f9198d48-ae44-400e-b53a-e91befe1bfc3 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:31:33.918303 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Removed routes are [] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 10 14:31:33.922163 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:33.940536 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.010430 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.038623 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port 67b96e5e-7c35-48fc-ae81-fc7cec1827e7 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:31:34.165456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c022c341-719d-4cd7-8109-e03ff26c96dc None None] Provisioning complete for port 952ccf00-78d7-4b96-a451-67a2a604e49e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:34.165456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c022c341-719d-4cd7-8109-e03ff26c96dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.247888 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.294005 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-c022c341-719d-4cd7-8109-e03ff26c96dc None None] Provisioning complete for port f9198d48-ae44-400e-b53a-e91befe1bfc3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:34.294410 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c022c341-719d-4cd7-8109-e03ff26c96dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.329704 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.366191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c022c341-719d-4cd7-8109-e03ff26c96dc None None] Port f9198d48-ae44-400e-b53a-e91befe1bfc3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:34.384601 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.388244 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Pushing event updated for resources: {'Port': ['ID=f9198d48-ae44-400e-b53a-e91befe1bfc3,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:34.398384 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.398943 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.399459 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.400848 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.401501 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.402001 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.402522 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.402866 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.403213 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.403558 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.403887 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.404480 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.404809 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:31:34.418450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.451402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8:0:1::1d9 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/1c664183-e9b0-41a3-b001-d85105118369/67b96e5e-7c35-48fc-ae81-fc7cec1827e7) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:34.488538 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Attempting to bind port f9198d48-ae44-400e-b53a-e91befe1bfc3 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:34.493878 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Attempting to bind port f9198d48-ae44-400e-b53a-e91befe1bfc3 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '279b58fb-1034-4cd3-88ef-6581d9b7ec4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:34.493878 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Attempting to bind port f9198d48-ae44-400e-b53a-e91befe1bfc3 on network ee5f9492-3bad-4793-a310-3fef72320cd2 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:34.495928 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:34.496305 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Checking segment: {'id': '279b58fb-1034-4cd3-88ef-6581d9b7ec4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:34.496898 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.497493 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Bound using segment: {'id': '279b58fb-1034-4cd3-88ef-6581d9b7ec4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:34.497643 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f816:3eff:fea6:de7d (cdc891b5-3e75-4d62-a51b-0f84be9af82d/82897941-f3a3-48d3-9e59-660221fe85ab/67b96e5e-7c35-48fc-ae81-fc7cec1827e7) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:34.498279 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Bound port: f9198d48-ae44-400e-b53a-e91befe1bfc3, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '279b58fb-1034-4cd3-88ef-6581d9b7ec4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:34.499877 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.580710 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] For port f9198d48-ae44-400e-b53a-e91befe1bfc3, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:34.584970 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] For port f9198d48-ae44-400e-b53a-e91befe1bfc3, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f9198d48-ae44-400e-b53a-e91befe1bfc3,segment=NetworkSegment(279b58fb-1034-4cd3-88ef-6581d9b7ec4b),segment_id=279b58fb-1034-4cd3-88ef-6581d9b7ec4b)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:34.591158 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-302a09d4-0307-420b-8af4-44d18a0d183e None None] Provisioning complete for port f9198d48-ae44-400e-b53a-e91befe1bfc3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:34.595214 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-302a09d4-0307-420b-8af4-44d18a0d183e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.615775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:34.645119 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-302a09d4-0307-420b-8af4-44d18a0d183e None None] Port f9198d48-ae44-400e-b53a-e91befe1bfc3 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:34.685326 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.818498 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:34.819403 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:34.829456 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda016f7-45fc-425d-a87c-26c7eb3cdb63 None None] Pushing event updated for resources: {'Port': ['ID=f9198d48-ae44-400e-b53a-e91befe1bfc3,revision_number=4']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:34.839892 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:34.859134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.860825 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6efba7f1-fb51-436e-acf2-941fe12444bb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594 HTTP/1.1" status: 200 len: 933 time: 1.9311025 Dec 10 14:31:34.864093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59186) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:34.867493 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.891784 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-97b69972-90dc-4960-8563-0f17ece8fb4b None None] Provisioning complete for port f9198d48-ae44-400e-b53a-e91befe1bfc3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:34.892107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-97b69972-90dc-4960-8563-0f17ece8fb4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:34.936270 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 491c932a-01cc-4033-9b2b-66c2a961f7d4 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:34.960742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c88fd21-a5a8-4e37-9f2d-e5b740909de9 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:35.032576 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.059590 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:35.060503 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a75a335d-d313-45ac-80f0-0cde23ccd933 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594 HTTP/1.1" status: 200 len: 933 time: 0.1935642 Dec 10 14:31:35.063357 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59188) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:35.079688 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'routes': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:35.110948 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:35.120120 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:35.124463 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:35.137849 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:35.138544 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.178423 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=67b96e5e-7c35-48fc-ae81-fc7cec1827e7,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:35.187082 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 491c932a-01cc-4033-9b2b-66c2a961f7d4 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:35.191887 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.234991 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-97b69972-90dc-4960-8563-0f17ece8fb4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.274588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-295e2c57-1d26-4a87-91e4-1f65b910d0cf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.305748 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5186f8fc-7077-4d8a-b05d-d342310091bc tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1034 time: 2.2052345 Dec 10 14:31:35.306743 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-97b69972-90dc-4960-8563-0f17ece8fb4b None None] For port f9198d48-ae44-400e-b53a-e91befe1bfc3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f9198d48-ae44-400e-b53a-e91befe1bfc3,segment=NetworkSegment(279b58fb-1034-4cd3-88ef-6581d9b7ec4b),segment_id=279b58fb-1034-4cd3-88ef-6581d9b7ec4b)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:35.306880 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59190) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:35.369813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.396235 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-97b69972-90dc-4960-8563-0f17ece8fb4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.463555 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:33Z', 'revision_number': 6, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f9198d48-ae44-400e-b53a-e91befe1bfc3', 'name': '', 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:5c:fd:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1278, 'fixed_ips': [{'subnet_id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:30Z', 'updated_at': '2021-12-10T14:31:34Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:35.466108 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97b69972-90dc-4960-8563-0f17ece8fb4b None None] Pushing event updated for resources: {'Port': ['ID=f9198d48-ae44-400e-b53a-e91befe1bfc3,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:35.520959 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42871ace-35bc-454a-b3e5-5d8ff5e3dab8 None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:33Z', 'revision_number': 6, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f9198d48-ae44-400e-b53a-e91befe1bfc3', 'name': '', 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:5c:fd:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1278, 'fixed_ips': [{'subnet_id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:30Z', 'updated_at': '2021-12-10T14:31:34Z', 'revision_number': 4, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:35.535947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 491c932a-01cc-4033-9b2b-66c2a961f7d4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=491c932a-01cc-4033-9b2b-66c2a961f7d4,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:35.540023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-903d0bef-87a9-45f4-8d83-2ce10f50c240 None None] Update dhcp port {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': '82897941-f3a3-48d3-9e59-660221fe85ab', 'ip_address': '2001:db8::f816:3eff:fe6c:8dcb'}, {'subnet_id': '1c664183-e9b0-41a3-b001-d85105118369'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': '491c932a-01cc-4033-9b2b-66c2a961f7d4'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:31:35.552125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-5cd527e1-7a6c-4677-9b1a-8417f7c80316 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 67b96e5e-7c35-48fc-ae81-fc7cec1827e7 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:35.552551 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5cd527e1-7a6c-4677-9b1a-8417f7c80316 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.576141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81594ae4-d729-4330-ab64-419079a859ae None None] Provisioning complete for port f9198d48-ae44-400e-b53a-e91befe1bfc3 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:35.576141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81594ae4-d729-4330-ab64-419079a859ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.643328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-903d0bef-87a9-45f4-8d83-2ce10f50c240 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.677286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.678187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 952ccf00-78d7-4b96-a451-67a2a604e49e up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:35.732317 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.extraroute_db [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added routes are [] {{(pid=103810) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 10 14:31:35.733012 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.extraroute_db [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Removed routes are [{'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}] {{(pid=103810) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 10 14:31:35.760205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5cd527e1-7a6c-4677-9b1a-8417f7c80316 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.779543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-5cd527e1-7a6c-4677-9b1a-8417f7c80316 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 67b96e5e-7c35-48fc-ae81-fc7cec1827e7 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:35.785530 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:35.941979 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=491c932a-01cc-4033-9b2b-66c2a961f7d4,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:36.027754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 952ccf00-78d7-4b96-a451-67a2a604e49e triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:36.028264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.049385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5cd527e1-7a6c-4677-9b1a-8417f7c80316 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.163848 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd527e1-7a6c-4677-9b1a-8417f7c80316 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=67b96e5e-7c35-48fc-ae81-fc7cec1827e7,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:36.218486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5cd527e1-7a6c-4677-9b1a-8417f7c80316 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.224444 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5cd527e1-7a6c-4677-9b1a-8417f7c80316 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/67b96e5e-7c35-48fc-ae81-fc7cec1827e7 HTTP/1.1" status: 204 len: 168 time: 0.9173591 Dec 10 14:31:36.227438 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59194) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:36.249108 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-81594ae4-d729-4330-ab64-419079a859ae None None] Provisioning complete for port 491c932a-01cc-4033-9b2b-66c2a961f7d4 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:36.250102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-81594ae4-d729-4330-ab64-419079a859ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.284705 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-903d0bef-87a9-45f4-8d83-2ce10f50c240 None None] Allocated IP 2001:db8:0:1::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/1c664183-e9b0-41a3-b001-d85105118369/491c932a-01cc-4033-9b2b-66c2a961f7d4) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:36.291385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.307113 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.315489 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.429563 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f00098ba-5bd4-4593-8c4f-72b367c660d6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:36.435961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59196) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:36.436164 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f00098ba-5bd4-4593-8c4f-72b367c660d6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.2050865 Dec 10 14:31:36.449188 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-903d0bef-87a9-45f4-8d83-2ce10f50c240 None None] For port 491c932a-01cc-4033-9b2b-66c2a961f7d4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=491c932a-01cc-4033-9b2b-66c2a961f7d4,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:36.465627 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:36.493878 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-903d0bef-87a9-45f4-8d83-2ce10f50c240 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.555134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8497c474-d7b9-48fb-8bf5-d6f5b8337dd2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:36.556709 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8497c474-d7b9-48fb-8bf5-d6f5b8337dd2 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.1207647 Dec 10 14:31:36.559331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59198) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:36.574632 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-903d0bef-87a9-45f4-8d83-2ce10f50c240 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.612642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:36.621613 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.626157 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59200) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:36.626326 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8480cb9f-3a67-48a7-9d0d-9e97993c56aa tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594 HTTP/1.1" status: 200 len: 699 time: 1.5615141 Dec 10 14:31:36.637123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dac348f9-25bc-45ad-8c94-0395aaf72cfd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:36.639177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dac348f9-25bc-45ad-8c94-0395aaf72cfd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:36.641681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dac348f9-25bc-45ad-8c94-0395aaf72cfd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:36.645476 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dac348f9-25bc-45ad-8c94-0395aaf72cfd tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.0830169 Dec 10 14:31:36.648115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59204) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:36.732017 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-f322da1f-f773-4eda-b204-a3693de65107 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 1c664183-e9b0-41a3-b001-d85105118369 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:36.743346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f322da1f-f773-4eda-b204-a3693de65107 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.769700 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903d0bef-87a9-45f4-8d83-2ce10f50c240 None None] Pushing event updated for resources: {'Port': ['ID=491c932a-01cc-4033-9b2b-66c2a961f7d4,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:36.817734 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:36.836378 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:36.837156 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:36.864861 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f322da1f-f773-4eda-b204-a3693de65107 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:36.909285 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a3c6c2b0-0e68-407a-88da-129b085e28ea tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594 HTTP/1.1" status: 200 len: 699 time: 0.2810986 Dec 10 14:31:36.915552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59206) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:37.076210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f322da1f-f773-4eda-b204-a3693de65107 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.213977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f9198d48-ae44-400e-b53a-e91befe1bfc3 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:37.250384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f322da1f-f773-4eda-b204-a3693de65107 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.298777 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f322da1f-f773-4eda-b204-a3693de65107 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.301144 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:37.303603 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f322da1f-f773-4eda-b204-a3693de65107 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/1c664183-e9b0-41a3-b001-d85105118369 HTTP/1.1" status: 204 len: 168 time: 0.6543980 Dec 10 14:31:37.305726 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f322da1f-f773-4eda-b204-a3693de65107 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=1c664183-e9b0-41a3-b001-d85105118369,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:37.307499 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59208) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:37.373320 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-d33d0f59-2355-4e9e-8a14-da146c715a5e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 82897941-f3a3-48d3-9e59-660221fe85ab {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:37.378757 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d33d0f59-2355-4e9e-8a14-da146c715a5e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.475519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port f9198d48-ae44-400e-b53a-e91befe1bfc3 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:37.475908 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.481953 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d33d0f59-2355-4e9e-8a14-da146c715a5e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.548441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.622714 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d33d0f59-2355-4e9e-8a14-da146c715a5e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.673399 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.678282 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8344ef5d-7f6f-4bbe-ba28-36a380fd9c55 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:37.730290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 491c932a-01cc-4033-9b2b-66c2a961f7d4 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:37.769409 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d33d0f59-2355-4e9e-8a14-da146c715a5e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.780140 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-809bfbf0-04b1-47f8-a888-d5f43fd4d93d None None] Could not find standard attr ID for object 67b96e5e-7c35-48fc-ae81-fc7cec1827e7. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:31:37.803923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d33d0f59-2355-4e9e-8a14-da146c715a5e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=82897941-f3a3-48d3-9e59-660221fe85ab,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:37.806577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d33d0f59-2355-4e9e-8a14-da146c715a5e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.810417 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d33d0f59-2355-4e9e-8a14-da146c715a5e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/82897941-f3a3-48d3-9e59-660221fe85ab HTTP/1.1" status: 204 len: 168 time: 0.5019426 Dec 10 14:31:37.815808 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59214) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:37.842068 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-809bfbf0-04b1-47f8-a888-d5f43fd4d93d None None] Provisioning complete for port 491c932a-01cc-4033-9b2b-66c2a961f7d4 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:37.851772 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-809bfbf0-04b1-47f8-a888-d5f43fd4d93d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.858077 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-aaa6d4b6-e675-4c2a-97b5-cf87c845973b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0411351 Dec 10 14:31:37.862384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59216) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:37.869469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:37.904165 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:35Z', 'revision_number': 7, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f9198d48-ae44-400e-b53a-e91befe1bfc3', 'name': '', 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:5c:fd:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1278, 'fixed_ips': [{'subnet_id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:30Z', 'updated_at': '2021-12-10T14:31:35Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:37.940976 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:37.955624 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 491c932a-01cc-4033-9b2b-66c2a961f7d4 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:37.956010 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.982473 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port f9198d48-ae44-400e-b53a-e91befe1bfc3 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:37.983136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:37.997364 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:37.998053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:38.191937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:38.197591 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6b54906-63f2-45be-951c-783fd2838f91 None None] Update dhcp port {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'fixed_ips': [{'subnet_id': '82897941-f3a3-48d3-9e59-660221fe85ab'}], 'binding:host_id': 'dv-neutron-821401-2-hyperv'}, 'id': '491c932a-01cc-4033-9b2b-66c2a961f7d4'} from dv-neutron-821401-2-hyperv. {{(pid=103812) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 10 14:31:38.305817 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b6b54906-63f2-45be-951c-783fd2838f91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:38.365482 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:38.368936 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:38.379618 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-90115f45-8f3d-4622-ac6e-065aac5d9d49 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-485525198&fields=id&tenant_id=a1d5a7f281834a22aee867878a76c226 HTTP/1.1" status: 200 len: 267 time: 0.0794063 Dec 10 14:31:38.512078 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port f9198d48-ae44-400e-b53a-e91befe1bfc3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=f9198d48-ae44-400e-b53a-e91befe1bfc3,segment=NetworkSegment(279b58fb-1034-4cd3-88ef-6581d9b7ec4b),segment_id=279b58fb-1034-4cd3-88ef-6581d9b7ec4b)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:38.512452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:38.521011 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:35Z', 'revision_number': 7, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f9198d48-ae44-400e-b53a-e91befe1bfc3', 'name': '', 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:5c:fd:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1278, 'fixed_ips': [{'subnet_id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:30Z', 'updated_at': '2021-12-10T14:31:35Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:38.537606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for f9198d48-ae44-400e-b53a-e91befe1bfc3 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:38.555851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b697aca-5f55-4372-913d-d202c8159f2d None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:38.558504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3f35259-f96b-4ae3-94c5-895af40c232a None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:35Z', 'revision_number': 7, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f9198d48-ae44-400e-b53a-e91befe1bfc3', 'name': '', 'network_id': 'ee5f9492-3bad-4793-a310-3fef72320cd2', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:5c:fd:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1278, 'fixed_ips': [{'subnet_id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:30Z', 'updated_at': '2021-12-10T14:31:35Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '9aabfbd5-ccd5-46d5-bfae-7b4051632ae9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:38.633885 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-0445ea7e-37da-42e5-824c-7c76f2205d0e tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:38.635447 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-0445ea7e-37da-42e5-824c-7c76f2205d0e tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/networks?id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f HTTP/1.1" status: 200 len: 812 time: 0.2429266 Dec 10 14:31:38.644801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-707b2478-beaa-4d15-8da8-68901cbae920 None None] Provisioning complete for port 491c932a-01cc-4033-9b2b-66c2a961f7d4 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:38.645180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-707b2478-beaa-4d15-8da8-68901cbae920 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:38.678315 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-6cb8a1b0-5dfb-458e-97dd-b6a961ba7acc tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/quotas/a1d5a7f281834a22aee867878a76c226 HTTP/1.1" status: 200 len: 375 time: 0.0347834 Dec 10 14:31:38.732471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65501114-0c5e-4c0f-9a47-0c57eb7f0f83 None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:38.798922 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 491c932a-01cc-4033-9b2b-66c2a961f7d4 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:38.841066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:38.848236 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-e5e345c9-82b8-4b89-90b4-e0c4f7962da9 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1502492 Dec 10 14:31:38.871913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-65501114-0c5e-4c0f-9a47-0c57eb7f0f83 None None] Deleting port 491c932a-01cc-4033-9b2b-66c2a961f7d4 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:38.872287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-65501114-0c5e-4c0f-9a47-0c57eb7f0f83 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:38.917144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.023778 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:39.031542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:39.037503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:39.038084 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.050471 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=faea7f55-0c4e-422c-902c-d6debcc18c6b,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:39.073470 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-3d119d3a-a7f0-4c4b-b64b-5b64760c4d8e service neutron] 10.222.0.57 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1842206 Dec 10 14:31:39.074213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.116580 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.120032 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=f9198d48-ae44-400e-b53a-e91befe1bfc3,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:39.128826 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-65501114-0c5e-4c0f-9a47-0c57eb7f0f83 None None] For port 491c932a-01cc-4033-9b2b-66c2a961f7d4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=491c932a-01cc-4033-9b2b-66c2a961f7d4,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:39.129248 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-65501114-0c5e-4c0f-9a47-0c57eb7f0f83 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.150196 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-65501114-0c5e-4c0f-9a47-0c57eb7f0f83 None None] Calling delete_port for 491c932a-01cc-4033-9b2b-66c2a961f7d4 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:39.174668 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7edc4d42-71ca-4592-b546-7e5d7069ddde tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.3083370 Dec 10 14:31:39.174999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59230) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:39.181719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d89ef95b-621e-4d32-a123-1841d146338d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:39.235383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 491c932a-01cc-4033-9b2b-66c2a961f7d4, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=491c932a-01cc-4033-9b2b-66c2a961f7d4,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:39.294996 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.307636 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-65bf9ead-f205-49b5-957b-d3cef6d7f831 service neutron] 10.222.0.57 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2245042 Dec 10 14:31:39.316284 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-4bd2a379-79a1-48d4-8fcd-ce699f6fbf64 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0714953 Dec 10 14:31:39.385714 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=491c932a-01cc-4033-9b2b-66c2a961f7d4,revision_number=7']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:39.389729 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-65501114-0c5e-4c0f-9a47-0c57eb7f0f83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.418802 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65501114-0c5e-4c0f-9a47-0c57eb7f0f83 None None] Pushing event deleted for resources: {'Port': ['ID=491c932a-01cc-4033-9b2b-66c2a961f7d4,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:39.421391 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65501114-0c5e-4c0f-9a47-0c57eb7f0f83 None None] No DVR routers for this DVR port 491c932a-01cc-4033-9b2b-66c2a961f7d4 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:39.437777 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.449162 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d89ef95b-621e-4d32-a123-1841d146338d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:39.454167 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51dde5e2-baef-4164-a4ff-ce6b058f2a38 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:39.454300 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d89ef95b-621e-4d32-a123-1841d146338d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.474343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-a04aab72-4b70-4e58-b9c8-e268d0736b9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:39.479506 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-a04aab72-4b70-4e58-b9c8-e268d0736b9d service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 1099 time: 0.0830078 Dec 10 14:31:39.584459 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': 'faea7f55-0c4e-422c-902c-d6debcc18c6b'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:39.585502 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.673656 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:39.739421 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/faea7f55-0c4e-422c-902c-d6debcc18c6b/669fc035-778a-4a1b-961b-d73c824eaf72) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:39.776402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:39.788703 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:39.799097 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fcd6a1e3-3890-44c3-b9b0-d93caff7518c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8823321 Dec 10 14:31:39.801795 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59238) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:39.804427 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:39.805285 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:39.883048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-56447c84-6457-4b16-bb51-9de345e35758 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting subnet 9aabfbd5-ccd5-46d5-bfae-7b4051632ae9 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:39.887115 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-56447c84-6457-4b16-bb51-9de345e35758 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.908032 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:39.941083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-56447c84-6457-4b16-bb51-9de345e35758 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.944419 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:39.996344 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.ipam_backend_mixin [None req-d89ef95b-621e-4d32-a123-1841d146338d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet faea7f55-0c4e-422c-902c-d6debcc18c6b (CIDR: 2001:db8::/64) Dec 10 14:31:40.025923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-6f336ce0-11ea-4e68-be90-d97a3e0a40c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:40.027444 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-6f336ce0-11ea-4e68-be90-d97a3e0a40c0 service neutron] 10.222.0.39 "GET /v2.0/networks?id=6227fea4-3842-4a83-a78f-a5ec3bccdb07 HTTP/1.1" status: 200 len: 897 time: 0.5205061 Dec 10 14:31:40.032767 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-d89ef95b-621e-4d32-a123-1841d146338d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:31:40.032998 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.033275 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d89ef95b-621e-4d32-a123-1841d146338d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:40.054357 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-56447c84-6457-4b16-bb51-9de345e35758 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.112100 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c921a3d0-a9a6-4b1a-bb7a-1e154a505d0a req-d5c8f2ac-b291-4844-b219-a6a4d009a98d tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 210 time: 0.0283992 Dec 10 14:31:40.125140 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-05b2c262-1a39-42dc-b201-389e69618c62 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=70717ebc-79f9-48f1-b654-d7a76d6366d3 HTTP/1.1" status: 200 len: 1002 time: 0.0655761 Dec 10 14:31:40.132763 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d89ef95b-621e-4d32-a123-1841d146338d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.9555869 Dec 10 14:31:40.132914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59244) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:40.145268 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:40.168169 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Pushing event updated for resources: {'Port': ['ID=669fc035-778a-4a1b-961b-d73c824eaf72,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:40.178693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:40.183238 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:40.188493 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:40.206356 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:38Z', 'revision_number': 8, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:40.245726 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:40.250530 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-56447c84-6457-4b16-bb51-9de345e35758 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.254134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Attempting to bind port 669fc035-778a-4a1b-961b-d73c824eaf72 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:40.254525 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Attempting to bind port 669fc035-778a-4a1b-961b-d73c824eaf72 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:40.254907 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Attempting to bind port 669fc035-778a-4a1b-961b-d73c824eaf72 on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:40.257891 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:40.258735 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:40.263196 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:40.263592 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:40.264005 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.264530 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:40.264940 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Bound port: 669fc035-778a-4a1b-961b-d73c824eaf72, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:40.265385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.288093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-2b46572f-9cae-4680-ab87-9cb69419c1f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:40.290435 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-2b46572f-9cae-4680-ab87-9cb69419c1f0 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=06dce599-7e77-4ea6-a2ef-4939d220952a HTTP/1.1" status: 200 len: 835 time: 0.1567392 Dec 10 14:31:40.319556 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56447c84-6457-4b16-bb51-9de345e35758 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Subnet': ['ID=9aabfbd5-ccd5-46d5-bfae-7b4051632ae9,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:40.322204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-56447c84-6457-4b16-bb51-9de345e35758 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.323617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db0bbac5-d873-4a22-b271-9d01c4dfc52a None None] Network ee5f9492-3bad-4793-a310-3fef72320cd2 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:40.326825 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-56447c84-6457-4b16-bb51-9de345e35758 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/9aabfbd5-ccd5-46d5-bfae-7b4051632ae9 HTTP/1.1" status: 204 len: 168 time: 0.5235281 Dec 10 14:31:40.332084 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59250) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:40.380676 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-6e4b5911-46d9-41c6-89f1-a9db1a97ad13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:40.382664 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-6e4b5911-46d9-41c6-89f1-a9db1a97ad13 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=6227fea4-3842-4a83-a78f-a5ec3bccdb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0787055 Dec 10 14:31:40.398026 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:40.434115 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] For port 669fc035-778a-4a1b-961b-d73c824eaf72, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:40.435851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.449291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] For port 669fc035-778a-4a1b-961b-d73c824eaf72, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=669fc035-778a-4a1b-961b-d73c824eaf72,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:40.455551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:40.459452 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.505267 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port 952ccf00-78d7-4b96-a451-67a2a604e49e {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:40.505749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.540944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.574597 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-b190190d-bc85-4d51-acbb-a52651faeb1f service neutron] 10.222.0.39 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1840167 Dec 10 14:31:40.586069 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fedf80c1-c3b4-4b1b-b29d-468e94993fa5 None None] DHCP port deletion for ee5f9492-3bad-4793-a310-3fef72320cd2 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:40.641072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port 952ccf00-78d7-4b96-a451-67a2a604e49e, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=952ccf00-78d7-4b96-a451-67a2a604e49e,segment=NetworkSegment(279b58fb-1034-4cd3-88ef-6581d9b7ec4b),segment_id=279b58fb-1034-4cd3-88ef-6581d9b7ec4b)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:40.641696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.672214 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for 952ccf00-78d7-4b96-a451-67a2a604e49e owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:40.727460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-061625e0-6905-4da1-ad3e-755d874376f1 None None] Pushing event updated for resources: {'Port': ['ID=669fc035-778a-4a1b-961b-d73c824eaf72,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:40.768938 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-fedf80c1-c3b4-4b1b-b29d-468e94993fa5 None None] Deleting port 952ccf00-78d7-4b96-a451-67a2a604e49e {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:40.769321 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fedf80c1-c3b4-4b1b-b29d-468e94993fa5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.835359 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:38Z', 'revision_number': 8, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:40.839858 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-c36ccc95-3735-48d2-9fdf-a062ff8bbf35 req-33797eca-f78e-4a99-b180-ff974ca6e5fd service neutron] 10.222.0.39 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2484429 Dec 10 14:31:40.866711 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6d6743d-9405-41e0-8f2b-7fdd00b5904e None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:38Z', 'revision_number': 8, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'becd6e20-27d8-4993-88df-ec45766cc810', 'name': '', 'network_id': '410c00ab-fbb1-49af-81bd-d3d499d7757d', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:1e:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:25Z', 'updated_at': '2021-12-10T14:31:31Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'bdb71fa9-24b8-43a7-870b-8e041ade82e5', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:40.874428 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 952ccf00-78d7-4b96-a451-67a2a604e49e no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:40.906032 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.945603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-fedf80c1-c3b4-4b1b-b29d-468e94993fa5 None None] For port 952ccf00-78d7-4b96-a451-67a2a604e49e, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=952ccf00-78d7-4b96-a451-67a2a604e49e,segment=NetworkSegment(279b58fb-1034-4cd3-88ef-6581d9b7ec4b),segment_id=279b58fb-1034-4cd3-88ef-6581d9b7ec4b)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:40.945603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fedf80c1-c3b4-4b1b-b29d-468e94993fa5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:40.945873 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No DVR routers for this DVR port 952ccf00-78d7-4b96-a451-67a2a604e49e on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:40.965015 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-fedf80c1-c3b4-4b1b-b29d-468e94993fa5 None None] Calling delete_port for 952ccf00-78d7-4b96-a451-67a2a604e49e owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:40.979076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No active binding found for port 952ccf00-78d7-4b96-a451-67a2a604e49e {{(pid=103812) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 10 14:31:40.979511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 952ccf00-78d7-4b96-a451-67a2a604e49e not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:40.997620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=952ccf00-78d7-4b96-a451-67a2a604e49e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:41.063771 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fedf80c1-c3b4-4b1b-b29d-468e94993fa5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.092650 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fedf80c1-c3b4-4b1b-b29d-468e94993fa5 None None] Pushing event deleted for resources: {'Port': ['ID=952ccf00-78d7-4b96-a451-67a2a604e49e,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:41.098782 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.099075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fedf80c1-c3b4-4b1b-b29d-468e94993fa5 None None] No DVR routers for this DVR port 952ccf00-78d7-4b96-a451-67a2a604e49e on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:41.130584 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ee5f9492-3bad-4793-a310-3fef72320cd2']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:41.142809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '279b58fb-1034-4cd3-88ef-6581d9b7ec4b') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:41.143207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '279b58fb-1034-4cd3-88ef-6581d9b7ec4b') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:41.154594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.169034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.176849 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Releasing vlan 380 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:31:41.178848 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:31:41.181081 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:31:41.240458 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7735ae9d-99b4-4769-bf68-3799d085333e req-88c610b5-c665-4c1c-97d3-7ed1b7436640 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 210 time: 0.0648768 Dec 10 14:31:41.275423 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.objects.ports [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103810) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:31:41.334713 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.339325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.352279 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/networks/ee5f9492-3bad-4793-a310-3fef72320cd2 HTTP/1.1" status: 204 len: 168 time: 1.0090902 Dec 10 14:31:41.352279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59258) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:41.363805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01885610-eab5-42d0-a952-3f24496ffe3e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Network': ['ID=ee5f9492-3bad-4793-a310-3fef72320cd2,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:41.540730 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.729138 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.729346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] For port 669fc035-778a-4a1b-961b-d73c824eaf72, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=669fc035-778a-4a1b-961b-d73c824eaf72,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:41.765021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.820281 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.821087 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.899311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-839e2bec-fb7c-44dd-af51-08325f317a09 None None] Provisioning complete for port 669fc035-778a-4a1b-961b-d73c824eaf72 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:41.900868 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-839e2bec-fb7c-44dd-af51-08325f317a09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.944586 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:41.951040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:41.956870 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=669fc035-778a-4a1b-961b-d73c824eaf72,revision_number=4']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:41.968512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:41.969384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:41.975932 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=8ad5c423-8c69-4e77-9bd4-4cc00a29ff61,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:42.005806 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-839e2bec-fb7c-44dd-af51-08325f317a09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:42.046029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-839e2bec-fb7c-44dd-af51-08325f317a09 None None] For port 669fc035-778a-4a1b-961b-d73c824eaf72, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=669fc035-778a-4a1b-961b-d73c824eaf72,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:42.098527 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19e9b38a-05cb-4f9f-8de8-477e64222e92 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:42.131208 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cea30712-28e8-4980-afe6-776682e40a48 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 1.9896188 Dec 10 14:31:42.133966 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59260) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:42.139040 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:f3:53:70', 'name': 'tempest-NetworksTestDHCPv6-94551221'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:42.199962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-839e2bec-fb7c-44dd-af51-08325f317a09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:42.261603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-839e2bec-fb7c-44dd-af51-08325f317a09 None None] Pushing event updated for resources: {'Port': ['ID=669fc035-778a-4a1b-961b-d73c824eaf72,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:42.312095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:42.316432 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port becd6e20-27d8-4993-88df-ec45766cc810 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:42.316924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:42.328354 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-ea144afa-faf7-4481-b62e-8b8eb4a21e0d None None] Could not find standard attr ID for object dc1759f7-0181-42e8-bec9-eb728ff441e1. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:31:42.396119 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a16a2043-f106-4526-a5ed-d84dd2c3fc59 req-886a5ec4-4cb2-4608-bb30-6c095f2184c4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 210 time: 0.0544522 Dec 10 14:31:42.414365 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:42.436371 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port 8124e0f6-d7c6-4fc1-9252-3b023ee46c6e yet. {{(pid=103810) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:31:42.445355 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port becd6e20-27d8-4993-88df-ec45766cc810, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=becd6e20-27d8-4993-88df-ec45766cc810,segment=NetworkSegment(862dac17-fd37-49f1-a3d3-c637bc135f24),segment_id=862dac17-fd37-49f1-a3d3-c637bc135f24)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:42.445842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:42.459546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for becd6e20-27d8-4993-88df-ec45766cc810 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:42.624913 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::258 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/faea7f55-0c4e-422c-902c-d6debcc18c6b/8124e0f6-d7c6-4fc1-9252-3b023ee46c6e) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:42.631394 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8:0:1:f816:3eff:fef3:5370 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/8ad5c423-8c69-4e77-9bd4-4cc00a29ff61/8124e0f6-d7c6-4fc1-9252-3b023ee46c6e) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:42.740498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:42.773375 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 669fc035-778a-4a1b-961b-d73c824eaf72 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:42.785266 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=becd6e20-27d8-4993-88df-ec45766cc810,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:42.874566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 669fc035-778a-4a1b-961b-d73c824eaf72 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:42.875084 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:42.961016 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-0b14f257-849f-4630-9148-a3e213175fff tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:42.962628 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-0b14f257-849f-4630-9148-a3e213175fff tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.39 "GET /v2.0/networks?id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f HTTP/1.1" status: 200 len: 812 time: 0.2612164 Dec 10 14:31:42.998940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.004324 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f9198d48-ae44-400e-b53a-e91befe1bfc3 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:43.041933 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: f9198d48-ae44-400e-b53a-e91befe1bfc3 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:43.042297 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device f9198d48-ae44-400e-b53a-e91befe1bfc3 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:43.044953 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.134936 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-38c7c229-289d-4ba0-9f97-009b3d05d2ea tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a1d5a7f281834a22aee867878a76c226 HTTP/1.1" status: 200 len: 379 time: 0.1264665 Dec 10 14:31:43.146990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Request body: {'port': {'device_id': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'admin_state_up': True, 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'security_groups': ['86f9ef55-d8a0-4e93-a6a9-e2c927f963a5']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:43.180931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-5bd554c7-0936-44dd-b22f-76a1c2be5558 None None] Provisioning complete for port 669fc035-778a-4a1b-961b-d73c824eaf72 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:43.181498 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5bd554c7-0936-44dd-b22f-76a1c2be5558 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.212346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.292583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:43.319614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:43.332970 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=8124e0f6-d7c6-4fc1-9252-3b023ee46c6e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:43.344250 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:43.349448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:43.355869 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:43.359414 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.416504 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-6a6e2939-aa5f-494b-beff-a43b355def13 None None] Could not find standard attr ID for object 67b96e5e-7c35-48fc-ae81-fc7cec1827e7. {{(pid=103812) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 10 14:31:43.444791 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:43.456742 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-974f03a6-93be-489d-976f-23f5654f933d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1031 time: 1.3194387 Dec 10 14:31:43.456950 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:43.458717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59270) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:43.466466 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-12554eec-3b64-478a-b2b4-421528671298 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1151552 Dec 10 14:31:43.466868 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59272) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:43.479508 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:43.482233 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:43.559326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Made reservation on behalf of a1d5a7f281834a22aee867878a76c226 for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:43.563146 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.590206 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fbc1208-37fe-408e-b8ba-73c0a19b872d req-dbdffd82-3f29-4cdb-b27f-fcd08b5d3c4c tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 210 time: 0.0561218 Dec 10 14:31:43.603717 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-cf5d69d1-b407-497b-9bf6-60ad2b0884cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting subnet bdb71fa9-24b8-43a7-870b-8e041ade82e5 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:43.617829 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf5d69d1-b407-497b-9bf6-60ad2b0884cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.653692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:43.688917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf5d69d1-b407-497b-9bf6-60ad2b0884cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.774803 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-1545f430-04a1-4241-babe-8b25cdf0adb5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port 8124e0f6-d7c6-4fc1-9252-3b023ee46c6e {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:43.775352 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1545f430-04a1-4241-babe-8b25cdf0adb5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.845159 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-474c34dc-90a8-47a8-92b7-8e7555916be4 None None] Provisioning complete for port 8124e0f6-d7c6-4fc1-9252-3b023ee46c6e triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:43.846616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf5d69d1-b407-497b-9bf6-60ad2b0884cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.846735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-474c34dc-90a8-47a8-92b7-8e7555916be4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.851035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Allocated IP 172.20.0.9 (e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f/d34297eb-b45e-40a3-93a5-fff721097da7/aaad23d0-018e-4bc3-96f5-29b61ee40dc1) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:43.915568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1545f430-04a1-4241-babe-8b25cdf0adb5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:43.931632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-1545f430-04a1-4241-babe-8b25cdf0adb5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for 8124e0f6-d7c6-4fc1-9252-3b023ee46c6e owned by {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:43.976265 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-474c34dc-90a8-47a8-92b7-8e7555916be4 None None] Port 8124e0f6-d7c6-4fc1-9252-3b023ee46c6e cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:44.012184 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:42Z', 'revision_number': 9, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:44.044570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf5d69d1-b407-497b-9bf6-60ad2b0884cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.047066 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:44.060506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:44.060506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:44.083043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf5d69d1-b407-497b-9bf6-60ad2b0884cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Subnet': ['ID=bdb71fa9-24b8-43a7-870b-8e041ade82e5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:44.094939 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cf5d69d1-b407-497b-9bf6-60ad2b0884cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.102042 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cf5d69d1-b407-497b-9bf6-60ad2b0884cb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/bdb71fa9-24b8-43a7-870b-8e041ade82e5 HTTP/1.1" status: 204 len: 168 time: 0.6294582 Dec 10 14:31:44.103444 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59274) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:44.149990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7851ac0-a18a-44a2-a68d-06be5852b46c None None] Network 410c00ab-fbb1-49af-81bd-d3d499d7757d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:44.186161 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.232042 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.285325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:44.336343 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port e41be62f-58d8-4ece-a8c7-cd68ac2283ad {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:44.336947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.341480 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.385449 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1545f430-04a1-4241-babe-8b25cdf0adb5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.412038 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:44.417363 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:44.429826 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:44.470800 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port e41be62f-58d8-4ece-a8c7-cd68ac2283ad, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e41be62f-58d8-4ece-a8c7-cd68ac2283ad,segment=NetworkSegment(862dac17-fd37-49f1-a3d3-c637bc135f24),segment_id=862dac17-fd37-49f1-a3d3-c637bc135f24)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:44.471449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.472856 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'Port': ['ID=aaad23d0-018e-4bc3-96f5-29b61ee40dc1,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:44.494862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for e41be62f-58d8-4ece-a8c7-cd68ac2283ad owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:44.563342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1545f430-04a1-4241-babe-8b25cdf0adb5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=8124e0f6-d7c6-4fc1-9252-3b023ee46c6e,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:44.577788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1545f430-04a1-4241-babe-8b25cdf0adb5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.585738 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1545f430-04a1-4241-babe-8b25cdf0adb5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/8124e0f6-d7c6-4fc1-9252-3b023ee46c6e HTTP/1.1" status: 204 len: 168 time: 1.1235840 Dec 10 14:31:44.589216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59276) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:44.681938 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:44.687815 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.774084 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfe2b780-b77a-434f-8d2c-b2e23cc5b6d6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:44.781399 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cfe2b780-b77a-434f-8d2c-b2e23cc5b6d6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.1872315 Dec 10 14:31:44.782244 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59282) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:44.853459 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21611c17-413f-4ded-a9eb-541095044d9c req-18080193-a9ca-4d8e-85dc-9f1074159148 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:44.863932 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-21611c17-413f-4ded-a9eb-541095044d9c req-18080193-a9ca-4d8e-85dc-9f1074159148 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 931 time: 0.1270308 Dec 10 14:31:44.878677 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-895a5182-572d-4303-93bb-12b2bcf6d399 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7327037 Dec 10 14:31:44.897757 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Request body: {'port': {'device_id': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:44.899532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bf0ec9c-3a46-42bc-9267-1e38020992c7 None None] DHCP port deletion for 410c00ab-fbb1-49af-81bd-d3d499d7757d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:44.901635 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e41be62f-58d8-4ece-a8c7-cd68ac2283ad no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:44.930586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:44.930810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: e41be62f-58d8-4ece-a8c7-cd68ac2283ad {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:44.931092 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e41be62f-58d8-4ece-a8c7-cd68ac2283ad not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:44.984153 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bf1cc1e-f0a7-4f72-b73c-ad7fafae59f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:44.988274 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2bf1cc1e-f0a7-4f72-b73c-ad7fafae59f3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.2027016 Dec 10 14:31:44.994820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=e41be62f-58d8-4ece-a8c7-cd68ac2283ad,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:44.997874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No DVR routers for this DVR port e41be62f-58d8-4ece-a8c7-cd68ac2283ad on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:45.000765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59284) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:45.013568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.048309 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-21611c17-413f-4ded-a9eb-541095044d9c req-226f49d7-872c-4b26-8c40-854bd44c6798 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1833422 Dec 10 14:31:45.107291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-53b1a521-8820-4d5c-9e67-127b453f76d2 None None] Provisioning complete for port aaad23d0-018e-4bc3-96f5-29b61ee40dc1 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:45.107838 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-53b1a521-8820-4d5c-9e67-127b453f76d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.145474 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b8239ba-5959-4148-ad62-de80518df3ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:45.147901 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b8239ba-5959-4148-ad62-de80518df3ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:45.149937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b8239ba-5959-4148-ad62-de80518df3ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:45.156296 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9b8239ba-5959-4148-ad62-de80518df3ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.1527388 Dec 10 14:31:45.156716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59286) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:45.158277 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:42Z', 'revision_number': 9, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:45.165049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-53b1a521-8820-4d5c-9e67-127b453f76d2 None None] Port aaad23d0-018e-4bc3-96f5-29b61ee40dc1 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:45.182859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.188449 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03044a7e-271a-4ba0-a76b-bd1b6698ef1a None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:42Z', 'revision_number': 9, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8b1692f7-7d73-4252-a67c-da171444a8b3', 'name': '', 'network_id': '6ca4d5d6-7b36-4002-97c2-7e235cdda7bb', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:b0:a1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1260, 'fixed_ips': [{'subnet_id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:16Z', 'updated_at': '2021-12-10T14:31:23Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': 'fe3af855-3e1f-467b-9262-60423a9eaedc', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:45.215915 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['410c00ab-fbb1-49af-81bd-d3d499d7757d']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:45.249816 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '862dac17-fd37-49f1-a3d3-c637bc135f24') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:45.250402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '862dac17-fd37-49f1-a3d3-c637bc135f24') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:45.263231 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.276102 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-476b6c01-2f63-42dd-ba84-fc87078e061a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 8ad5c423-8c69-4e77-9bd4-4cc00a29ff61 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:45.277604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.284421 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-476b6c01-2f63-42dd-ba84-fc87078e061a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.286423 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Releasing vlan 368 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:31:45.287308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:31:45.290752 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:31:45.346293 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-476b6c01-2f63-42dd-ba84-fc87078e061a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.443445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.454259 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.460103 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/networks/410c00ab-fbb1-49af-81bd-d3d499d7757d HTTP/1.1" status: 204 len: 168 time: 1.3532352 Dec 10 14:31:45.467092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59288) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:45.475684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb1c50dc-9bf7-416b-bc79-e126a4c8327e tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Network': ['ID=410c00ab-fbb1-49af-81bd-d3d499d7757d,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:45.482532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-476b6c01-2f63-42dd-ba84-fc87078e061a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.517912 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aaad23d0-018e-4bc3-96f5-29b61ee40dc1 {{(pid=103810) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:31:45.528949 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.553508 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.provisioning_blocks [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Transition to ACTIVE for port object aaad23d0-018e-4bc3-96f5-29b61ee40dc1 will not be triggered until provisioned by entity L2. {{(pid=103810) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:31:45.620582 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.677126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-476b6c01-2f63-42dd-ba84-fc87078e061a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.727614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476b6c01-2f63-42dd-ba84-fc87078e061a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=8ad5c423-8c69-4e77-9bd4-4cc00a29ff61,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:45.729580 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Pushing event updated for resources: {'Port': ['ID=aaad23d0-018e-4bc3-96f5-29b61ee40dc1,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:45.736240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1b8bbeb-555d-40e9-bebf-095781120181 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:45.748550 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-476b6c01-2f63-42dd-ba84-fc87078e061a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.755254 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-476b6c01-2f63-42dd-ba84-fc87078e061a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/8ad5c423-8c69-4e77-9bd4-4cc00a29ff61 HTTP/1.1" status: 204 len: 168 time: 0.5972331 Dec 10 14:31:45.761126 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59290) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:45.909192 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-5a60a2e9-2eb5-4551-b811-4cfc68581e06 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet faea7f55-0c4e-422c-902c-d6debcc18c6b {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:45.915445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a60a2e9-2eb5-4551-b811-4cfc68581e06 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.961721 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:45.973343 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Attempting to bind port aaad23d0-018e-4bc3-96f5-29b61ee40dc1 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:45.973655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Attempting to bind port aaad23d0-018e-4bc3-96f5-29b61ee40dc1 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:45.973996 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Attempting to bind port aaad23d0-018e-4bc3-96f5-29b61ee40dc1 on network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:45.980650 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a60a2e9-2eb5-4551-b811-4cfc68581e06 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.009566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Port aaad23d0-018e-4bc3-96f5-29b61ee40dc1 on network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:31:46.011032 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Attempting to bind port aaad23d0-018e-4bc3-96f5-29b61ee40dc1 on network e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:46.024153 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:46.024501 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Checking segment: {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:46.024896 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Bound using segment: {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:46.025340 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Bound port: aaad23d0-018e-4bc3-96f5-29b61ee40dc1, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3002d938-5fba-44ab-8087-00a333e47ca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f'}}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:46.025755 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.182478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a60a2e9-2eb5-4551-b811-4cfc68581e06 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.213518 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] For port aaad23d0-018e-4bc3-96f5-29b61ee40dc1, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:46.219123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96bff9de-355b-4cb8-818d-e57615f682c6 req-3fa29331-6bec-4eaa-8b18-597ad6576fbb tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:46.220804 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-96bff9de-355b-4cb8-818d-e57615f682c6 req-3fa29331-6bec-4eaa-8b18-597ad6576fbb tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.0646024 Dec 10 14:31:46.232994 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] For port aaad23d0-018e-4bc3-96f5-29b61ee40dc1, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1,segment=NetworkSegment(3002d938-5fba-44ab-8087-00a333e47ca8),segment_id=3002d938-5fba-44ab-8087-00a333e47ca8)] {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:46.289637 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.320933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a60a2e9-2eb5-4551-b811-4cfc68581e06 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.348190 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-96bff9de-355b-4cb8-818d-e57615f682c6 req-14503e74-ac27-4f51-91ba-4ffd3d859017 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1100214 Dec 10 14:31:46.391231 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port 8b1692f7-7d73-4252-a67c-da171444a8b3 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:46.391694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.403099 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a60a2e9-2eb5-4551-b811-4cfc68581e06 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=faea7f55-0c4e-422c-902c-d6debcc18c6b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:46.410255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5a60a2e9-2eb5-4551-b811-4cfc68581e06 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.416369 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5a60a2e9-2eb5-4551-b811-4cfc68581e06 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/faea7f55-0c4e-422c-902c-d6debcc18c6b HTTP/1.1" status: 204 len: 168 time: 0.6519489 Dec 10 14:31:46.418353 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:46.419635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.419776 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59294) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:46.420403 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] 10.222.0.39 "PUT /v2.0/ports/aaad23d0-018e-4bc3-96f5-29b61ee40dc1 HTTP/1.1" status: 200 len: 1093 time: 1.5335493 Dec 10 14:31:46.420916 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'tag': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:31:46.423301 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f2d7ba6-df51-4455-96c7-a3012f5d8340" -d '{"events": [{"name": "network-changed", "server_uuid": "639cb4fb-fcb2-41bb-8528-734e490b8575", "tag": "aaad23d0-018e-4bc3-96f5-29b61ee40dc1"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:31:46.444039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-387f8f56-40e4-4d31-953f-c4ed2496ab12 service neutron] Pushing event updated for resources: {'Port': ['ID=aaad23d0-018e-4bc3-96f5-29b61ee40dc1,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:46.482332 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:31:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9659e6d7-9918-41f1-9a6d-b4ff913c2bd2 x-openstack-request-id: req-9659e6d7-9918-41f1-9a6d-b4ff913c2bd2 {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:31:46.487626 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "639cb4fb-fcb2-41bb-8528-734e490b8575", "tag": "aaad23d0-018e-4bc3-96f5-29b61ee40dc1", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:31:46.487626 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-9659e6d7-9918-41f1-9a6d-b4ff913c2bd2 {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:31:46.487626 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'tag': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1', 'status': 'completed', 'code': 200} Dec 10 14:31:46.516531 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1969fa4a-5c5f-429f-a98d-1b8c0863e0b4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0929031 Dec 10 14:31:46.517388 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59298) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:46.522238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:46.560548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2d7ba6-df51-4455-96c7-a3012f5d8340 req-d2a063ad-750a-4017-841d-0e97837e6367 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:46.564032 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-1f2d7ba6-df51-4455-96c7-a3012f5d8340 req-d2a063ad-750a-4017-841d-0e97837e6367 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1096 time: 0.0554824 Dec 10 14:31:46.672931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port 8b1692f7-7d73-4252-a67c-da171444a8b3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=8b1692f7-7d73-4252-a67c-da171444a8b3,segment=NetworkSegment(c5ef3d30-2c43-48b0-94dc-aa33c15b3435),segment_id=c5ef3d30-2c43-48b0-94dc-aa33c15b3435)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:46.673321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.678045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2d7ba6-df51-4455-96c7-a3012f5d8340 req-91a2b4f3-4100-4d85-abc7-075ccc02ae4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:46.683782 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-1f2d7ba6-df51-4455-96c7-a3012f5d8340 req-91a2b4f3-4100-4d85-abc7-075ccc02ae4b service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=a1d5a7f281834a22aee867878a76c226&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1074810 Dec 10 14:31:46.690495 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device becd6e20-27d8-4993-88df-ec45766cc810 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:46.697563 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for 8b1692f7-7d73-4252-a67c-da171444a8b3 owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:46.718888 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: becd6e20-27d8-4993-88df-ec45766cc810 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:46.723418 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device becd6e20-27d8-4993-88df-ec45766cc810 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:46.771456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:46.775069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.810065 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4fb7164-7217-4249-b4b9-dd498361ddb6 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:46.841438 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2d7ba6-df51-4455-96c7-a3012f5d8340 req-cecb5a38-3158-45d6-85c6-47e91cf50dd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:46.843565 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-1f2d7ba6-df51-4455-96c7-a3012f5d8340 req-cecb5a38-3158-45d6-85c6-47e91cf50dd6 service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1551626 Dec 10 14:31:46.933287 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7f5d62e9-8665-46eb-93d7-42baa4393bd7 None None] Provisioning complete for port 669fc035-778a-4a1b-961b-d73c824eaf72 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:46.933966 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7f5d62e9-8665-46eb-93d7-42baa4393bd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:46.940055 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-07249db5-11a8-4cce-8d35-bbed09b1791d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:46.942461 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-07249db5-11a8-4cce-8d35-bbed09b1791d service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1096 time: 0.0610726 Dec 10 14:31:47.011911 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-86cbb7c7-6d4b-457b-b9ec-f67ccc7620fc service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1 HTTP/1.1" status: 200 len: 217 time: 0.0599837 Dec 10 14:31:47.080906 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-d9624c78-e100-4d31-b1d0-84f04859da39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:47.082808 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-d9624c78-e100-4d31-b1d0-84f04859da39 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=d34297eb-b45e-40a3-93a5-fff721097da7 HTTP/1.1" status: 200 len: 851 time: 0.0620029 Dec 10 14:31:47.098894 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2296d87-9151-463e-840c-d5541c1de5cd None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:47.136936 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-d24330a9-215f-4bf7-bb68-ee9ed8c92b9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:47.139093 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-d24330a9-215f-4bf7-bb68-ee9ed8c92b9a service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0489984 Dec 10 14:31:47.160853 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c2296d87-9151-463e-840c-d5541c1de5cd None None] Deleting port 669fc035-778a-4a1b-961b-d73c824eaf72 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:47.161851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c2296d87-9151-463e-840c-d5541c1de5cd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:47.246675 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c2296d87-9151-463e-840c-d5541c1de5cd None None] For port 669fc035-778a-4a1b-961b-d73c824eaf72, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=669fc035-778a-4a1b-961b-d73c824eaf72,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:47.247065 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c2296d87-9151-463e-840c-d5541c1de5cd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:47.248066 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-ab09aed4-e6f9-4aa4-b7da-c9cb246d6c69 service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1004767 Dec 10 14:31:47.263174 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c2296d87-9151-463e-840c-d5541c1de5cd None None] Calling delete_port for 669fc035-778a-4a1b-961b-d73c824eaf72 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:47.362857 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:47.368735 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-ff718dc8-612a-402a-8e9c-c3e85516a398 req-dcc99597-c1aa-4ce7-82f8-bf675e379628 service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1136034 Dec 10 14:31:47.415907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=8b1692f7-7d73-4252-a67c-da171444a8b3,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:47.421964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:47.449892 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c2296d87-9151-463e-840c-d5541c1de5cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:47.478803 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2296d87-9151-463e-840c-d5541c1de5cd None None] Pushing event deleted for resources: {'Port': ['ID=669fc035-778a-4a1b-961b-d73c824eaf72,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:47.504246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2296d87-9151-463e-840c-d5541c1de5cd None None] No DVR routers for this DVR port 669fc035-778a-4a1b-961b-d73c824eaf72 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:47.520579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=a43962e0-cf84-44c8-8faa-546aa0d281c8,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:47.556069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:47.560298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:47.563433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:47.564022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:47.571617 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39fa6b60-ecd7-4f94-8b10-85166811b279 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:47.665355 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2c5de0a7-9112-452b-a74c-8a303bda5dd9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.1444533 Dec 10 14:31:47.670049 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59302) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:47.673325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f213c363-50ab-4fdf-84d5-7c71d9c3b888 req-c8c84368-6752-4452-b587-93f58a60b000 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:47.674958 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f213c363-50ab-4fdf-84d5-7c71d9c3b888 req-c8c84368-6752-4452-b587-93f58a60b000 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.1780167 Dec 10 14:31:47.689904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-567c8dd9-404b-4aa1-9da0-c56325b91668 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:47.697102 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:47.730556 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'project_id': 'ad863e8eeacb4ff7b6e54fd3ddcddd70', 'fixed_ips': [{'subnet_id': 'a43962e0-cf84-44c8-8faa-546aa0d281c8'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:31:47.734523 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:47.818707 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f213c363-50ab-4fdf-84d5-7c71d9c3b888 req-6441a391-c19d-4d94-9ea1-1f4f5be4192f tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1278522 Dec 10 14:31:47.880140 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:31:47.912376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Allocated IP 2001:db8::2 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/a43962e0-cf84-44c8-8faa-546aa0d281c8/db953515-c08a-42c6-bf66-ae650ee7d2ab) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:47.959640 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:48.057221 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:48.068815 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-033f8400-9e54-4060-a046-034febe89406 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5978010 Dec 10 14:31:48.068815 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59304) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:48.070368 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:48.088121 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:48.088912 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:48.092271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.125594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-39634736-9993-4f20-8991-235230b53417 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting subnet fe3af855-3e1f-467b-9262-60423a9eaedc {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:48.129359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39634736-9993-4f20-8991-235230b53417 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.174552 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.178442 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39634736-9993-4f20-8991-235230b53417 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.198758 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:48.238563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:48.241693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:48.245913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:48.256142 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Pushing event updated for resources: {'Port': ['ID=db953515-c08a-42c6-bf66-ae650ee7d2ab,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:48.283179 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-567c8dd9-404b-4aa1-9da0-c56325b91668 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:48.286963 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-567c8dd9-404b-4aa1-9da0-c56325b91668 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.322014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39634736-9993-4f20-8991-235230b53417 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.326288 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Attempting to bind port db953515-c08a-42c6-bf66-ae650ee7d2ab on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:31:48.327145 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Attempting to bind port db953515-c08a-42c6-bf66-ae650ee7d2ab by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:31:48.327536 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Attempting to bind port db953515-c08a-42c6-bf66-ae650ee7d2ab on network cdc891b5-3e75-4d62-a51b-0f84be9af82d {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:31:48.334252 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:31:48.334925 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Checking segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:31:48.335600 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.336171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Bound using segment: {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:31:48.337409 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Bound port: db953515-c08a-42c6-bf66-ae650ee7d2ab, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '292f222e-ec8a-4b09-987f-5c8bd8bc0449', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:31:48.337995 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.412073 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] For port db953515-c08a-42c6-bf66-ae650ee7d2ab, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:31:48.415698 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] For port db953515-c08a-42c6-bf66-ae650ee7d2ab, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=db953515-c08a-42c6-bf66-ae650ee7d2ab,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:31:48.459847 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.ipam_backend_mixin [None req-567c8dd9-404b-4aa1-9da0-c56325b91668 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet a43962e0-cf84-44c8-8faa-546aa0d281c8 (CIDR: 2001:db8::/64) Dec 10 14:31:48.460929 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:46Z', 'revision_number': 10, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:48.477957 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39634736-9993-4f20-8991-235230b53417 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.487709 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:48.496244 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:48.496859 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:48.501244 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.518269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39634736-9993-4f20-8991-235230b53417 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Subnet': ['ID=fe3af855-3e1f-467b-9262-60423a9eaedc,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:48.522164 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-39634736-9993-4f20-8991-235230b53417 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.525510 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-39634736-9993-4f20-8991-235230b53417 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/fe3af855-3e1f-467b-9262-60423a9eaedc HTTP/1.1" status: 204 len: 168 time: 0.4578190 Dec 10 14:31:48.528236 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59306) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:48.538232 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-567c8dd9-404b-4aa1-9da0-c56325b91668 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:31:48.538760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-567c8dd9-404b-4aa1-9da0-c56325b91668 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:48.601933 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:48.616223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.618615 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67d1097e-2faa-4c19-a531-a0183a020913 None None] Network 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:48.644318 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-567c8dd9-404b-4aa1-9da0-c56325b91668 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.9728134 Dec 10 14:31:48.644908 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59308) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:48.662568 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'subnet': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:48.664992 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69e5638c-7740-437c-9065-a7c7edf98128 None None] Pushing event updated for resources: {'Port': ['ID=db953515-c08a-42c6-bf66-ae650ee7d2ab,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:48.711445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port e51caa04-e910-4600-b070-6e1ec445d80a {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:48.711934 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.832281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port e51caa04-e910-4600-b070-6e1ec445d80a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e51caa04-e910-4600-b070-6e1ec445d80a,segment=NetworkSegment(c5ef3d30-2c43-48b0-94dc-aa33c15b3435),segment_id=c5ef3d30-2c43-48b0-94dc-aa33c15b3435)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:48.832907 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:48.881931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for e51caa04-e910-4600-b070-6e1ec445d80a owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:48.890477 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:46Z', 'revision_number': 10, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:48.922847 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c977554-1d32-4208-89e9-28186384eb25 None None] DHCP port deletion for 6ca4d5d6-7b36-4002-97c2-7e235cdda7bb request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:48.932009 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30c10637-7e14-4528-9734-aa3ee04db02d None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:46Z', 'revision_number': 10, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None, '_interfaces': [{'id': '16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3', 'name': '', 'network_id': '4c636d8e-3e22-4f05-9af4-2ab71943989a', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'mac_address': 'fa:16:3e:41:6e:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'device_owner': 'network:router_interface', 'standard_attr_id': 1251, 'fixed_ips': [{'subnet_id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:31:11Z', 'updated_at': '2021-12-10T14:31:18Z', 'revision_number': 5, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'subnets': [{'id': '38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:48.977130 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 669fc035-778a-4a1b-961b-d73c824eaf72 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:49.003460 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 669fc035-778a-4a1b-961b-d73c824eaf72 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:49.003806 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 669fc035-778a-4a1b-961b-d73c824eaf72 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:49.026729 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8c977554-1d32-4208-89e9-28186384eb25 None None] Deleting port e51caa04-e910-4600-b070-6e1ec445d80a {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:49.027195 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8c977554-1d32-4208-89e9-28186384eb25 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.036934 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:49.040672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.080083 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b34d6f-57a7-4963-85a9-708596dc7133 req-372407d2-710c-473e-afbd-c6b891654627 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:49.081746 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97b34d6f-57a7-4963-85a9-708596dc7133 req-372407d2-710c-473e-afbd-c6b891654627 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.0755754 Dec 10 14:31:49.113954 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-8c977554-1d32-4208-89e9-28186384eb25 None None] For port e51caa04-e910-4600-b070-6e1ec445d80a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=e51caa04-e910-4600-b070-6e1ec445d80a,segment=NetworkSegment(c5ef3d30-2c43-48b0-94dc-aa33c15b3435),segment_id=c5ef3d30-2c43-48b0-94dc-aa33c15b3435)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:49.114275 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8c977554-1d32-4208-89e9-28186384eb25 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.130986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-8c977554-1d32-4208-89e9-28186384eb25 None None] Calling delete_port for e51caa04-e910-4600-b070-6e1ec445d80a owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:49.138409 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-97b34d6f-57a7-4963-85a9-708596dc7133 req-57e5eb3b-dbef-46bc-afce-b71acd56f51b tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482197 Dec 10 14:31:49.153630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.192649 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=e51caa04-e910-4600-b070-6e1ec445d80a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:49.202507 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No DVR routers for this DVR port e51caa04-e910-4600-b070-6e1ec445d80a on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:49.242962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-8c977554-1d32-4208-89e9-28186384eb25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.289328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c977554-1d32-4208-89e9-28186384eb25 None None] Pushing event deleted for resources: {'Port': ['ID=e51caa04-e910-4600-b070-6e1ec445d80a,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:49.302350 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c977554-1d32-4208-89e9-28186384eb25 None None] No DVR routers for this DVR port e51caa04-e910-4600-b070-6e1ec445d80a on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:49.368095 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.395546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6ca4d5d6-7b36-4002-97c2-7e235cdda7bb']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:49.408739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:49.409200 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c5ef3d30-2c43-48b0-94dc-aa33c15b3435') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:49.424022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.442367 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.451696 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Releasing vlan 398 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:31:49.452655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:31:49.464302 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:31:49.552884 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.objects.ports [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103810) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 10 14:31:49.602928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.607261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:49.614516 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/networks/6ca4d5d6-7b36-4002-97c2-7e235cdda7bb HTTP/1.1" status: 204 len: 168 time: 1.0831795 Dec 10 14:31:49.618526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59312) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:49.640542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd7d16ba-c74e-43a1-a157-232564af5d09 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Network': ['ID=6ca4d5d6-7b36-4002-97c2-7e235cdda7bb,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:49.774669 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59316) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:49.846470 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1a2aab87-f2ad-4098-81ce-913aa62063c6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/bec1b40f-2e80-44c7-a266-a325b8e10dc0 HTTP/1.1" status: 200 len: 994 time: 0.0625794 Dec 10 14:31:50.062760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.112851 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.150698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59322) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:50.406297 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] For port db953515-c08a-42c6-bf66-ae650ee7d2ab, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=db953515-c08a-42c6-bf66-ae650ee7d2ab,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:50.425833 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8589245d-3302-4a31-91fb-fbe2501bfcf2 req-1c415dbc-37c4-42ad-a2c0-996ec98c1e5f tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:50.434254 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8589245d-3302-4a31-91fb-fbe2501bfcf2 req-1c415dbc-37c4-42ad-a2c0-996ec98c1e5f tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.1194956 Dec 10 14:31:50.451224 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.463153 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 51f5cb26-c855-4e4d-ba72-420baf876e75 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:50.463483 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.530640 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.531534 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.539227 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8589245d-3302-4a31-91fb-fbe2501bfcf2 req-2f2c52d0-ce22-474b-a8ab-89d3c5541726 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1037850 Dec 10 14:31:50.587328 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.587563 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.603167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 51f5cb26-c855-4e4d-ba72-420baf876e75 owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:50.640458 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:50.651220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Subnet': ['ID=96969e05-cd52-4417-8621-e93b266189f3,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:50.660702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:50.661621 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:50.662269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.665335 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=db953515-c08a-42c6-bf66-ae650ee7d2ab,revision_number=4']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:50.671110 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:50.671446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.679062 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3eae8401-ed3d-45c8-acb8-f7ce416ffbd0 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:50.774958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3b2fe0d2-d6ee-47ca-a8d9-9e14d5015a3d None None] Provisioning complete for port db953515-c08a-42c6-bf66-ae650ee7d2ab triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:50.775325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3b2fe0d2-d6ee-47ca-a8d9-9e14d5015a3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.819519 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3,segment=NetworkSegment(4f31cd72-d151-4e97-990e-ffc32e237a7c),segment_id=4f31cd72-d151-4e97-990e-ffc32e237a7c)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:50.819890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.838772 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7a11b58a-f7cf-413c-ace4-3e46f4f1b0eb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 864 time: 2.1900434 Dec 10 14:31:50.839134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59326) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:50.840694 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:50.846510 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Request body: {'port': {'network_id': 'cdc891b5-3e75-4d62-a51b-0f84be9af82d', 'mac_address': 'fa:16:3e:fd:e7:bb', 'name': 'tempest-NetworksTestDHCPv6-254678263'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:50.863208 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device db953515-c08a-42c6-bf66-ae650ee7d2ab up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:50.949359 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3b2fe0d2-d6ee-47ca-a8d9-9e14d5015a3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:50.992952 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port db953515-c08a-42c6-bf66-ae650ee7d2ab triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:50.997027 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.001307 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3b2fe0d2-d6ee-47ca-a8d9-9e14d5015a3d None None] For port db953515-c08a-42c6-bf66-ae650ee7d2ab, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=db953515-c08a-42c6-bf66-ae650ee7d2ab,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:51.071452 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.089930 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.103450 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3b2fe0d2-d6ee-47ca-a8d9-9e14d5015a3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.126290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Made reservation on behalf of ad863e8eeacb4ff7b6e54fd3ddcddd70 for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:31:51.132264 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=51f5cb26-c855-4e4d-ba72-420baf876e75,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:51.134595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.166733 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:51.240134 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b2fe0d2-d6ee-47ca-a8d9-9e14d5015a3d None None] Pushing event updated for resources: {'Port': ['ID=db953515-c08a-42c6-bf66-ae650ee7d2ab,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:51.256033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.256378 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Floating IP bec1b40f-2e80-44c7-a266-a325b8e10dc0 disassociated (deleted). External IP: 172.26.2.252, port: 70717ebc-79f9-48f1-b654-d7a76d6366d3. Dec 10 14:31:51.263456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:31:51.264636 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:31:51.336335 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.357513 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.391905 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] device_id is not set on port e0d6c4d4-bb29-4126-ae6e-1e8300496ed6 yet. {{(pid=103811) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 10 14:31:51.551499 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:51.638727 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:51.647663 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6c9c9966-459c-4798-bb27-b447d88b91b4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0254090 Dec 10 14:31:51.649666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:51.657772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59330) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:51.661992 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:51.663392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:51.722312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-a837905c-bd9d-4a90-b457-a088e13e1ccb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting subnet 38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:51.726510 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a837905c-bd9d-4a90-b457-a088e13e1ccb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.773954 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a837905c-bd9d-4a90-b457-a088e13e1ccb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.880700 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a837905c-bd9d-4a90-b457-a088e13e1ccb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:51.900059 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:51.986197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:50Z', 'revision_number': 11, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:51.987449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d5fb6e4-9f50-40e3-a8a0-e76a8b8d77e5 req-a9f04958-4d3c-447d-8499-6cc42f4a5fa8 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:51.988971 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0d5fb6e4-9f50-40e3-a8a0-e76a8b8d77e5 req-a9f04958-4d3c-447d-8499-6cc42f4a5fa8 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.1190009 Dec 10 14:31:51.990905 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router ff0346ca-999c-400f-8b50-ce9d0945eb30 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:52.001775 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8::f1 (cdc891b5-3e75-4d62-a51b-0f84be9af82d/a43962e0-cf84-44c8-8faa-546aa0d281c8/e0d6c4d4-bb29-4126-ae6e-1e8300496ed6) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:52.013750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Allocated IP 2001:db8:0:1:f816:3eff:fefd:e7bb (cdc891b5-3e75-4d62-a51b-0f84be9af82d/96969e05-cd52-4417-8621-e93b266189f3/e0d6c4d4-bb29-4126-ae6e-1e8300496ed6) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:31:52.022777 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:52.025025 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-dd310801-e81e-45ca-8c79-2ef6459de8d2 None None] Provisioning complete for port db953515-c08a-42c6-bf66-ae650ee7d2ab triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:52.025132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-dd310801-e81e-45ca-8c79-2ef6459de8d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.038211 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a837905c-bd9d-4a90-b457-a088e13e1ccb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.076087 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:52.077398 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:52.078483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a837905c-bd9d-4a90-b457-a088e13e1ccb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Subnet': ['ID=38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:52.081295 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a837905c-bd9d-4a90-b457-a088e13e1ccb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.087296 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a837905c-bd9d-4a90-b457-a088e13e1ccb tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d HTTP/1.1" status: 204 len: 168 time: 0.4254041 Dec 10 14:31:52.087444 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59332) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:52.090904 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7f88f5c-cb72-44f7-9ecb-c1d221e97913 None None] Network 4c636d8e-3e22-4f05-9af4-2ab71943989a requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:52.099597 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8b1692f7-7d73-4252-a67c-da171444a8b3 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:52.151393 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0d5fb6e4-9f50-40e3-a8a0-e76a8b8d77e5 req-86560054-10d4-4369-9702-bcdea0c7d251 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1547420 Dec 10 14:31:52.190385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.205671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 8b1692f7-7d73-4252-a67c-da171444a8b3 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:52.206132 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 8b1692f7-7d73-4252-a67c-da171444a8b3 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:52.206623 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e51caa04-e910-4600-b070-6e1ec445d80a no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:52.250848 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:52.253894 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Deleting port 41cb962f-dc16-46ed-acc5-1f45dea7291f {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:52.254312 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.255605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.263760 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] Sync routers for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:52.267653 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: e51caa04-e910-4600-b070-6e1ec445d80a {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:52.268122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device e51caa04-e910-4600-b070-6e1ec445d80a not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:52.270290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:52.282199 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:52.283416 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:52.301488 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0c8db98d-9e7d-40a6-84ff-ae0a7e73c308 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/floatingips/bec1b40f-2e80-44c7-a266-a325b8e10dc0 HTTP/1.1" status: 204 len: 168 time: 2.1492121 Dec 10 14:31:52.316418 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:31:52.318829 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e" -d '{"events": [{"name": "network-changed", "server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:31:52.367785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] For port 41cb962f-dc16-46ed-acc5-1f45dea7291f, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=41cb962f-dc16-46ed-acc5-1f45dea7291f,segment=NetworkSegment(4f31cd72-d151-4e97-990e-ffc32e237a7c),segment_id=4f31cd72-d151-4e97-990e-ffc32e237a7c)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:52.367785 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.378767 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.387269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Calling delete_port for 41cb962f-dc16-46ed-acc5-1f45dea7291f owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:52.393271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:50Z', 'revision_number': 11, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:52.406275 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:31:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77964a15-554a-4025-bbda-27c32dbbf07f x-openstack-request-id: req-77964a15-554a-4025-bbda-27c32dbbf07f {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:31:52.406585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:31:52.406853 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-77964a15-554a-4025-bbda-27c32dbbf07f {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:31:52.407265 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'status': 'completed', 'code': 200} Dec 10 14:31:52.433639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52f50814-f5a2-49ce-9b2c-7633dc1669e8 None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:50Z', 'revision_number': 11, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:52.455246 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:52.547269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.550187 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-02be4469-2281-432b-955c-917ba1c71c89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:52.551825 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-02be4469-2281-432b-955c-917ba1c71c89 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 1099 time: 0.0687826 Dec 10 14:31:52.615359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event updated for resources: {'Port': ['ID=e0d6c4d4-bb29-4126-ae6e-1e8300496ed6,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:52.636917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:31:52.636917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:31:52.636917 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:31:52.639818 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:52.640684 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.661688 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-edd2586d-eebd-4d7d-8922-18e65c445d86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:52.663550 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-edd2586d-eebd-4d7d-8922-18e65c445d86 service neutron] 10.222.0.39 "GET /v2.0/networks?id=6227fea4-3842-4a83-a78f-a5ec3bccdb07 HTTP/1.1" status: 200 len: 897 time: 0.1028223 Dec 10 14:31:52.680242 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a740df5b-822f-40aa-a293-e69ac39e4777', 'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:f7:ab:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_interface', 'standard_attr_id': 1186, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:38Z', 'updated_at': '2021-12-10T14:30:47Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:52.707742 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] Checking router: ff0346ca-999c-400f-8b50-ce9d0945eb30 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:52.709077 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.714518 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1af5150d-5259-4951-a2a6-796247ffe845 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1031 time: 1.8743463 Dec 10 14:31:52.717289 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59338) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:52.719047 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-57c4ec6d-e98a-4962-bf60-4e5c4e7a0ac6 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=70717ebc-79f9-48f1-b654-d7a76d6366d3 HTTP/1.1" status: 200 len: 217 time: 0.0483985 Dec 10 14:31:52.731456 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:52.740507 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:52.747877 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No DVR routers for this DVR port 41cb962f-dc16-46ed-acc5-1f45dea7291f on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:52.760230 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Port': ['ID=41cb962f-dc16-46ed-acc5-1f45dea7291f,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:52.805338 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ac89e90-54c9-4147-98f1-400964537b91 None None] DHCP port deletion for 4c636d8e-3e22-4f05-9af4-2ab71943989a request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:52.900829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:52.904523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-141069db-8f4b-4cc0-94fe-31e8c57f185a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:52.906440 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-141069db-8f4b-4cc0-94fe-31e8c57f185a service neutron] 10.222.0.39 "GET /v2.0/subnets?id=06dce599-7e77-4ea6-a2ef-4939d220952a HTTP/1.1" status: 200 len: 835 time: 0.1615863 Dec 10 14:31:52.960249 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:52.974983 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4c636d8e-3e22-4f05-9af4-2ab71943989a']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:52.990405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device db953515-c08a-42c6-bf66-ae650ee7d2ab up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:31:52.993545 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c247aeac-59ed-4a24-8cfe-a7c89e0deec0 req-539f07f5-45dc-4ae7-a39e-7dad9246fc7f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:52.995123 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c247aeac-59ed-4a24-8cfe-a7c89e0deec0 req-539f07f5-45dc-4ae7-a39e-7dad9246fc7f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 946 time: 0.1471436 Dec 10 14:31:52.995255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4f31cd72-d151-4e97-990e-ffc32e237a7c') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:52.995477 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4f31cd72-d151-4e97-990e-ffc32e237a7c') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:53.013633 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.031616 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-eca7b364-6311-43aa-9e9a-179e97ef3ef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:53.033382 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-eca7b364-6311-43aa-9e9a-179e97ef3ef4 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=6227fea4-3842-4a83-a78f-a5ec3bccdb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1173351 Dec 10 14:31:53.037551 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.054024 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Releasing vlan 352 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:31:53.054744 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:31:53.058703 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:31:53.078208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-5f2bfaa8-00dc-4907-9d47-c129f714a08c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting port e0d6c4d4-bb29-4126-ae6e-1e8300496ed6 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:53.078547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5f2bfaa8-00dc-4907-9d47-c129f714a08c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.086968 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port db953515-c08a-42c6-bf66-ae650ee7d2ab triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:53.087464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.145004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-0067efc9-c905-42fe-8105-83dc9143a036 None None] Provisioning complete for port e0d6c4d4-bb29-4126-ae6e-1e8300496ed6 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:53.145373 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0067efc9-c905-42fe-8105-83dc9143a036 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.190189 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-0067efc9-c905-42fe-8105-83dc9143a036 None None] Port e0d6c4d4-bb29-4126-ae6e-1e8300496ed6 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:31:53.212199 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c247aeac-59ed-4a24-8cfe-a7c89e0deec0 req-e638a564-7a56-4da4-b1d6-948bd891d2d0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1992185 Dec 10 14:31:53.228495 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-aed96d8f-f6bd-427d-9371-ba9ed8bbb5c4 service neutron] 10.222.0.39 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1856225 Dec 10 14:31:53.248670 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.285955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.290929 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/networks/4c636d8e-3e22-4f05-9af4-2ab71943989a HTTP/1.1" status: 204 len: 168 time: 1.2025228 Dec 10 14:31:53.302592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59344) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:53.307190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'routes': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:53.328788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e22ec6-d85a-4b33-ae69-d4dd81af5aed tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Pushing event deleted for resources: {'Network': ['ID=4c636d8e-3e22-4f05-9af4-2ab71943989a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:53.352726 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:53.353982 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5f2bfaa8-00dc-4907-9d47-c129f714a08c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.375901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:53.376249 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 16a29a7f-c60d-4fd8-96bd-033b3a1b4cd3 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:53.376659 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 41cb962f-dc16-46ed-acc5-1f45dea7291f no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:53.385329 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a740df5b-822f-40aa-a293-e69ac39e4777', 'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:f7:ab:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_interface', 'standard_attr_id': 1186, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:38Z', 'updated_at': '2021-12-10T14:30:47Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:53.386089 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d3fb710-8ba8-48dd-ad46-318b50b20f4e req-bd49ff9e-6360-455c-b60e-a35bf1238109 service neutron] 10.222.0.39 "GET /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1486511 Dec 10 14:31:53.401618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 41cb962f-dc16-46ed-acc5-1f45dea7291f {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:53.401975 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 41cb962f-dc16-46ed-acc5-1f45dea7291f not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:53.416481 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f664c3f1-99ee-415c-9729-994fb2f125ff None None] The sync data for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv is: [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': 'a740df5b-822f-40aa-a293-e69ac39e4777', 'name': '', 'network_id': '6227fea4-3842-4a83-a78f-a5ec3bccdb07', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:f7:ab:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_interface', 'standard_attr_id': 1186, 'fixed_ips': [{'subnet_id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:38Z', 'updated_at': '2021-12-10T14:30:47Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '06dce599-7e77-4ea6-a2ef-4939d220952a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:53.437822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-5f2bfaa8-00dc-4907-9d47-c129f714a08c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Calling delete_port for e0d6c4d4-bb29-4126-ae6e-1e8300496ed6 owned by {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:53.566718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ca0dc0-9e9e-4699-99bd-4a3634555e73 req-538bc029-e56a-4021-91f0-70cda7230075 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:53.568256 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d6ca0dc0-9e9e-4699-99bd-4a3634555e73 req-538bc029-e56a-4021-91f0-70cda7230075 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.3028560 Dec 10 14:31:53.591821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Added routes are [] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 10 14:31:53.592168 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.extraroute_db [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Removed routes are [] {{(pid=103811) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 10 14:31:53.592528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.663425 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e234ebc-40b6-4b25-9232-cd2769aade77 None None] New status for floating IP bec1b40f-2e80-44c7-a266-a325b8e10dc0: DOWN {{(pid=103812) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:31:53.764180 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d6ca0dc0-9e9e-4699-99bd-4a3634555e73 req-93e856b1-d807-4ffd-a262-ab6a6f7f4365 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1736577 Dec 10 14:31:53.818992 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.826087 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:53.947481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router dd925215-16e0-45b2-afbb-d31a45079594 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:54.035738 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:54.043571 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.044730 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7e76e8f7-0dd3-44fd-9e1a-ee05871556db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594 HTTP/1.1" status: 200 len: 700 time: 0.7411618 Dec 10 14:31:54.044887 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] Sync routers for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:54.048187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59346) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:54.055558 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:54.056243 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:54.059835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5f2bfaa8-00dc-4907-9d47-c129f714a08c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.083486 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ea4e1db5-0a63-49cb-8ea7-034ba198b88f tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=dd925215-16e0-45b2-afbb-d31a45079594 HTTP/1.1" status: 200 len: 205 time: 0.0340548 Dec 10 14:31:54.086162 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59348) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:54.105364 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2bfaa8-00dc-4907-9d47-c129f714a08c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Port': ['ID=e0d6c4d4-bb29-4126-ae6e-1e8300496ed6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:54.135103 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:54.158028 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5f2bfaa8-00dc-4907-9d47-c129f714a08c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.161705 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5f2bfaa8-00dc-4907-9d47-c129f714a08c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/e0d6c4d4-bb29-4126-ae6e-1e8300496ed6 HTTP/1.1" status: 204 len: 168 time: 1.4424753 Dec 10 14:31:54.164111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59350) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:54.173822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23cff653-c444-4b87-b9bf-6324fac60cac req-afa668b0-de90-4583-a228-eff553faf1d2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:54.177203 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-23cff653-c444-4b87-b9bf-6324fac60cac req-afa668b0-de90-4583-a228-eff553faf1d2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 946 time: 0.1272175 Dec 10 14:31:54.184352 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-af3d33a7-a2b3-4bb7-b7bd-ab5af8549df9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.206739 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:50Z', 'revision_number': 11, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:54.222313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a899af4b-47d8-4d8f-9fdf-7305258f6126 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:54.226796 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a899af4b-47d8-4d8f-9fdf-7305258f6126 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.0614030 Dec 10 14:31:54.227433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59352) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:54.249522 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] Checking router: dd925215-16e0-45b2-afbb-d31a45079594 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:54.268199 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] Routers {'dd925215-16e0-45b2-afbb-d31a45079594'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:54.269091 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['dd925215-16e0-45b2-afbb-d31a45079594'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:54.306535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93b9e30d-f939-4a12-9d0d-c23579bda512 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:54.311140 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-93b9e30d-f939-4a12-9d0d-c23579bda512 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.0825906 Dec 10 14:31:54.313112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59356) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:54.353555 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] Set router dd925215-16e0-45b2-afbb-d31a45079594 gateway port host: None {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:54.418561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d48e546-97ed-420a-8bbc-25152a80a713 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:54.420147 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d48e546-97ed-420a-8bbc-25152a80a713 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:54.420442 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:50Z', 'revision_number': 11, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:54.422056 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d48e546-97ed-420a-8bbc-25152a80a713 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:54.424099 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1d48e546-97ed-420a-8bbc-25152a80a713 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.1098492 Dec 10 14:31:54.428371 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59358) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:54.445281 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de0865a8-fa9f-40aa-8a11-444481a18edc req-c1c45218-0541-420e-9f17-1143b2262cf5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:54.446917 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-de0865a8-fa9f-40aa-8a11-444481a18edc req-c1c45218-0541-420e-9f17-1143b2262cf5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 946 time: 0.1346056 Dec 10 14:31:54.450742 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bba70c2-4cd2-45bf-a17e-15209f8605ee None None] The sync data for ids ['dd925215-16e0-45b2-afbb-d31a45079594'] in dv-neutron-821401-2-hyperv is: [{'id': 'dd925215-16e0-45b2-afbb-d31a45079594', 'name': 'tempest-RoutersTest-router-922062126', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:08Z', 'updated_at': '2021-12-10T14:31:50Z', 'revision_number': 11, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:54.523883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-1254a2bd-3e1e-4d03-b569-7e4baa9b43f5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet 96969e05-cd52-4417-8621-e93b266189f3 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:54.537298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1254a2bd-3e1e-4d03-b569-7e4baa9b43f5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.562579 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-de0865a8-fa9f-40aa-8a11-444481a18edc req-812ab9e9-9e54-4229-b9a0-db4b07213149 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=27b83861-1b2d-49f5-87e4-db2e023d9028&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0902891 Dec 10 14:31:54.589793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1254a2bd-3e1e-4d03-b569-7e4baa9b43f5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.672637 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1254a2bd-3e1e-4d03-b569-7e4baa9b43f5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.792702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-af3d33a7-a2b3-4bb7-b7bd-ab5af8549df9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.796407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-af3d33a7-a2b3-4bb7-b7bd-ab5af8549df9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.815125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1254a2bd-3e1e-4d03-b569-7e4baa9b43f5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.848855 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1254a2bd-3e1e-4d03-b569-7e4baa9b43f5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=96969e05-cd52-4417-8621-e93b266189f3,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:54.851011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1254a2bd-3e1e-4d03-b569-7e4baa9b43f5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.852282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [req-23cff653-c444-4b87-b9bf-6324fac60cac req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 70717ebc-79f9-48f1-b654-d7a76d6366d3 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:54.852636 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-23cff653-c444-4b87-b9bf-6324fac60cac req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.857156 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1254a2bd-3e1e-4d03-b569-7e4baa9b43f5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/96969e05-cd52-4417-8621-e93b266189f3 HTTP/1.1" status: 204 len: 168 time: 0.4257395 Dec 10 14:31:54.857270 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59362) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:54.861689 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a28476c-2e25-4a64-b41b-00ac71a0eb08 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:54.905146 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234a3fe4-1f3d-4db3-9d6b-2fcbd1fa4d33 req-773698b1-5345-4881-b39f-cd08b4308a7c tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:54.906894 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-234a3fe4-1f3d-4db3-9d6b-2fcbd1fa4d33 req-773698b1-5345-4881-b39f-cd08b4308a7c tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.0614042 Dec 10 14:31:54.943716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-af3d33a7-a2b3-4bb7-b7bd-ab5af8549df9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.944266 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af3d33a7-a2b3-4bb7-b7bd-ab5af8549df9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Fanout notify agent at l3_agent the message router_deleted on router dd925215-16e0-45b2-afbb-d31a45079594 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:31:54.952177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-af3d33a7-a2b3-4bb7-b7bd-ab5af8549df9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:54.953318 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-af3d33a7-a2b3-4bb7-b7bd-ab5af8549df9 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594 HTTP/1.1" status: 204 len: 168 time: 0.8654668 Dec 10 14:31:54.961765 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59364) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:54.970347 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6ac5c002-a340-4b96-bce2-73e191745ce3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-209125739', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:54.972422 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-c32998e4-369f-4842-8534-31b78986686d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Deleting subnet a43962e0-cf84-44c8-8faa-546aa0d281c8 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:54.983958 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c32998e4-369f-4842-8534-31b78986686d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.017361 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-234a3fe4-1f3d-4db3-9d6b-2fcbd1fa4d33 req-cfed799c-c056-472f-930a-45f4c9218bef tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1037850 Dec 10 14:31:55.039626 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-23cff653-c444-4b87-b9bf-6324fac60cac req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port 70717ebc-79f9-48f1-b654-d7a76d6366d3, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=70717ebc-79f9-48f1-b654-d7a76d6366d3,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:55.040001 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-23cff653-c444-4b87-b9bf-6324fac60cac req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.054124 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c32998e4-369f-4842-8534-31b78986686d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.077914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [req-23cff653-c444-4b87-b9bf-6324fac60cac req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 70717ebc-79f9-48f1-b654-d7a76d6366d3 owned by compute:nova {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:55.078459 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6ac5c002-a340-4b96-bce2-73e191745ce3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.079738 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6ac5c002-a340-4b96-bce2-73e191745ce3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.145993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6ac5c002-a340-4b96-bce2-73e191745ce3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.186102 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6ac5c002-a340-4b96-bce2-73e191745ce3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.208381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c32998e4-369f-4842-8534-31b78986686d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.251036 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6ac5c002-a340-4b96-bce2-73e191745ce3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.252585 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6ac5c002-a340-4b96-bce2-73e191745ce3 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.2895007 Dec 10 14:31:55.255284 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59366) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.264274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-55d7bd89-8436-4924-be65-5d93659020a7 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Request body: {'router': {'admin_state_up': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:31:55.453238 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c32998e4-369f-4842-8534-31b78986686d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.489812 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c32998e4-369f-4842-8534-31b78986686d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.493317 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c32998e4-369f-4842-8534-31b78986686d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/a43962e0-cf84-44c8-8faa-546aa0d281c8 HTTP/1.1" status: 204 len: 168 time: 0.6350262 Dec 10 14:31:55.494194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32998e4-369f-4842-8534-31b78986686d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Subnet': ['ID=a43962e0-cf84-44c8-8faa-546aa0d281c8,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:55.495973 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59368) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.506387 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-23cff653-c444-4b87-b9bf-6324fac60cac req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.537441 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-172e3c31-5d4e-45cc-a39d-16c454ba0593 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0402617 Dec 10 14:31:55.540197 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59370) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.548299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2524b8c2-6f72-47e3-adce-7178bc2d5c59 None None] Network cdc891b5-3e75-4d62-a51b-0f84be9af82d requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:31:55.589899 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49352fe3-ae11-4e62-809f-ba5ccf89e640 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:55.591376 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-49352fe3-ae11-4e62-809f-ba5ccf89e640 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0502522 Dec 10 14:31:55.594708 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59374) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.619194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-55d7bd89-8436-4924-be65-5d93659020a7 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-551663', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-549470', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30284'] for router, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.622742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=70717ebc-79f9-48f1-b654-d7a76d6366d3,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:55.662989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60feded-89b9-4b63-8c7b-ae40098d36bb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:55.678565 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c60feded-89b9-4b63-8c7b-ae40098d36bb tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0720344 Dec 10 14:31:55.678565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59376) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.679671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-f5b43524-c6da-4ca8-bea1-7279adba564e None None] Provisioning complete for port db953515-c08a-42c6-bf66-ae650ee7d2ab triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:31:55.679671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f5b43524-c6da-4ca8-bea1-7279adba564e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.685747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-23cff653-c444-4b87-b9bf-6324fac60cac req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] No DVR routers for this DVR port 70717ebc-79f9-48f1-b654-d7a76d6366d3 on host hv-neutron-8214 {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:55.689074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-23cff653-c444-4b87-b9bf-6324fac60cac req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.697831 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-23cff653-c444-4b87-b9bf-6324fac60cac req-3d8e093b-4a21-4193-8909-ebeca5cd2a92 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "DELETE /v2.0/ports/70717ebc-79f9-48f1-b654-d7a76d6366d3 HTTP/1.1" status: 204 len: 173 time: 1.5062432 Dec 10 14:31:55.697831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'name': 'network-vif-deleted', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:31:55.697831 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d18047a5-ffff-4e37-a686-6ac878917d34" -d '{"events": [{"server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "name": "network-vif-deleted", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:31:55.719686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-55d7bd89-8436-4924-be65-5d93659020a7 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-551652', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-551677', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-549463'] for router, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.748738 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a011ed9c-15d1-4fcf-a769-9ffe0d7c6a02 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0730746 Dec 10 14:31:55.749118 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59380) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.783534 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-55c21f1e-d5e6-4c59-90b9-6228716e293c req-f158d9e2-b976-4224-84e2-93f82592173b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=6086f4ed-571f-44d6-82fb-d4a909f7daba HTTP/1.1" status: 200 len: 210 time: 0.0692751 Dec 10 14:31:55.788204 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:31:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47a42e17-2c78-4bbc-8280-1ac949c863a9 x-openstack-request-id: req-47a42e17-2c78-4bbc-8280-1ac949c863a9 {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:31:55.788564 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6086f4ed-571f-44d6-82fb-d4a909f7daba", "name": "network-vif-deleted", "tag": "70717ebc-79f9-48f1-b654-d7a76d6366d3", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:31:55.788881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-47a42e17-2c78-4bbc-8280-1ac949c863a9 {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:31:55.789367 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6086f4ed-571f-44d6-82fb-d4a909f7daba', 'name': 'network-vif-deleted', 'tag': '70717ebc-79f9-48f1-b654-d7a76d6366d3', 'status': 'completed', 'code': 200} Dec 10 14:31:55.798563 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-c9d2b5ff-7add-403d-a696-7993e8d64774 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:55.799330 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c9d2b5ff-7add-403d-a696-7993e8d64774 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:55.800335 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b228512-2db8-4932-94bb-265b92faea22 None None] DHCP port deletion for cdc891b5-3e75-4d62-a51b-0f84be9af82d request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:31:55.802679 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c9d2b5ff-7add-403d-a696-7993e8d64774 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/e0d6c4d4-bb29-4126-ae6e-1e8300496ed6 HTTP/1.1" status: 404 len: 333 time: 0.0434618 Dec 10 14:31:55.807261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59382) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.840764 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-36da6aab-580a-4733-a25e-614091c2506f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:55.841238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-36da6aab-580a-4733-a25e-614091c2506f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:55.845043 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-36da6aab-580a-4733-a25e-614091c2506f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/96969e05-cd52-4417-8621-e93b266189f3 HTTP/1.1" status: 404 len: 337 time: 0.0365956 Dec 10 14:31:55.848120 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59384) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.856671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2b228512-2db8-4932-94bb-265b92faea22 None None] Deleting port db953515-c08a-42c6-bf66-ae650ee7d2ab {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:55.857076 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2b228512-2db8-4932-94bb-265b92faea22 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.874915 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-9901605b-f2d9-436b-826d-a4b68934e481 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:55.876262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9901605b-f2d9-436b-826d-a4b68934e481 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:55.881043 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9901605b-f2d9-436b-826d-a4b68934e481 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/a43962e0-cf84-44c8-8faa-546aa0d281c8 HTTP/1.1" status: 404 len: 337 time: 0.0295763 Dec 10 14:31:55.881324 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59386) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.904540 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-1cd7e6eb-3dc0-45b9-a568-2114dbca9249 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:55.906681 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1cd7e6eb-3dc0-45b9-a568-2114dbca9249 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:55.911559 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1cd7e6eb-3dc0-45b9-a568-2114dbca9249 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/8124e0f6-d7c6-4fc1-9252-3b023ee46c6e HTTP/1.1" status: 404 len: 333 time: 0.0268064 Dec 10 14:31:55.912279 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59388) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.926588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-2b228512-2db8-4932-94bb-265b92faea22 None None] For port db953515-c08a-42c6-bf66-ae650ee7d2ab, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=db953515-c08a-42c6-bf66-ae650ee7d2ab,segment=NetworkSegment(292f222e-ec8a-4b09-987f-5c8bd8bc0449),segment_id=292f222e-ec8a-4b09-987f-5c8bd8bc0449)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:55.928020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2b228512-2db8-4932-94bb-265b92faea22 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:55.938336 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-c8cfe6f5-3d1b-401b-b0f3-0212ce1031f4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:55.938798 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c8cfe6f5-3d1b-401b-b0f3-0212ce1031f4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:55.939876 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-2b228512-2db8-4932-94bb-265b92faea22 None None] Calling delete_port for db953515-c08a-42c6-bf66-ae650ee7d2ab owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:55.941852 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c8cfe6f5-3d1b-401b-b0f3-0212ce1031f4 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/8ad5c423-8c69-4e77-9bd4-4cc00a29ff61 HTTP/1.1" status: 404 len: 337 time: 0.0285146 Dec 10 14:31:55.944507 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59390) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:55.954221 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55d7bd89-8436-4924-be65-5d93659020a7 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Router 6879c367-c96c-4234-9990-26722e6c957e is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:31:55.973730 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-d1b09087-7b15-452b-b2ed-59414c18bcaa tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:55.974181 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d1b09087-7b15-452b-b2ed-59414c18bcaa tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:55.979507 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d1b09087-7b15-452b-b2ed-59414c18bcaa tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/faea7f55-0c4e-422c-902c-d6debcc18c6b HTTP/1.1" status: 404 len: 337 time: 0.0318089 Dec 10 14:31:55.980344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59392) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.005344 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-73bb39e1-739b-4811-b59a-76ce4728caf6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.006198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-73bb39e1-739b-4811-b59a-76ce4728caf6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.009323 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-73bb39e1-739b-4811-b59a-76ce4728caf6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/67b96e5e-7c35-48fc-ae81-fc7cec1827e7 HTTP/1.1" status: 404 len: 333 time: 0.0279605 Dec 10 14:31:56.011904 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59394) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.043545 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-d6117df8-4be2-4fc0-9103-13f200831029 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.044180 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d6117df8-4be2-4fc0-9103-13f200831029 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.047678 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d6117df8-4be2-4fc0-9103-13f200831029 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/1c664183-e9b0-41a3-b001-d85105118369 HTTP/1.1" status: 404 len: 337 time: 0.0341702 Dec 10 14:31:56.050269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59398) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.081298 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-cbb005e2-c629-486f-a7a5-ee47381918e6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.082033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cbb005e2-c629-486f-a7a5-ee47381918e6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.084881 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cbb005e2-c629-486f-a7a5-ee47381918e6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/82897941-f3a3-48d3-9e59-660221fe85ab HTTP/1.1" status: 404 len: 337 time: 0.0334666 Dec 10 14:31:56.087498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59400) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.089534 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-2b228512-2db8-4932-94bb-265b92faea22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:56.095790 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55d7bd89-8436-4924-be65-5d93659020a7 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:56.103203 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-55d7bd89-8436-4924-be65-5d93659020a7 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:56.104379 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-55d7bd89-8436-4924-be65-5d93659020a7 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "PUT /v2.0/routers/6879c367-c96c-4234-9990-26722e6c957e HTTP/1.1" status: 200 len: 693 time: 0.8475316 Dec 10 14:31:56.106978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59402) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.116608 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] Sync routers for ids ['6879c367-c96c-4234-9990-26722e6c957e'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:56.122604 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b228512-2db8-4932-94bb-265b92faea22 None None] No DVR routers for this DVR port db953515-c08a-42c6-bf66-ae650ee7d2ab on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:31:56.128102 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-c5407c8f-e0cb-4bb3-932f-41c01a568356 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.128822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c5407c8f-e0cb-4bb3-932f-41c01a568356 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.137800 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c5407c8f-e0cb-4bb3-932f-41c01a568356 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/dc1759f7-0181-42e8-bec9-eb728ff441e1 HTTP/1.1" status: 404 len: 333 time: 0.0488446 Dec 10 14:31:56.156340 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b228512-2db8-4932-94bb-265b92faea22 None None] Pushing event deleted for resources: {'Port': ['ID=db953515-c08a-42c6-bf66-ae650ee7d2ab,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:56.162595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59404) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.171844 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] Routers {'6879c367-c96c-4234-9990-26722e6c957e'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:56.172692 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6879c367-c96c-4234-9990-26722e6c957e'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:56.196687 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1ce706-d2db-43ce-b498-1017db2947f5 req-9d8d86f1-3aee-467c-a083-31224a8e17bc tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:56.204748 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-aa1ce706-d2db-43ce-b498-1017db2947f5 req-9d8d86f1-3aee-467c-a083-31224a8e17bc tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.0653312 Dec 10 14:31:56.219763 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-5699e86b-2f6a-42f8-8acc-1e1622ab2d8e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.220337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5699e86b-2f6a-42f8-8acc-1e1622ab2d8e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.225832 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5699e86b-2f6a-42f8-8acc-1e1622ab2d8e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/e33d88af-109d-47b0-9ff8-cd30ad64d35b HTTP/1.1" status: 404 len: 337 time: 0.0603547 Dec 10 14:31:56.226087 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59406) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.240911 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c0369900-f66b-4acb-90de-a46f42172574 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/routers/6879c367-c96c-4234-9990-26722e6c957e HTTP/1.1" status: 200 len: 699 time: 0.1327503 Dec 10 14:31:56.244541 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59408) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.253027 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] Set router 6879c367-c96c-4234-9990-26722e6c957e gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:56.257868 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-87c01666-be65-4cbd-8d62-db6806efa928 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.258395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-87c01666-be65-4cbd-8d62-db6806efa928 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.261897 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-87c01666-be65-4cbd-8d62-db6806efa928 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/6dd9f3df-7ea2-4019-98ce-7e27ce7f9d2c HTTP/1.1" status: 404 len: 337 time: 0.0343289 Dec 10 14:31:56.267176 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59410) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.286197 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2e56995b-03e5-4070-b00b-25487d10da96 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=6879c367-c96c-4234-9990-26722e6c957e HTTP/1.1" status: 200 len: 205 time: 0.0408223 Dec 10 14:31:56.288698 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59412) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.290460 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-1e551fa4-cb48-4ef6-b6b1-f7165d4b938e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.291006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1e551fa4-cb48-4ef6-b6b1-f7165d4b938e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.294083 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1e551fa4-cb48-4ef6-b6b1-f7165d4b938e tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/568e9d99-040f-47f0-a44d-8cfc6266e033 HTTP/1.1" status: 404 len: 333 time: 0.0260308 Dec 10 14:31:56.297175 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59414) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.311943 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6879c367-c96c-4234-9990-26722e6c957e', 'name': 'tempest-RoutersTest-router-209125739', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:55Z', 'updated_at': '2021-12-10T14:31:55Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:56.322500 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-aa1ce706-d2db-43ce-b498-1017db2947f5 req-86c72ca5-8d4e-4d6a-a538-6474ebe2f9cc tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1162648 Dec 10 14:31:56.338879 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] Checking router: 6879c367-c96c-4234-9990-26722e6c957e for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:31:56.350196 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] Routers {'6879c367-c96c-4234-9990-26722e6c957e'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:56.350814 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['6879c367-c96c-4234-9990-26722e6c957e'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:56.358423 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-c1f2365d-0918-404e-a1d9-a6aacbaefc98 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.358890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c1f2365d-0918-404e-a1d9-a6aacbaefc98 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.361931 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c1f2365d-0918-404e-a1d9-a6aacbaefc98 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/12abe0f7-269a-43bb-b17c-2229d58e220c HTTP/1.1" status: 404 len: 337 time: 0.0638428 Dec 10 14:31:56.364807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59416) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.392658 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bdfee391-3e79-481b-900b-7d2dc812bd64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:56.395045 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-6e290ac3-143c-451a-b12b-a2f71c424b73 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.395616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6e290ac3-143c-451a-b12b-a2f71c424b73 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.398728 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6e290ac3-143c-451a-b12b-a2f71c424b73 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/e958ee16-eed1-4b00-aa2b-744bf60e902b HTTP/1.1" status: 404 len: 333 time: 0.0328929 Dec 10 14:31:56.401353 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59418) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.430176 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c4ca1fd-95e1-430c-82f8-a341785340d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.430893 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2c4ca1fd-95e1-430c-82f8-a341785340d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.434090 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2c4ca1fd-95e1-430c-82f8-a341785340d5 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/03d2b436-cf6c-409b-a7fc-6483f1285ff0 HTTP/1.1" status: 404 len: 337 time: 0.0317733 Dec 10 14:31:56.438183 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] Set router 6879c367-c96c-4234-9990-26722e6c957e gateway port host: None {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:31:56.445057 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59420) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.468902 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-75ca9350-e5e9-4d86-a013-afce10f2ac17 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.469494 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-75ca9350-e5e9-4d86-a013-afce10f2ac17 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.477733 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-75ca9350-e5e9-4d86-a013-afce10f2ac17 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/2b50bbf1-32b1-49bd-8448-39c99e248803 HTTP/1.1" status: 404 len: 333 time: 0.0264375 Dec 10 14:31:56.479593 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59422) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.496576 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6879c367-c96c-4234-9990-26722e6c957e', 'name': 'tempest-RoutersTest-router-209125739', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:55Z', 'updated_at': '2021-12-10T14:31:55Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:56.505895 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-d2213f72-66cb-483d-9fbd-b77d2ba97fce tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.506322 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d2213f72-66cb-483d-9fbd-b77d2ba97fce tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.511997 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d2213f72-66cb-483d-9fbd-b77d2ba97fce tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/4efc5a0d-e845-438e-bbdd-a8b2bfcc3f27 HTTP/1.1" status: 404 len: 337 time: 0.0289619 Dec 10 14:31:56.512316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59424) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.527096 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ee62ff7-ec85-451e-9a9e-a33e5fef6db1 None None] The sync data for ids ['6879c367-c96c-4234-9990-26722e6c957e'] in dv-neutron-821401-2-hyperv is: [{'id': '6879c367-c96c-4234-9990-26722e6c957e', 'name': 'tempest-RoutersTest-router-209125739', 'tenant_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:31:55Z', 'updated_at': '2021-12-10T14:31:55Z', 'revision_number': 2, 'project_id': 'f89dac3cc3eb4260b99c6e932dee7a4f', 'gw_port_host': None}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:31:56.536962 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-968ec012-0b27-41e8-8666-99f6d1140a18 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.537591 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-968ec012-0b27-41e8-8666-99f6d1140a18 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.543002 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-968ec012-0b27-41e8-8666-99f6d1140a18 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/eb2c4627-4ceb-4bc1-bc86-02cc548051a0 HTTP/1.1" status: 404 len: 333 time: 0.0273168 Dec 10 14:31:56.543208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59426) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.561030 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bdfee391-3e79-481b-900b-7d2dc812bd64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:56.563605 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bdfee391-3e79-481b-900b-7d2dc812bd64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:56.569438 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-8667c42f-9195-4b99-8508-95b474f15c2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.569903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8667c42f-9195-4b99-8508-95b474f15c2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.575294 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8667c42f-9195-4b99-8508-95b474f15c2c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/4ae0c946-e656-46b3-8e50-e07a5a89f88f HTTP/1.1" status: 404 len: 337 time: 0.0288420 Dec 10 14:31:56.575766 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59428) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.604482 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-0316a069-6cf0-48ed-b3e1-90bbea2cf520 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.605037 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0316a069-6cf0-48ed-b3e1-90bbea2cf520 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.608143 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0316a069-6cf0-48ed-b3e1-90bbea2cf520 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/b7a29473-1427-4db6-89f9-e129b3657aa5 HTTP/1.1" status: 404 len: 333 time: 0.0317452 Dec 10 14:31:56.610802 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59430) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.644324 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-5abe2696-9355-4b7a-8e81-03c435869452 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.646234 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5abe2696-9355-4b7a-8e81-03c435869452 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.648107 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5abe2696-9355-4b7a-8e81-03c435869452 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/8a90ebc2-a2fe-409c-ac33-76ba6c30ed7c HTTP/1.1" status: 404 len: 337 time: 0.0359299 Dec 10 14:31:56.650700 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59432) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.675227 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c855870-095a-4720-a3e2-4c2342e49c73 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.675923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2c855870-095a-4720-a3e2-4c2342e49c73 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.679163 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2c855870-095a-4720-a3e2-4c2342e49c73 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/f99f975a-dd8a-46d0-9f74-f7008e84b5b4 HTTP/1.1" status: 404 len: 333 time: 0.0275044 Dec 10 14:31:56.681828 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59434) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.694672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bdfee391-3e79-481b-900b-7d2dc812bd64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:56.695228 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bdfee391-3e79-481b-900b-7d2dc812bd64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Fanout notify agent at l3_agent the message router_deleted on router 6879c367-c96c-4234-9990-26722e6c957e {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:31:56.704373 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-bdfee391-3e79-481b-900b-7d2dc812bd64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:56.708496 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bdfee391-3e79-481b-900b-7d2dc812bd64 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/6879c367-c96c-4234-9990-26722e6c957e HTTP/1.1" status: 204 len: 168 time: 0.4158852 Dec 10 14:31:56.708860 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59436) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.715067 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-efd74a2b-50e8-47f3-b323-6fa8eb6b3c8b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.715815 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-efd74a2b-50e8-47f3-b323-6fa8eb6b3c8b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.722434 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-efd74a2b-50e8-47f3-b323-6fa8eb6b3c8b tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/14b38d17-838e-42f5-9950-b658bd6b499c HTTP/1.1" status: 404 len: 337 time: 0.0375376 Dec 10 14:31:56.725990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59438) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.734048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device db953515-c08a-42c6-bf66-ae650ee7d2ab no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:56.753023 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-eeb1afc5-2ed8-4e87-8c06-7b6ce0b3c8d2 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=6879c367-c96c-4234-9990-26722e6c957e HTTP/1.1" status: 200 len: 205 time: 0.0430391 Dec 10 14:31:56.755774 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59440) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.757768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: db953515-c08a-42c6-bf66-ae650ee7d2ab {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:56.758121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device db953515-c08a-42c6-bf66-ae650ee7d2ab not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:56.773744 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-4bfd3d46-9283-41ac-a39f-3a407398dbc9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.774243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4bfd3d46-9283-41ac-a39f-3a407398dbc9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.781109 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4bfd3d46-9283-41ac-a39f-3a407398dbc9 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/4be0af70-c176-4c45-aad4-5123f1642584 HTTP/1.1" status: 404 len: 337 time: 0.0397737 Dec 10 14:31:56.781726 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59442) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.801821 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-c5a4eb40-1a8f-4069-8927-0809d4c5cdec tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] delete failed (client error): The resource could not be found. Dec 10 14:31:56.805470 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c5a4eb40-1a8f-4069-8927-0809d4c5cdec tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/6879c367-c96c-4234-9990-26722e6c957e HTTP/1.1" status: 404 len: 336 time: 0.0459614 Dec 10 14:31:56.806316 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59444) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.817812 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-c5306c4d-63cd-4d24-b955-236dcace121a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.818057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c5306c4d-63cd-4d24-b955-236dcace121a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.821169 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c5306c4d-63cd-4d24-b955-236dcace121a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/d0d3bf3b-1f65-4563-9d2b-ba7f63861762 HTTP/1.1" status: 404 len: 333 time: 0.0383677 Dec 10 14:31:56.824213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59448) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.839712 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-fbb86fc8-8f0b-46a0-9ba6-20dff4799fce tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.840179 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fbb86fc8-8f0b-46a0-9ba6-20dff4799fce tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.843489 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fbb86fc8-8f0b-46a0-9ba6-20dff4799fce tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/9aabfbd5-ccd5-46d5-bfae-7b4051632ae9 HTTP/1.1" status: 404 len: 337 time: 0.0361526 Dec 10 14:31:56.846304 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59450) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.856306 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-aa80178a-9776-4bfa-aeff-340241359d71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.857078 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aa80178a-9776-4bfa-aeff-340241359d71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.860849 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-aa80178a-9776-4bfa-aeff-340241359d71 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/fe79d879-8a72-4292-ad7b-fbbfbd6c4dc6 HTTP/1.1" status: 404 len: 337 time: 0.0358846 Dec 10 14:31:56.861532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59452) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.876443 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59454) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.884389 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-027d1492-72db-45f5-8fa9-92310ed54b8c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.884816 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-027d1492-72db-45f5-8fa9-92310ed54b8c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.887946 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-027d1492-72db-45f5-8fa9-92310ed54b8c tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/bdb71fa9-24b8-43a7-870b-8e041ade82e5 HTTP/1.1" status: 404 len: 337 time: 0.0404477 Dec 10 14:31:56.891049 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59456) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.907697 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-476d6c80-fce1-4157-8474-e21921dcae34 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.908089 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-476d6c80-fce1-4157-8474-e21921dcae34 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.913509 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-476d6c80-fce1-4157-8474-e21921dcae34 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/1940732e-9096-48d6-923e-c735ad6cf8f9 HTTP/1.1" status: 404 len: 337 time: 0.0334859 Dec 10 14:31:56.913692 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59458) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.932020 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-ac38d384-257a-42ef-9513-98657ef1c5db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.932473 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ac38d384-257a-42ef-9513-98657ef1c5db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.935483 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-91c4d40e-746c-4335-90ed-d0bb647c9f89 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.935729 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ac38d384-257a-42ef-9513-98657ef1c5db tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/fe3af855-3e1f-467b-9262-60423a9eaedc HTTP/1.1" status: 404 len: 337 time: 0.0399439 Dec 10 14:31:56.936545 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-91c4d40e-746c-4335-90ed-d0bb647c9f89 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.938710 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59460) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.939662 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-91c4d40e-746c-4335-90ed-d0bb647c9f89 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/8b97ccd1-1856-4fba-aa18-eefbdd7b4e58 HTTP/1.1" status: 404 len: 333 time: 0.0250690 Dec 10 14:31:56.942176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59462) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.967319 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-a0d731b2-dc01-4e41-9145-137c050a1af7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.967767 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a0d731b2-dc01-4e41-9145-137c050a1af7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.970831 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a0d731b2-dc01-4e41-9145-137c050a1af7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/c3586ecc-e9f2-4723-911c-1c07785f6890 HTTP/1.1" status: 404 len: 337 time: 0.0277414 Dec 10 14:31:56.971207 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-cd44569c-d514-49d1-bede-1496fa334e55 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.971656 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cd44569c-d514-49d1-bede-1496fa334e55 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:56.973473 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59464) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.975277 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cd44569c-d514-49d1-bede-1496fa334e55 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/38f4de8f-eb2e-4d26-a0ba-fc87e5ed144d HTTP/1.1" status: 404 len: 337 time: 0.0354524 Dec 10 14:31:56.979805 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59466) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:56.998232 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-c1e800d6-507e-4a30-a536-146adaf238c6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:56.999189 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c1e800d6-507e-4a30-a536-146adaf238c6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.002288 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c1e800d6-507e-4a30-a536-146adaf238c6 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/f0d5e6c7-fdb1-4e45-816f-fb86f5a294cf HTTP/1.1" status: 404 len: 337 time: 0.0279591 Dec 10 14:31:57.004806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59468) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.013104 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68c8c2e2-a7bc-46c5-8c4a-112a77bdc78c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:57.016761 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-410b5adc-1187-48d0-8e8d-c364ccb8d343 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=dd925215-16e0-45b2-afbb-d31a45079594 HTTP/1.1" status: 200 len: 205 time: 0.0360863 Dec 10 14:31:57.020841 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59470) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.027440 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-6b453ea8-d664-401f-aa3d-b3270fca01a8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.028011 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6b453ea8-d664-401f-aa3d-b3270fca01a8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.031686 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6b453ea8-d664-401f-aa3d-b3270fca01a8 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/a58e708c-50a4-4135-8c1f-8d028c585717 HTTP/1.1" status: 404 len: 333 time: 0.0257027 Dec 10 14:31:57.034029 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59472) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.064017 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-9cd0e0df-1e29-4d2d-8132-66f94949b498 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.064486 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9cd0e0df-1e29-4d2d-8132-66f94949b498 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.067583 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9cd0e0df-1e29-4d2d-8132-66f94949b498 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/48ae817e-c6a9-4f5d-9b6c-c87aab128156 HTTP/1.1" status: 404 len: 337 time: 0.0326240 Dec 10 14:31:57.070115 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59474) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.073730 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-71211632-2e6e-4766-98ec-9327cc5e3362 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] delete failed (client error): The resource could not be found. Dec 10 14:31:57.074756 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-71211632-2e6e-4766-98ec-9327cc5e3362 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/dd925215-16e0-45b2-afbb-d31a45079594 HTTP/1.1" status: 404 len: 336 time: 0.0527465 Dec 10 14:31:57.079010 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59476) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.086965 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68c8c2e2-a7bc-46c5-8c4a-112a77bdc78c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:57.107952 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-84c46655-a2b0-4f35-a24d-3b84c38aa2bf tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.108416 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-84c46655-a2b0-4f35-a24d-3b84c38aa2bf tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.111556 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-84c46655-a2b0-4f35-a24d-3b84c38aa2bf tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/b92e4239-8c60-49f3-82cc-fa2b69fdb4bf HTTP/1.1" status: 404 len: 337 time: 0.0405159 Dec 10 14:31:57.117183 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59478) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.126814 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-57e30527-90ed-471b-bdc5-c8c54a309e0a tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=29bfcc86-c895-4ac7-899f-a63cdcb7f25e HTTP/1.1" status: 200 len: 205 time: 0.0467329 Dec 10 14:31:57.129072 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59480) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.152347 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4ffe7134-beb4-4433-b223-0e35d811da4d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports?device_id=368ea4de-3a8a-4a6b-b781-39affd032ba1 HTTP/1.1" status: 200 len: 205 time: 0.0330906 Dec 10 14:31:57.154677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59482) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.168677 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-dca46777-798b-4950-a7be-54bcd0317215 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] delete failed (client error): The resource could not be found. Dec 10 14:31:57.170741 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dca46777-798b-4950-a7be-54bcd0317215 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/29bfcc86-c895-4ac7-899f-a63cdcb7f25e HTTP/1.1" status: 404 len: 336 time: 0.0400624 Dec 10 14:31:57.173065 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59484) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.197345 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-26867557-b1db-4552-9bb5-987495512226 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] delete failed (client error): The resource could not be found. Dec 10 14:31:57.199241 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-26867557-b1db-4552-9bb5-987495512226 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/routers/368ea4de-3a8a-4a6b-b781-39affd032ba1 HTTP/1.1" status: 404 len: 336 time: 0.0425842 Dec 10 14:31:57.203888 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-142f3dc0-95e2-4994-804f-f19fe602b8a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.204338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-142f3dc0-95e2-4994-804f-f19fe602b8a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.206940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59486) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.210031 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-142f3dc0-95e2-4994-804f-f19fe602b8a0 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/47d3c035-cc5c-46f9-b04b-7bedd04839eb HTTP/1.1" status: 404 len: 337 time: 0.0336251 Dec 10 14:31:57.210280 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59488) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.237114 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-40291e51-e416-4256-9c11-323d4a3b4127 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=a4772d7e-f186-4631-b2e3-2bb145bd2322 HTTP/1.1" status: 200 len: 205 time: 0.0257239 Dec 10 14:31:57.239223 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-a65e6ff2-6747-4726-8ab8-7339f9882b0d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.239669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59490) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.239844 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a65e6ff2-6747-4726-8ab8-7339f9882b0d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.245946 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a65e6ff2-6747-4726-8ab8-7339f9882b0d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/3f1b52c4-4951-4b16-bcdc-430200350dcd HTTP/1.1" status: 404 len: 337 time: 0.0380082 Dec 10 14:31:57.246961 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59492) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.286644 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-7aff61ec-9cda-4eff-bec7-237009151aa4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] delete failed (client error): The resource could not be found. Dec 10 14:31:57.287709 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7aff61ec-9cda-4eff-bec7-237009151aa4 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/a4772d7e-f186-4631-b2e3-2bb145bd2322 HTTP/1.1" status: 404 len: 336 time: 0.0471034 Dec 10 14:31:57.291197 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59494) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.303826 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ce75686a-8125-4004-8f7e-377fc0c1202a tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "GET /v2.0/ports?device_id=6f770f17-285d-418a-814b-c2e1570f3be5 HTTP/1.1" status: 200 len: 205 time: 0.0555208 Dec 10 14:31:57.305871 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59496) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.321509 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-93e29fb9-a58c-4796-9b9b-ff2e1119b557 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd HTTP/1.1" status: 200 len: 205 time: 0.0290105 Dec 10 14:31:57.328100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59498) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.335672 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68c8c2e2-a7bc-46c5-8c4a-112a77bdc78c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:57.348110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-68c8c2e2-a7bc-46c5-8c4a-112a77bdc78c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:57.348110 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-68c8c2e2-a7bc-46c5-8c4a-112a77bdc78c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/security-groups/27b83861-1b2d-49f5-87e4-db2e023d9028 HTTP/1.1" status: 204 len: 168 time: 0.4770298 Dec 10 14:31:57.356441 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-09815057-5f10-4027-87c3-bbf34aa215be tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] delete failed (client error): The resource could not be found. Dec 10 14:31:57.362385 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-09815057-5f10-4027-87c3-bbf34aa215be tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/routers/6f770f17-285d-418a-814b-c2e1570f3be5 HTTP/1.1" status: 404 len: 336 time: 0.0528269 Dec 10 14:31:57.363049 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59504) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.375505 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-94cd6214-64c8-4aa4-b9b4-72b80dcfa865 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] delete failed (client error): The resource could not be found. Dec 10 14:31:57.377270 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-94cd6214-64c8-4aa4-b9b4-72b80dcfa865 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/a6f7f5ff-7d1d-42f5-b110-8260b01c6bdd HTTP/1.1" status: 404 len: 336 time: 0.0474765 Dec 10 14:31:57.381643 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68c8c2e2-a7bc-46c5-8c4a-112a77bdc78c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=27b83861-1b2d-49f5-87e4-db2e023d9028,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:57.385009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59506) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.402199 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-c2cb2574-2c8f-42ff-8f7d-19a30a872d8d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.402526 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c2cb2574-2c8f-42ff-8f7d-19a30a872d8d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.408972 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c2cb2574-2c8f-42ff-8f7d-19a30a872d8d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/0d48bc55-e0ba-4d31-986a-e5327256a5c6 HTTP/1.1" status: 404 len: 337 time: 0.0433767 Dec 10 14:31:57.409661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59508) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.416984 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-b6049355-b45e-4655-afa0-c34610813a25 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.417436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b6049355-b45e-4655-afa0-c34610813a25 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.421864 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b6049355-b45e-4655-afa0-c34610813a25 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/e5476e8f-088f-4ba5-ac74-99f1ba9f36c6 HTTP/1.1" status: 404 len: 337 time: 0.0358353 Dec 10 14:31:57.425945 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59510) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.440068 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-2710da03-7059-43ec-8343-7e3f7cb28420 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.440841 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2710da03-7059-43ec-8343-7e3f7cb28420 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.450044 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2710da03-7059-43ec-8343-7e3f7cb28420 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/c083f621-b958-4f89-91b9-35eb3797afdf HTTP/1.1" status: 404 len: 337 time: 0.0388579 Dec 10 14:31:57.450830 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59512) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.451435 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59514) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.483904 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5ddc4d2e-4afc-42e7-a300-287a5bf53047 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=d2ee67c4-432f-4d44-92f7-f652b9c8f167 HTTP/1.1" status: 200 len: 205 time: 0.0565531 Dec 10 14:31:57.487648 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59516) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.521228 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-b60fd0a9-edab-40e2-8993-8237cbccb159 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.521895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b60fd0a9-edab-40e2-8993-8237cbccb159 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.527331 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b60fd0a9-edab-40e2-8993-8237cbccb159 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/23fa6c92-49fd-413d-80d1-47d83bdfcfb9 HTTP/1.1" status: 404 len: 333 time: 0.0666211 Dec 10 14:31:57.527578 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59518) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.530982 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-74d87e9d-799b-441b-9468-b4f1129e2074 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] delete failed (client error): The resource could not be found. Dec 10 14:31:57.532019 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-74d87e9d-799b-441b-9468-b4f1129e2074 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/d2ee67c4-432f-4d44-92f7-f652b9c8f167 HTTP/1.1" status: 404 len: 336 time: 0.0438361 Dec 10 14:31:57.536075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59520) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.563755 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-d322a181-9493-492f-8369-7004f4a4b604 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.564213 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d322a181-9493-492f-8369-7004f4a4b604 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.569973 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d322a181-9493-492f-8369-7004f4a4b604 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/aa8f6eca-77cd-4b2a-abe0-47af4532c196 HTTP/1.1" status: 404 len: 337 time: 0.0386460 Dec 10 14:31:57.570084 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e389d38-dfe1-4e6b-b0d4-473026e74312 req-6d5433be-7149-43bb-b5f2-1d3ec66a2042 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:57.570220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59522) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.571191 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4e389d38-dfe1-4e6b-b0d4-473026e74312 req-6d5433be-7149-43bb-b5f2-1d3ec66a2042 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.1308403 Dec 10 14:31:57.572239 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f19826e-14be-4b39-a65a-7877727ec85a tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.572665 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9f19826e-14be-4b39-a65a-7877727ec85a tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.577472 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9f19826e-14be-4b39-a65a-7877727ec85a tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/73c675c1-06c8-45f2-a602-9df68c0a5ff7 HTTP/1.1" status: 404 len: 337 time: 0.0388653 Dec 10 14:31:57.578334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59524) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.628587 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-230cf1ab-590d-4804-b852-3ab21f6efc9d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.629175 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-230cf1ab-590d-4804-b852-3ab21f6efc9d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.632388 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-230cf1ab-590d-4804-b852-3ab21f6efc9d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/e55e62e8-cc60-4757-af52-ffb7a7428ba1 HTTP/1.1" status: 404 len: 333 time: 0.0614769 Dec 10 14:31:57.634948 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59526) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.668857 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-6bed3898-1b9f-4551-a20b-df3dc0ba0293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.668857 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6bed3898-1b9f-4551-a20b-df3dc0ba0293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.672315 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6bed3898-1b9f-4551-a20b-df3dc0ba0293 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/1cbd6562-25cf-4d77-95a5-de9d7d9d8841 HTTP/1.1" status: 404 len: 337 time: 0.0364108 Dec 10 14:31:57.675005 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59528) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.713193 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-ff07f769-8802-424f-b81a-63f46735c33d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.713806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ff07f769-8802-424f-b81a-63f46735c33d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.720037 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ff07f769-8802-424f-b81a-63f46735c33d tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/832a3614-528d-4d6b-a571-e3a9afaecf3d HTTP/1.1" status: 404 len: 333 time: 0.0409741 Dec 10 14:31:57.751209 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59530) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.786179 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-224c8478-11ad-4387-8860-9b6c1e174d40 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.786648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-224c8478-11ad-4387-8860-9b6c1e174d40 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.789835 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-224c8478-11ad-4387-8860-9b6c1e174d40 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/51f47c75-1482-4e83-8bd1-7a21d5404caa HTTP/1.1" status: 404 len: 337 time: 0.0377235 Dec 10 14:31:57.792974 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59532) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.820998 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-7aa87e2f-910b-4d46-aca0-f2c35d9bdf39 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.821664 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7aa87e2f-910b-4d46-aca0-f2c35d9bdf39 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.824767 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-7aa87e2f-910b-4d46-aca0-f2c35d9bdf39 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/c9a9d483-c13d-44fa-b912-76ed0d11521b HTTP/1.1" status: 404 len: 333 time: 0.0313148 Dec 10 14:31:57.849846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59534) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.882606 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d97b200b-3ec9-4215-85d2-a5dab0ef6608 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "GET /v2.0/ports?device_id=d18cfd99-e8a8-404e-ba1d-7e6297383bb5 HTTP/1.1" status: 200 len: 205 time: 0.3027487 Dec 10 14:31:57.885023 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59536) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.886263 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-acb73fb9-bf15-459a-8f8d-45a54a92b136 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.886720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-acb73fb9-bf15-459a-8f8d-45a54a92b136 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.893791 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-acb73fb9-bf15-459a-8f8d-45a54a92b136 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/27c801e6-c2b3-4a50-844a-b4d8911c9a98 HTTP/1.1" status: 404 len: 337 time: 0.0395160 Dec 10 14:31:57.894543 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59538) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.923176 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-63db12ec-ceba-4c6c-aa6c-03d90b486b1f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:57.923713 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-63db12ec-ceba-4c6c-aa6c-03d90b486b1f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:57.926177 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-a4b792ac-13eb-4183-9389-325a78928f79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] delete failed (client error): The resource could not be found. Dec 10 14:31:57.926859 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-63db12ec-ceba-4c6c-aa6c-03d90b486b1f tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/224bf8b6-3cb5-4ebd-be20-9fa406fe35fc HTTP/1.1" status: 404 len: 333 time: 0.0313566 Dec 10 14:31:57.929979 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a4b792ac-13eb-4183-9389-325a78928f79 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/routers/d18cfd99-e8a8-404e-ba1d-7e6297383bb5 HTTP/1.1" status: 404 len: 336 time: 0.0413115 Dec 10 14:31:57.930090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59540) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.930255 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59542) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:57.954892 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4e389d38-dfe1-4e6b-b0d4-473026e74312 req-7585cb8f-78e2-47ff-9080-cd451d095967 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3720686 Dec 10 14:31:58.002792 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 70717ebc-79f9-48f1-b654-d7a76d6366d3 no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:31:58.003878 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-2aba126f-74f0-46ab-8956-c715c8cce2b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:58.004532 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2aba126f-74f0-46ab-8956-c715c8cce2b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:58.007692 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2aba126f-74f0-46ab-8956-c715c8cce2b3 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/5e1d1bb2-2ce1-4a3f-9f7b-526e93ce252b HTTP/1.1" status: 404 len: 337 time: 0.0753620 Dec 10 14:31:58.010742 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-3d139dcf-bf46-435f-ab12-64138e28ebe6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:58.011181 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59546) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:58.011318 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3d139dcf-bf46-435f-ab12-64138e28ebe6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:58.017105 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3d139dcf-bf46-435f-ab12-64138e28ebe6 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/c9398767-cec9-48fd-bdd3-815a3b0bab44 HTTP/1.1" status: 404 len: 337 time: 0.0814013 Dec 10 14:31:58.017380 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59548) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:58.039272 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-a4f2ad17-e051-42c5-b160-f04eec31195c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:58.039862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a4f2ad17-e051-42c5-b160-f04eec31195c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:58.045464 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a4f2ad17-e051-42c5-b160-f04eec31195c tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/f9f8f466-5aa0-40a8-9f77-cfb52db44021 HTTP/1.1" status: 404 len: 333 time: 0.0307057 Dec 10 14:31:58.045698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59550) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:58.053498 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.pecan_wsgi.hooks.translation [None req-6fe38573-bab2-4781-95a2-7d444d4ce085 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:58.053969 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6fe38573-bab2-4781-95a2-7d444d4ce085 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103810) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:58.059682 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6fe38573-bab2-4781-95a2-7d444d4ce085 tempest-RoutersTest-1759834111 tempest-RoutersTest-1759834111-project] 10.222.0.57 "DELETE /v2.0/subnets/57c9ba11-01e5-45c5-9332-cfdfee1d754c HTTP/1.1" status: 404 len: 337 time: 0.0387557 Dec 10 14:31:58.077906 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-ffa050a6-454c-41e7-9df2-e0e7ce9fb4a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:58.078153 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ffa050a6-454c-41e7-9df2-e0e7ce9fb4a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:58.081555 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ffa050a6-454c-41e7-9df2-e0e7ce9fb4a7 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/f32deff0-5335-4e4e-a47e-fd16649a6044 HTTP/1.1" status: 404 len: 337 time: 0.0344131 Dec 10 14:31:58.083915 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59554) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:58.110353 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-c41b8702-9a4d-4960-b635-11aa6867fe82 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:58.111098 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c41b8702-9a4d-4960-b635-11aa6867fe82 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:58.114298 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c41b8702-9a4d-4960-b635-11aa6867fe82 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/ports/263c0732-dcb6-4136-b1ce-24a8d9fc10ef HTTP/1.1" status: 404 len: 333 time: 0.0291195 Dec 10 14:31:58.117651 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59556) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:58.153038 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.pecan_wsgi.hooks.translation [None req-45e8b150-6f41-4422-9180-25a570233301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] DELETE failed (client error): The resource could not be found. Dec 10 14:31:58.153535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-45e8b150-6f41-4422-9180-25a570233301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103811) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 10 14:31:58.158151 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-45e8b150-6f41-4422-9180-25a570233301 tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/subnets/e6318643-befa-43c7-9fa6-96dd2c2e2e70 HTTP/1.1" status: 404 len: 337 time: 0.0394750 Dec 10 14:31:58.161269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59558) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:58.185387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: 70717ebc-79f9-48f1-b654-d7a76d6366d3 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:31:58.186105 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 70717ebc-79f9-48f1-b654-d7a76d6366d3 not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:31:58.191537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.242501 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.336658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.357305 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cdc891b5-3e75-4d62-a51b-0f84be9af82d']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:58.367414 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '292f222e-ec8a-4b09-987f-5c8bd8bc0449') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:58.367715 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '292f222e-ec8a-4b09-987f-5c8bd8bc0449') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:58.378587 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.392988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.399504 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Releasing vlan 354 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:31:58.399903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:31:58.403417 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:31:58.532797 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59562) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:58.539956 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.547044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.553269 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] 10.222.0.57 "DELETE /v2.0/networks/cdc891b5-3e75-4d62-a51b-0f84be9af82d HTTP/1.1" status: 204 len: 168 time: 0.3909030 Dec 10 14:31:58.567469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa16e842-24d0-4065-abc8-79f4f569f6ca tempest-NetworksTestDHCPv6-169922711 tempest-NetworksTestDHCPv6-169922711-project] Pushing event deleted for resources: {'Network': ['ID=cdc891b5-3e75-4d62-a51b-0f84be9af82d,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:58.685207 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-14e92224-ea69-4711-acf9-21066ac1dff0 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=f89dac3cc3eb4260b99c6e932dee7a4f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1510401 Dec 10 14:31:58.688216 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59568) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:58.739954 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d32ef9c5-9d38-4b67-bde5-6459298c463e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.761961 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d32ef9c5-9d38-4b67-bde5-6459298c463e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.807109 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port a740df5b-822f-40aa-a293-e69ac39e4777 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:31:58.807776 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.894051 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d32ef9c5-9d38-4b67-bde5-6459298c463e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.896347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port a740df5b-822f-40aa-a293-e69ac39e4777, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=a740df5b-822f-40aa-a293-e69ac39e4777,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:31:58.896673 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d32ef9c5-9d38-4b67-bde5-6459298c463e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.896787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:58.897894 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d32ef9c5-9d38-4b67-bde5-6459298c463e admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/d61529e1-10cf-461c-adfb-117bfd5a0066 HTTP/1.1" status: 204 len: 168 time: 0.2083874 Dec 10 14:31:58.906929 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d32ef9c5-9d38-4b67-bde5-6459298c463e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d61529e1-10cf-461c-adfb-117bfd5a0066,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:58.912252 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for a740df5b-822f-40aa-a293-e69ac39e4777 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:31:59.026897 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59576) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:59.082528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fa3b501-ac70-4f67-bbeb-8bfa857a7c09 req-1fba179a-1f95-4d39-94bb-aac43f5a35cf tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:31:59.084197 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2fa3b501-ac70-4f67-bbeb-8bfa857a7c09 req-1fba179a-1f95-4d39-94bb-aac43f5a35cf tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.0578599 Dec 10 14:31:59.142041 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2fa3b501-ac70-4f67-bbeb-8bfa857a7c09 req-28bf635b-b036-4eee-a489-35dbc999ffdc tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0508919 Dec 10 14:31:59.197289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:59.226472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=a740df5b-822f-40aa-a293-e69ac39e4777,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:59.341026 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8312526b-2bff-4281-afb2-771a0fb5cd21 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=ad863e8eeacb4ff7b6e54fd3ddcddd70&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3099623 Dec 10 14:31:59.341145 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59586) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:59.399215 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-042a3129-29ed-4a59-8809-e9157453167b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:59.422631 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-042a3129-29ed-4a59-8809-e9157453167b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:59.448177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:59.545547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-042a3129-29ed-4a59-8809-e9157453167b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:59.556294 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-042a3129-29ed-4a59-8809-e9157453167b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:59.556294 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-042a3129-29ed-4a59-8809-e9157453167b admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/08e219a3-2955-4301-983d-9b16b863604e HTTP/1.1" status: 204 len: 168 time: 0.2082567 Dec 10 14:31:59.558508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-042a3129-29ed-4a59-8809-e9157453167b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08e219a3-2955-4301-983d-9b16b863604e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:31:59.673632 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router ff0346ca-999c-400f-8b50-ce9d0945eb30 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:31:59.788962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:31:59.796924 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-65d7ba74-3af8-44bf-ba97-d894aa49abe4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/routers/ff0346ca-999c-400f-8b50-ce9d0945eb30/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3443213 Dec 10 14:31:59.797562 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59600) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:31:59.798949 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] Sync routers for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:31:59.812314 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:31:59.814294 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:31:59.851648 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-fb24615c-72d6-4259-a30c-55cd117927ef tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting subnet 06dce599-7e77-4ea6-a2ef-4939d220952a {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:31:59.854985 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb24615c-72d6-4259-a30c-55cd117927ef tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:59.900204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb24615c-72d6-4259-a30c-55cd117927ef tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:31:59.925992 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:00.008366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb24615c-72d6-4259-a30c-55cd117927ef tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.018760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device aaad23d0-018e-4bc3-96f5-29b61ee40dc1 details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:32:00.080548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59608) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:00.135805 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:31:59Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:00.167215 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] Checking router: ff0346ca-999c-400f-8b50-ce9d0945eb30 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:32:00.177091 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] Routers {'ff0346ca-999c-400f-8b50-ce9d0945eb30'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:00.178207 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:31:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['ff0346ca-999c-400f-8b50-ce9d0945eb30'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:00.188791 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port aaad23d0-018e-4bc3-96f5-29b61ee40dc1, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1,segment=NetworkSegment(3002d938-5fba-44ab-8087-00a333e47ca8),segment_id=3002d938-5fba-44ab-8087-00a333e47ca8)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:00.197300 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb24615c-72d6-4259-a30c-55cd117927ef tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.203604 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'port_id': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1', 'mac_address': 'fa:16:3e:56:71:0f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 387, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:32:00.249085 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.257612 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d5990b3-22ef-456c-acc9-4e8279e0b209 None None] Network 6227fea4-3842-4a83-a78f-a5ec3bccdb07 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:00.283797 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fb24615c-72d6-4259-a30c-55cd117927ef tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.288012 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] Set router ff0346ca-999c-400f-8b50-ce9d0945eb30 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:00.288159 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fb24615c-72d6-4259-a30c-55cd117927ef tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/subnets/06dce599-7e77-4ea6-a2ef-4939d220952a HTTP/1.1" status: 204 len: 168 time: 0.4882627 Dec 10 14:32:00.288255 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb24615c-72d6-4259-a30c-55cd117927ef tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Subnet': ['ID=06dce599-7e77-4ea6-a2ef-4939d220952a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:00.292667 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1943d121-a7e3-4268-b1b2-90d08380e10c tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'router': {'name': 'tempest-RoutersNegativeIpV6Test-router-373235321', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:00.294729 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59618) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:00.311813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aaad23d0-018e-4bc3-96f5-29b61ee40dc1 {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:32:00.365297 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port aaad23d0-018e-4bc3-96f5-29b61ee40dc1, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1,segment=NetworkSegment(3002d938-5fba-44ab-8087-00a333e47ca8),segment_id=3002d938-5fba-44ab-8087-00a333e47ca8)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:00.408417 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1943d121-a7e3-4268-b1b2-90d08380e10c tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.410153 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1943d121-a7e3-4268-b1b2-90d08380e10c tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.443361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.445376 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79369e4b-c51d-4670-a3d2-e82c6bb27568 req-d7795d08-bf0c-4da7-ba3e-0393cc048cc4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:00.453019 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-79369e4b-c51d-4670-a3d2-e82c6bb27568 req-d7795d08-bf0c-4da7-ba3e-0393cc048cc4 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 943 time: 0.1565411 Dec 10 14:32:00.469068 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:31:59Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:00.502501 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9e6d466-1282-4a29-ac94-0140ceeb85ac None None] The sync data for ids ['ff0346ca-999c-400f-8b50-ce9d0945eb30'] in dv-neutron-821401-2-hyperv is: [{'id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'name': 'tempest-TestNetworkBasicOps-router-318858189', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104'}], 'enable_snat': True}, 'gw_port_id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:31:59Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': '5a50d5fe-7e23-4220-a824-58a665d0e7c5', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:19:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff0346ca-999c-400f-8b50-ce9d0945eb30', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1172, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:26Z', 'updated_at': '2021-12-10T14:30:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:32:00.537672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea698113-45a6-438d-9950-1f76c62ce1e9 None None] DHCP port deletion for 6227fea4-3842-4a83-a78f-a5ec3bccdb07 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:32:00.543283 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=aaad23d0-018e-4bc3-96f5-29b61ee40dc1,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:00.546337 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-79369e4b-c51d-4670-a3d2-e82c6bb27568 req-f12cd9c5-1ca5-4a7f-86b7-46cf21a9efe5 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0923071 Dec 10 14:32:00.547491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1943d121-a7e3-4268-b1b2-90d08380e10c tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.569786 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.602245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ea698113-45a6-438d-9950-1f76c62ce1e9 None None] Deleting port 224b7552-af57-4388-9143-da740e40f170 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:00.602639 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ea698113-45a6-438d-9950-1f76c62ce1e9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.645220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['aaad23d0-018e-4bc3-96f5-29b61ee40dc1'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:32:00.650379 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1943d121-a7e3-4268-b1b2-90d08380e10c tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.689547 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.709220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-ea698113-45a6-438d-9950-1f76c62ce1e9 None None] For port 224b7552-af57-4388-9143-da740e40f170, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=224b7552-af57-4388-9143-da740e40f170,segment=NetworkSegment(2d62797f-ef39-42b9-9390-c745f87a2ead),segment_id=2d62797f-ef39-42b9-9390-c745f87a2ead)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:00.709652 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ea698113-45a6-438d-9950-1f76c62ce1e9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.726545 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1943d121-a7e3-4268-b1b2-90d08380e10c tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.727938 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1943d121-a7e3-4268-b1b2-90d08380e10c tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 711 time: 0.6457043 Dec 10 14:32:00.729524 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-ea698113-45a6-438d-9950-1f76c62ce1e9 None None] Calling delete_port for 224b7552-af57-4388-9143-da740e40f170 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:00.730815 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59628) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:00.737284 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-273706312'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:00.813111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 5a50d5fe-7e23-4220-a824-58a665d0e7c5 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:00.813663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.825334 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Made reservation on behalf of f4458d42f98847a7909268deb386f7a6 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:00.829337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.839935 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.927750 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ea698113-45a6-438d-9950-1f76c62ce1e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.937574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.940859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port 5a50d5fe-7e23-4220-a824-58a665d0e7c5, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=5a50d5fe-7e23-4220-a824-58a665d0e7c5,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:00.941231 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:00.966675 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 5a50d5fe-7e23-4220-a824-58a665d0e7c5 owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:00.982700 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea698113-45a6-438d-9950-1f76c62ce1e9 None None] No DVR routers for this DVR port 224b7552-af57-4388-9143-da740e40f170 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:32:00.986962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea698113-45a6-438d-9950-1f76c62ce1e9 None None] Pushing event deleted for resources: {'Port': ['ID=224b7552-af57-4388-9143-da740e40f170,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:00.994274 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.044429 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] vlan segment allocate from pool success with {'vlan_id': 360, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:32:01.045937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 224b7552-af57-4388-9143-da740e40f170 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:32:01.058697 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59632) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:01.066317 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3be15a4e-d5cd-4077-9264-0f926a9f4c59,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:01.073341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.073964 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Added segment d6a31439-d437-47ff-a395-ec941c2c5ae5 of type vlan for network 95325c3b-2663-4cb7-b976-32008e9b218c Dec 10 14:32:01.131734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.136962 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 224b7552-af57-4388-9143-da740e40f170 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:32:01.137696 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 224b7552-af57-4388-9143-da740e40f170 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:32:01.138464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a740df5b-822f-40aa-a293-e69ac39e4777 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:32:01.184896 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: a740df5b-822f-40aa-a293-e69ac39e4777 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:32:01.185247 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device a740df5b-822f-40aa-a293-e69ac39e4777 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:32:01.208736 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.248248 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-secgroup--1524348776'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:01.265381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.271341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:01.272012 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.316867 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.342009 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Network': ['ID=95325c3b-2663-4cb7-b976-32008e9b218c,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:01.343981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=5a50d5fe-7e23-4220-a824-58a665d0e7c5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:01.352744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.357744 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 95325c3b-2663-4cb7-b976-32008e9b218c details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:32:01.359703 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cb18503-33f2-4695-8c42-a88672e69d17 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:32:01.376253 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.416928 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a50b79c0-7fea-4e11-a6a3-474e5c96ed2b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.6846447 Dec 10 14:32:01.420044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59636) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:01.425907 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'subnet': {'network_id': '95325c3b-2663-4cb7-b976-32008e9b218c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:01.433052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.537870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.542896 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.579617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Made reservation on behalf of f4458d42f98847a7909268deb386f7a6 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:01.583324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.611489 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.665813 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c77344b8-9690-4ad1-839f-38cd000cf5c9 req-7374cc48-0987-4bdc-b6b7-e17791965c7d tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:01.667257 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c77344b8-9690-4ad1-839f-38cd000cf5c9 req-7374cc48-0987-4bdc-b6b7-e17791965c7d tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 944 time: 0.0504804 Dec 10 14:32:01.671966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.672602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Fanout notify agent at l3_agent the message router_deleted on router ff0346ca-999c-400f-8b50-ce9d0945eb30 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:32:01.681407 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.682475 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0bd3443e-dd09-4ba0-b617-a3083c9b0cce tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/routers/ff0346ca-999c-400f-8b50-ce9d0945eb30 HTTP/1.1" status: 204 len: 168 time: 1.3743670 Dec 10 14:32:01.685198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59640) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:01.742646 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c77344b8-9690-4ad1-839f-38cd000cf5c9 req-0469f617-18ed-4d7a-a522-4a11073b6a69 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0604501 Dec 10 14:32:01.769456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.806967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b13e9baa-1c83-4c2c-ae3b-484c215e409d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:01.824432 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.864446 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.917093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.945202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.958056 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:01.974247 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=83a0f450-53f1-45fb-b310-28358e781154,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:01.999950 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6227fea4-3842-4a83-a78f-a5ec3bccdb07']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:02.015448 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Subnet': ['ID=f2977c1e-c9e6-4d98-846b-2d9306118f4f,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:02.017581 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device aaad23d0-018e-4bc3-96f5-29b61ee40dc1 up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:02.021057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2d62797f-ef39-42b9-9390-c745f87a2ead') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:02.021470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2d62797f-ef39-42b9-9390-c745f87a2ead') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:02.033945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.039011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.040573 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-50f6b942-c2fe-4bdb-9d3c-dd779a6addc6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.9804504 Dec 10 14:32:02.042095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Checking segment: {'id': 'd6a31439-d437-47ff-a395-ec941c2c5ae5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '95325c3b-2663-4cb7-b976-32008e9b218c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:02.042930 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network hostable DHCP agents. Network: 95325c3b-2663-4cb7-b976-32008e9b218c, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:32:02.043723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59642) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.056809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.067792 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Releasing vlan 353 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:32:02.068201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:32:02.071344 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:32:02.099524 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-be2407cb-e29c-472a-bda2-55ed05f1df3e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.0545235 Dec 10 14:32:02.102262 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59644) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.106557 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-90a14511-107a-40c2-8db2-8ce5cd5b9970 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-security--1286005091', 'description': 'tempest-security-description-2028406896'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:02.141967 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90a14511-107a-40c2-8db2-8ce5cd5b9970 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.151032 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port aaad23d0-018e-4bc3-96f5-29b61ee40dc1 completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:32:02.155777 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port aaad23d0-018e-4bc3-96f5-29b61ee40dc1 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:02.156153 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.175777 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network 95325c3b-2663-4cb7-b976-32008e9b218c is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:32:02.189565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90a14511-107a-40c2-8db2-8ce5cd5b9970 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.231645 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.243269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.249154 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/networks/6227fea4-3842-4a83-a78f-a5ec3bccdb07 HTTP/1.1" status: 204 len: 168 time: 0.5623572 Dec 10 14:32:02.259761 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59646) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.260346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 95325c3b-2663-4cb7-b976-32008e9b218c) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:02.261059 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90a14511-107a-40c2-8db2-8ce5cd5b9970 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.262138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90502eb8-7d75-4f56-be09-0c3e67aadb17 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Network': ['ID=6227fea4-3842-4a83-a78f-a5ec3bccdb07,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:02.264728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.268735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-90a14511-107a-40c2-8db2-8ce5cd5b9970 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.268735 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-90a14511-107a-40c2-8db2-8ce5cd5b9970 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "PUT /v2.0/security-groups/83a0f450-53f1-45fb-b310-28358e781154 HTTP/1.1" status: 200 len: 1797 time: 0.1645734 Dec 10 14:32:02.271435 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59648) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.280611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e75df7b-403f-4b62-97a3-7db61a5c0f25 None None] Network 95325c3b-2663-4cb7-b976-32008e9b218c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:02.281305 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'network': {'name': 'tempest-network-smoke--1971497590', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'port_security_enabled': True}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:02.281750 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:02.282344 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.321558 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fdfeb5fe-84e3-4d36-b7ed-342d4542953d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups/83a0f450-53f1-45fb-b310-28358e781154 HTTP/1.1" status: 200 len: 1797 time: 0.0485256 Dec 10 14:32:02.324567 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59650) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.332030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:32:02.334561 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6dc186fb-271a-4f84-b7cc-24b88ca25cac" -d '{"events": [{"server_uuid": "639cb4fb-fcb2-41bb-8528-734e490b8575", "name": "network-vif-plugged", "status": "completed", "tag": "aaad23d0-018e-4bc3-96f5-29b61ee40dc1"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:32:02.343846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90a14511-107a-40c2-8db2-8ce5cd5b9970 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=83a0f450-53f1-45fb-b310-28358e781154,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:02.353321 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port aaad23d0-018e-4bc3-96f5-29b61ee40dc1, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1,segment=NetworkSegment(3002d938-5fba-44ab-8087-00a333e47ca8),segment_id=3002d938-5fba-44ab-8087-00a333e47ca8)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:02.382498 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:32:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f0f4e81-5e62-4ba5-b2bc-1392b1c2d836 x-openstack-request-id: req-1f0f4e81-5e62-4ba5-b2bc-1392b1c2d836 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:32:02.382792 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "639cb4fb-fcb2-41bb-8528-734e490b8575", "name": "network-vif-plugged", "status": "completed", "tag": "aaad23d0-018e-4bc3-96f5-29b61ee40dc1", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:32:02.383046 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-1f0f4e81-5e62-4ba5-b2bc-1392b1c2d836 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:32:02.383477 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1', 'code': 200} Dec 10 14:32:02.385450 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:02.390100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.412993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b40ab9a1-a28c-4c5b-9da4-47129d6209e8 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.420350 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] vlan segment allocate from pool success with {'vlan_id': 389, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:32:02.421773 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-95325c3b-2663-4cb7-b976-32008e9b218c', 'network_id': '95325c3b-2663-4cb7-b976-32008e9b218c', 'project_id': 'f4458d42f98847a7909268deb386f7a6', 'fixed_ips': [{'subnet_id': 'f2977c1e-c9e6-4d98-846b-2d9306118f4f'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:32:02.423091 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.430677 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.430964 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Added segment 744b984b-20c9-438a-b07b-084c6734dffa of type vlan for network ff92c14f-f9fb-4f05-9886-7825120a4f21 Dec 10 14:32:02.440591 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.443404 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b40ab9a1-a28c-4c5b-9da4-47129d6209e8 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.466659 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d20c8d15-006b-4bf6-b23f-664e06859a27 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0452609 Dec 10 14:32:02.471725 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59654) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.479395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'network': {'name': 'tempest-router-network01--1539168604'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:02.500454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.558634 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=aaad23d0-018e-4bc3-96f5-29b61ee40dc1,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:02.568215 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b40ab9a1-a28c-4c5b-9da4-47129d6209e8 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.570956 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b40ab9a1-a28c-4c5b-9da4-47129d6209e8 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.572167 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b40ab9a1-a28c-4c5b-9da4-47129d6209e8 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/83a0f450-53f1-45fb-b310-28358e781154 HTTP/1.1" status: 204 len: 168 time: 0.2474117 Dec 10 14:32:02.574734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59656) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.584957 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40ab9a1-a28c-4c5b-9da4-47129d6209e8 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=83a0f450-53f1-45fb-b310-28358e781154,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:02.617993 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Made reservation on behalf of f4458d42f98847a7909268deb386f7a6 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:02.622061 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.622898 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Allocated IP 2001:db8::2 (95325c3b-2663-4cb7-b976-32008e9b218c/f2977c1e-c9e6-4d98-846b-2d9306118f4f/21c21f2e-6cb8-441b-be34-168cc8bdad54) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:02.628602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.634418 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:02.635041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.669345 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-87398731-5e33-41dd-a604-393094a7e569 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0934193 Dec 10 14:32:02.676724 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59658) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.719678 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c6737c-cd5e-48e5-93c8-f7adc79bde86 req-67ddc8c8-2e94-4d0d-a501-dfd2bc81a81e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:02.722567 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-91c6737c-cd5e-48e5-93c8-f7adc79bde86 req-67ddc8c8-2e94-4d0d-a501-dfd2bc81a81e service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1098 time: 0.0787432 Dec 10 14:32:02.724764 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-f405812f-73fe-4f90-8326-2223b549a7f6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] delete failed (client error): The resource could not be found. Dec 10 14:32:02.725824 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f405812f-73fe-4f90-8326-2223b549a7f6 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/83a0f450-53f1-45fb-b310-28358e781154 HTTP/1.1" status: 404 len: 347 time: 0.0174050 Dec 10 14:32:02.737542 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59660) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.741283 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5a50d5fe-7e23-4220-a824-58a665d0e7c5 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:32:02.747503 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-6a933300-9079-4e21-aad7-73c2451d4087 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-secgroup--1425962113'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:02.752558 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] vlan segment allocate from pool success with {'vlan_id': 374, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:32:02.767111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 5a50d5fe-7e23-4220-a824-58a665d0e7c5 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:32:02.767111 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 5a50d5fe-7e23-4220-a824-58a665d0e7c5 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:32:02.767441 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Network': ['ID=ff92c14f-f9fb-4f05-9886-7825120a4f21,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:02.785846 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-91c6737c-cd5e-48e5-93c8-f7adc79bde86 req-30d3e2e0-e816-482b-b64f-afa9ff80e5ed service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0540986 Dec 10 14:32:02.787483 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.787841 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Added segment 69f5a656-a617-4178-981e-491620f56b76 of type vlan for network 606d90a8-f9cd-4aad-a9ea-8f279933b819 Dec 10 14:32:02.801472 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-60f0a0c0-86a7-40ff-b159-788fb576ed9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.5242107 Dec 10 14:32:02.803461 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59664) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:02.807565 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:32:02.809327 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-313184532', 'admin_state_up': True, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:02.838897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.861902 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.893086 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6a933300-9079-4e21-aad7-73c2451d4087 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.905664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4c09906c-9479-443c-a272-fa2a0fd9eab5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:02.931638 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ad6bcd-b090-4755-8f77-bae809e47b55 req-21eddb76-c3a1-4b50-81f6-f6cd20e9e987 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:02.933053 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-60ad6bcd-b090-4755-8f77-bae809e47b55 req-21eddb76-c3a1-4b50-81f6-f6cd20e9e987 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 945 time: 0.0774608 Dec 10 14:32:03.003044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.008589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.014842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:03.015449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.028698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6a933300-9079-4e21-aad7-73c2451d4087 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.035719 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-60ad6bcd-b090-4755-8f77-bae809e47b55 req-ce40a453-133b-4e6f-9cef-352707a50123 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0927720 Dec 10 14:32:03.043711 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Network 95325c3b-2663-4cb7-b976-32008e9b218c is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:03.048531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:03.060421 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:03.068452 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Pushing event updated for resources: {'Port': ['ID=21c21f2e-6cb8-441b-be34-168cc8bdad54,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:03.092205 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Network': ['ID=606d90a8-f9cd-4aad-a9ea-8f279933b819,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:03.106347 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.107746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.112092 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 606d90a8-f9cd-4aad-a9ea-8f279933b819 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:32:03.160940 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Attempting to bind port 21c21f2e-6cb8-441b-be34-168cc8bdad54 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:32:03.161682 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Attempting to bind port 21c21f2e-6cb8-441b-be34-168cc8bdad54 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'd6a31439-d437-47ff-a395-ec941c2c5ae5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '95325c3b-2663-4cb7-b976-32008e9b218c'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:32:03.161913 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Attempting to bind port 21c21f2e-6cb8-441b-be34-168cc8bdad54 on network 95325c3b-2663-4cb7-b976-32008e9b218c {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:03.163494 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6a933300-9079-4e21-aad7-73c2451d4087 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.163646 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.179641 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:32:03.180039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Checking segment: {'id': 'd6a31439-d437-47ff-a395-ec941c2c5ae5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '95325c3b-2663-4cb7-b976-32008e9b218c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:03.180418 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.180813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Bound using segment: {'id': 'd6a31439-d437-47ff-a395-ec941c2c5ae5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '95325c3b-2663-4cb7-b976-32008e9b218c'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:32:03.181297 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Bound port: 21c21f2e-6cb8-441b-be34-168cc8bdad54, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd6a31439-d437-47ff-a395-ec941c2c5ae5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': '95325c3b-2663-4cb7-b976-32008e9b218c'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:32:03.181762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.189395 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2ef9f209-27a0-438e-9e9b-17c66f3834c8 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.7167771 Dec 10 14:32:03.192668 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59666) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:03.198377 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'network': {'name': 'tempest-router-network02--56597541'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:03.200558 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a933300-9079-4e21-aad7-73c2451d4087 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=264b84f5-c1d6-4886-aae9-37e3dc7dfc0a,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:03.256353 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] For port 21c21f2e-6cb8-441b-be34-168cc8bdad54, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:32:03.259343 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] For port 21c21f2e-6cb8-441b-be34-168cc8bdad54, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=21c21f2e-6cb8-441b-be34-168cc8bdad54,segment=NetworkSegment(d6a31439-d437-47ff-a395-ec941c2c5ae5),segment_id=d6a31439-d437-47ff-a395-ec941c2c5ae5)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:32:03.285187 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6a933300-9079-4e21-aad7-73c2451d4087 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.289864 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6a933300-9079-4e21-aad7-73c2451d4087 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.5504379 Dec 10 14:32:03.294727 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59668) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:03.296006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3042137e-af99-415d-8c23-e15150a39ad1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': '264b84f5-c1d6-4886-aae9-37e3dc7dfc0a', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:03.340315 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.354450 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.397320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e36689a-995f-47bb-a887-4760c147f351 None None] Pushing event updated for resources: {'Port': ['ID=21c21f2e-6cb8-441b-be34-168cc8bdad54,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:03.438119 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Made reservation on behalf of f4458d42f98847a7909268deb386f7a6 for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:03.442491 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.466555 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] vlan segment allocate from pool success with {'vlan_id': 350, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:32:03.487634 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.487982 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Added segment 215c5420-57ae-4a4f-882c-b978566f4fc2 of type vlan for network b0b8dc19-b292-40b4-8b6e-993b1d9437ae Dec 10 14:32:03.553663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3042137e-af99-415d-8c23-e15150a39ad1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.576408 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.625911 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3042137e-af99-415d-8c23-e15150a39ad1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.720976 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.727548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:03.728138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.751052 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3042137e-af99-415d-8c23-e15150a39ad1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.774035 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3042137e-af99-415d-8c23-e15150a39ad1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5bbd1942-e7b7-44eb-b48e-1053d34eb9e5,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:03.810915 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.841618 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:03.845208 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Network': ['ID=b0b8dc19-b292-40b4-8b6e-993b1d9437ae,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:03.858171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network b0b8dc19-b292-40b4-8b6e-993b1d9437ae details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:32:03.960909 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.26.2.72 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/d3220285-7992-4fb1-9ccf-a69cee14808d) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:04.070331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.162670 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef40e746-3613-4414-9012-77efa4aca2ef req-a01ae2a8-2103-4930-b82f-64798f91a35b tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:04.164409 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ef40e746-3613-4414-9012-77efa4aca2ef req-a01ae2a8-2103-4930-b82f-64798f91a35b tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 945 time: 0.0527620 Dec 10 14:32:04.216468 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ef40e746-3613-4414-9012-77efa4aca2ef req-55f873a5-dc59-43f9-91ba-dfc7462c271f tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457482 Dec 10 14:32:04.329520 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89adce93-2d42-4978-9a61-6a3f0541ba69 None None] Network 95325c3b-2663-4cb7-b976-32008e9b218c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:04.428478 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-759f1214-cfa6-4a80-8cbd-b3f98fb83250 None None] Provisioning complete for port 21c21f2e-6cb8-441b-be34-168cc8bdad54 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:04.428852 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-759f1214-cfa6-4a80-8cbd-b3f98fb83250 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.444927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3042137e-af99-415d-8c23-e15150a39ad1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.448745 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b786197a-63ef-4860-9595-429608cd47e6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 1.2515423 Dec 10 14:32:04.454739 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3042137e-af99-415d-8c23-e15150a39ad1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.1547534 Dec 10 14:32:04.454739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59672) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:04.455014 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59674) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:04.455142 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'subnet': {'network_id': '606d90a8-f9cd-4aad-a9ea-8f279933b819', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:04.482804 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afe4de0a-30c2-4b7b-9fa5-573944bc2b75 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.491269 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afe4de0a-30c2-4b7b-9fa5-573944bc2b75 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.512348 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.537522 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-759f1214-cfa6-4a80-8cbd-b3f98fb83250 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.576065 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-759f1214-cfa6-4a80-8cbd-b3f98fb83250 None None] For port 21c21f2e-6cb8-441b-be34-168cc8bdad54, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=21c21f2e-6cb8-441b-be34-168cc8bdad54,segment=NetworkSegment(d6a31439-d437-47ff-a395-ec941c2c5ae5),segment_id=d6a31439-d437-47ff-a395-ec941c2c5ae5)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:04.581476 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:04.584743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:04.588191 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:04.599842 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-077ec02f-e44a-446a-9498-fe8230def67e None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:32:04.611318 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=d3220285-7992-4fb1-9ccf-a69cee14808d,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:04.675333 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afe4de0a-30c2-4b7b-9fa5-573944bc2b75 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.677620 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-afe4de0a-30c2-4b7b-9fa5-573944bc2b75 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.679014 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-afe4de0a-30c2-4b7b-9fa5-573944bc2b75 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/5bbd1942-e7b7-44eb-b48e-1053d34eb9e5 HTTP/1.1" status: 204 len: 168 time: 0.2288659 Dec 10 14:32:04.683926 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59676) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:04.696648 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Made reservation on behalf of f4458d42f98847a7909268deb386f7a6 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:04.697191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-759f1214-cfa6-4a80-8cbd-b3f98fb83250 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.704685 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.750950 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afe4de0a-30c2-4b7b-9fa5-573944bc2b75 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=5bbd1942-e7b7-44eb-b48e-1053d34eb9e5,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:04.757409 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-759f1214-cfa6-4a80-8cbd-b3f98fb83250 None None] Pushing event updated for resources: {'Port': ['ID=21c21f2e-6cb8-441b-be34-168cc8bdad54,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:04.803269 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 21c21f2e-6cb8-441b-be34-168cc8bdad54 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:04.808283 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-55f05ea7-8491-4651-88bb-285cf8a358ae tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1212745 Dec 10 14:32:04.811597 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59678) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:04.868542 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-dbd72a57-b8f2-4469-9bba-9dc8ea6e7063 None None] Provisioning complete for port 21c21f2e-6cb8-441b-be34-168cc8bdad54 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:04.868944 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-dbd72a57-b8f2-4469-9bba-9dc8ea6e7063 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.874609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a2b7edc6-4894-4ae3-8781-2efb8581a225 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.899617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a2b7edc6-4894-4ae3-8781-2efb8581a225 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.909084 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 21c21f2e-6cb8-441b-be34-168cc8bdad54 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:04.909474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:04.991335 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.033235 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-dbd72a57-b8f2-4469-9bba-9dc8ea6e7063 None None] Provisioning complete for port d3220285-7992-4fb1-9ccf-a69cee14808d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:05.033636 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-dbd72a57-b8f2-4469-9bba-9dc8ea6e7063 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.046330 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.068116 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Subnet': ['ID=ddedaae7-20f0-4b7a-94cb-f962123b7632,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:05.073269 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Checking segment: {'id': '69f5a656-a617-4178-981e-491620f56b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '606d90a8-f9cd-4aad-a9ea-8f279933b819'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:05.073666 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network hostable DHCP agents. Network: 606d90a8-f9cd-4aad-a9ea-8f279933b819, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:32:05.082332 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.083030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.083155 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.083579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.083928 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.084125 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-dbd72a57-b8f2-4469-9bba-9dc8ea6e7063 None None] Port d3220285-7992-4fb1-9ccf-a69cee14808d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:32:05.084254 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.084604 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.084937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.085274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.085643 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.085981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.086313 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.086744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:05.145167 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ea0527b0-b2c6-469a-a8f8-f3fc71a6b1a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.180577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network 606d90a8-f9cd-4aad-a9ea-8f279933b819 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:32:05.265499 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 606d90a8-f9cd-4aad-a9ea-8f279933b819) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:05.270125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:05.270739 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.286275 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d7893b1-6988-455a-95d0-945fdb579225 None None] Network 606d90a8-f9cd-4aad-a9ea-8f279933b819 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:05.362797 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1e2d791-341c-4912-941a-4511ce3b561e req-fd19ec2c-c690-4c20-aa90-6f0ebb3883f0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:05.364710 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c1e2d791-341c-4912-941a-4511ce3b561e req-fd19ec2c-c690-4c20-aa90-6f0ebb3883f0 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 945 time: 0.0632348 Dec 10 14:32:05.373274 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a829091d-200c-4f82-ac17-79e99becd5e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.9237554 Dec 10 14:32:05.380640 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59682) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:05.386149 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'subnet': {'network_id': 'b0b8dc19-b292-40b4-8b6e-993b1d9437ae', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:05.397082 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-606d90a8-f9cd-4aad-a9ea-8f279933b819', 'network_id': '606d90a8-f9cd-4aad-a9ea-8f279933b819', 'project_id': 'f4458d42f98847a7909268deb386f7a6', 'fixed_ips': [{'subnet_id': 'ddedaae7-20f0-4b7a-94cb-f962123b7632'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:32:05.399484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.494730 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c1e2d791-341c-4912-941a-4511ce3b561e req-9afff6d3-1e97-4851-b1ac-ae119955672f tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1198277 Dec 10 14:32:05.495376 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a2b7edc6-4894-4ae3-8781-2efb8581a225 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.497552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a2b7edc6-4894-4ae3-8781-2efb8581a225 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.499306 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a2b7edc6-4894-4ae3-8781-2efb8581a225 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/264b84f5-c1d6-4886-aae9-37e3dc7dfc0a HTTP/1.1" status: 204 len: 168 time: 0.6861243 Dec 10 14:32:05.501290 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59684) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:05.524962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b7edc6-4894-4ae3-8781-2efb8581a225 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=264b84f5-c1d6-4886-aae9-37e3dc7dfc0a,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:05.573385 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f4912f92-974b-4ad6-a565-3fbaffa102e9 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0670877 Dec 10 14:32:05.573385 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59688) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:05.577146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Allocated IP 2001:db8::2 (606d90a8-f9cd-4aad-a9ea-8f279933b819/ddedaae7-20f0-4b7a-94cb-f962123b7632/662cdb4d-d8ff-490c-88c1-d69cb3577e0d) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:05.579072 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e8062eba-bcbf-4609-8a08-fb4ff120945a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-secgroup--1908676668'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:05.644931 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Made reservation on behalf of f4458d42f98847a7909268deb386f7a6 for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:05.648588 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.663719 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.738647 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fce849f-884e-48aa-a8ca-e3d15c70b44c req-5738e6ab-a6a4-4d62-84ff-c666beb134f2 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:05.740211 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0fce849f-884e-48aa-a8ca-e3d15c70b44c req-5738e6ab-a6a4-4d62-84ff-c666beb134f2 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 945 time: 0.1331208 Dec 10 14:32:05.794359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e8062eba-bcbf-4609-8a08-fb4ff120945a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.845936 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0fce849f-884e-48aa-a8ca-e3d15c70b44c req-8a1b6ede-e766-43f4-a50e-2d099dd6e83c tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "GET /v2.0/security-groups?id=86f9ef55-d8a0-4e93-a6a9-e2c927f963a5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0952544 Dec 10 14:32:05.869962 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59690) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:05.880762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.899556 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9e515e57-cb88-4daa-8042-7c6664cc1317 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:32:05.967201 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e8062eba-bcbf-4609-8a08-fb4ff120945a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:05.996837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.044054 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:32:06.044976 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Network 606d90a8-f9cd-4aad-a9ea-8f279933b819 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:06.052451 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:06.052850 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:06.054726 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e73f277-738b-4f4a-8ef7-9f2b3e22cd90 tempest-TestVolumeBootPattern-566671055 tempest-TestVolumeBootPattern-566671055-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:06.058911 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8e73f277-738b-4f4a-8ef7-9f2b3e22cd90 tempest-TestVolumeBootPattern-566671055 tempest-TestVolumeBootPattern-566671055-project-admin] 10.222.0.57 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1093 time: 0.1853020 Dec 10 14:32:06.059112 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Sync routers for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:32:06.059672 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.060331 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59694) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:06.061629 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Pushing event updated for resources: {'Port': ['ID=662cdb4d-d8ff-490c-88c1-d69cb3577e0d,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:06.065697 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'fixed_ip_address': '172.20.0.9'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:06.096362 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:06.097006 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:06.106141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e8062eba-bcbf-4609-8a08-fb4ff120945a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.153655 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Subnet': ['ID=521465a1-ba8d-4123-9da4-889e47221956,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:06.162633 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8062eba-bcbf-4609-8a08-fb4ff120945a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d8ec11cb-280a-43bc-9b67-0b9884e23c73,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:06.171316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Checking segment: {'id': '215c5420-57ae-4a4f-882c-b978566f4fc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b0b8dc19-b292-40b4-8b6e-993b1d9437ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:06.171723 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network hostable DHCP agents. Network: b0b8dc19-b292-40b4-8b6e-993b1d9437ae, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:32:06.176163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.177668 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8bcc9bd1-4f83-4359-a434-885fb5cbf040 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 3.3726377 Dec 10 14:32:06.180512 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Attempting to bind port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:32:06.180705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59696) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:06.180924 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Attempting to bind port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '69f5a656-a617-4178-981e-491620f56b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '606d90a8-f9cd-4aad-a9ea-8f279933b819'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:32:06.181294 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Attempting to bind port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d on network 606d90a8-f9cd-4aad-a9ea-8f279933b819 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:06.191632 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:32:06.192023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Checking segment: {'id': '69f5a656-a617-4178-981e-491620f56b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '606d90a8-f9cd-4aad-a9ea-8f279933b819'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:06.192424 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.192817 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Bound using segment: {'id': '69f5a656-a617-4178-981e-491620f56b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '606d90a8-f9cd-4aad-a9ea-8f279933b819'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:32:06.193295 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Bound port: 662cdb4d-d8ff-490c-88c1-d69cb3577e0d, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '69f5a656-a617-4178-981e-491620f56b76', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 374, 'network_id': '606d90a8-f9cd-4aad-a9ea-8f279933b819'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:32:06.193718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.210947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e8062eba-bcbf-4609-8a08-fb4ff120945a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.214959 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e8062eba-bcbf-4609-8a08-fb4ff120945a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.6378479 Dec 10 14:32:06.215918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59698) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:06.225053 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-49e4cdfc-f63d-4531-8f9d-c78cf2600cd4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'd8ec11cb-280a-43bc-9b67-0b9884e23c73', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:06.225222 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ea91e4d9-6fcf-4959-a6eb-21d3f9cb888e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?project_id=c0bfba20c10d46e1abb38c3a54bd852b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0395706 Dec 10 14:32:06.225222 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59700) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:06.276927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network b0b8dc19-b292-40b4-8b6e-993b1d9437ae is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:32:06.293009 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:06.325510 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for floatingip, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.350776 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.356178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] For port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:32:06.368848 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, b0b8dc19-b292-40b4-8b6e-993b1d9437ae) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:06.385758 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:06.385758 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.403086 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3e175e1-d847-4dc0-9824-0165a3fb9833 None None] Network b0b8dc19-b292-40b4-8b6e-993b1d9437ae requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:06.410077 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-49e4cdfc-f63d-4531-8f9d-c78cf2600cd4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.414710 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] For port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=662cdb4d-d8ff-490c-88c1-d69cb3577e0d,segment=NetworkSegment(69f5a656-a617-4178-981e-491620f56b76),segment_id=69f5a656-a617-4178-981e-491620f56b76)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:32:06.443087 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c25da130-23f6-4e35-86f4-e259a5874c4c tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:06.444626 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c25da130-23f6-4e35-86f4-e259a5874c4c tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2185185 Dec 10 14:32:06.447749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59702) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:06.484918 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6ee8b49a-295c-4a4b-a250-4684cf40d6d3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0360000 Dec 10 14:32:06.487461 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59704) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:06.492748 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-113463244', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:06.503112 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-49e4cdfc-f63d-4531-8f9d-c78cf2600cd4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.514619 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-01287f8c-f6ca-4437-8546-5baca62a81bd tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1328270 Dec 10 14:32:06.517718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59706) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:06.550918 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.558273 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.586544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-b0b8dc19-b292-40b4-8b6e-993b1d9437ae', 'network_id': 'b0b8dc19-b292-40b4-8b6e-993b1d9437ae', 'project_id': 'f4458d42f98847a7909268deb386f7a6', 'fixed_ips': [{'subnet_id': '521465a1-ba8d-4123-9da4-889e47221956'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:32:06.586544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.613870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-49e4cdfc-f63d-4531-8f9d-c78cf2600cd4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.646666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96550787-b557-4012-93a9-1cdd346d7ad6 None None] Pushing event updated for resources: {'Port': ['ID=662cdb4d-d8ff-490c-88c1-d69cb3577e0d,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:06.693528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49e4cdfc-f63d-4531-8f9d-c78cf2600cd4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=99fc3083-cdf9-4dc0-bd75-f558b50157a7,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:06.717664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:04Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:06.725253 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Allocated IP 172.26.2.107 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/40d25b7f-9687-4fec-b61f-4bd2b00daf0b) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:06.727685 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:06.731923 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.754833 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Checking router: 9e515e57-cb88-4daa-8042-7c6664cc1317 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:32:06.755020 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Updating router 9e515e57-cb88-4daa-8042-7c6664cc1317 port d3220285-7992-4fb1-9ccf-a69cee14808d binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:32:06.801734 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 21c21f2e-6cb8-441b-be34-168cc8bdad54 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:06.839761 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.853977 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-49e4cdfc-f63d-4531-8f9d-c78cf2600cd4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.863151 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-49e4cdfc-f63d-4531-8f9d-c78cf2600cd4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.6424525 Dec 10 14:32:06.863151 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59708) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:06.866274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-052a88b2-0679-404a-b96d-aca2357f2e17 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'd8ec11cb-280a-43bc-9b67-0b9884e23c73', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:06.890360 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Allocated IP 2001:db8::2 (b0b8dc19-b292-40b4-8b6e-993b1d9437ae/521465a1-ba8d-4123-9da4-889e47221956/53c382b9-237d-4077-af08-ab507ccd90dc) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:06.979608 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:06.985768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.083575 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 21c21f2e-6cb8-441b-be34-168cc8bdad54 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:07.083952 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.155148 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.209964 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.286082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:07.294426 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Subnet': ['ID=4f430ec7-91c3-4707-a417-018d2e296df6,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:07.298087 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.298268 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:07.300328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:07.302674 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'Port': ['ID=40d25b7f-9687-4fec-b61f-4bd2b00daf0b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:07.330508 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Checking segment: {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:07.330879 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network hostable DHCP agents. Network: ff92c14f-f9fb-4f05-9886-7825120a4f21, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:32:07.354552 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-052a88b2-0679-404a-b96d-aca2357f2e17 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.399755 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.457773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:32:07.490521 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Network b0b8dc19-b292-40b4-8b6e-993b1d9437ae is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:07.499168 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:07.512611 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.515801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:07.531191 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Pushing event updated for resources: {'Port': ['ID=53c382b9-237d-4077-af08-ab507ccd90dc,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:07.563009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-052a88b2-0679-404a-b96d-aca2357f2e17 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.564019 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, ff92c14f-f9fb-4f05-9886-7825120a4f21) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:07.574838 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:07.576940 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.603387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5e971d8-b2d5-4b5d-bcae-c92ab0650ec9 None None] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:07.603387 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.665954 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Allocated IP 2001:db8::1 (606d90a8-f9cd-4aad-a9ea-8f279933b819/ddedaae7-20f0-4b7a-94cb-f962123b7632/160f80b7-8b70-4c4b-b3c4-040c7a49c5de) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:07.671791 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.682504 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-052a88b2-0679-404a-b96d-aca2357f2e17 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.682766 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1206ee6d-17a3-4547-b1da-fd2e07c5737b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 1.1914451 Dec 10 14:32:07.683589 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59710) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:07.749980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-052a88b2-0679-404a-b96d-aca2357f2e17 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba0b7472-32f8-48d6-8a7e-b1abd22f88e6,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:07.772180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3514c05f-e16d-48d9-ac2c-9efe89a7c7a0 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:32:07.774874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Attempting to bind port d3220285-7992-4fb1-9ccf-a69cee14808d on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:32:07.774874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Attempting to bind port d3220285-7992-4fb1-9ccf-a69cee14808d by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:32:07.774874 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Attempting to bind port d3220285-7992-4fb1-9ccf-a69cee14808d on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:07.789997 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:32:07.790376 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:07.791285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.791285 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:32:07.791646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Bound port: d3220285-7992-4fb1-9ccf-a69cee14808d, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:32:07.792034 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.833563 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Attempting to bind port 53c382b9-237d-4077-af08-ab507ccd90dc on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:32:07.833951 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Attempting to bind port 53c382b9-237d-4077-af08-ab507ccd90dc by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '215c5420-57ae-4a4f-882c-b978566f4fc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b0b8dc19-b292-40b4-8b6e-993b1d9437ae'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:32:07.834295 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Attempting to bind port 53c382b9-237d-4077-af08-ab507ccd90dc on network b0b8dc19-b292-40b4-8b6e-993b1d9437ae {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:07.836026 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-052a88b2-0679-404a-b96d-aca2357f2e17 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.840106 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-052a88b2-0679-404a-b96d-aca2357f2e17 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.9757540 Dec 10 14:32:07.849809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59712) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:07.849965 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88997d90-9ab5-4875-9401-a4ad54c37116 None None] Pushing event updated for resources: {'Port': ['ID=d3220285-7992-4fb1-9ccf-a69cee14808d,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:07.850073 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-304313ab-04c7-426e-b272-5d416e1489b5 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'd8ec11cb-280a-43bc-9b67-0b9884e23c73', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:07.871471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 31, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:32:07.871471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Checking segment: {'id': '215c5420-57ae-4a4f-882c-b978566f4fc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b0b8dc19-b292-40b4-8b6e-993b1d9437ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:07.871471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.871471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Bound using segment: {'id': '215c5420-57ae-4a4f-882c-b978566f4fc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b0b8dc19-b292-40b4-8b6e-993b1d9437ae'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:32:07.871471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Bound port: 53c382b9-237d-4077-af08-ab507ccd90dc, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '215c5420-57ae-4a4f-882c-b978566f4fc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'b0b8dc19-b292-40b4-8b6e-993b1d9437ae'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:32:07.871471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.875167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:07.881974 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] For port d3220285-7992-4fb1-9ccf-a69cee14808d, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:32:07.914934 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] For port d3220285-7992-4fb1-9ccf-a69cee14808d, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d3220285-7992-4fb1-9ccf-a69cee14808d,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:32:07.979991 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-fdefe919-50fb-4bee-927b-0b7380c18d18 None None] Provisioning complete for port d3220285-7992-4fb1-9ccf-a69cee14808d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:07.980371 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fdefe919-50fb-4bee-927b-0b7380c18d18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.007980 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-304313ab-04c7-426e-b272-5d416e1489b5 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.021891 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-ff92c14f-f9fb-4f05-9886-7825120a4f21', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:32:08.022769 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.040903 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.051622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.136574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network 606d90a8-f9cd-4aad-a9ea-8f279933b819 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:08.148203 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:08.151611 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-304313ab-04c7-426e-b272-5d416e1489b5 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.157363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Port': ['ID=160f80b7-8b70-4c4b-b3c4-040c7a49c5de,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:08.157363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:08.157363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.226705 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7b6f5bf-611e-405e-a63f-c9ca7d6be887 None None] Network 606d90a8-f9cd-4aad-a9ea-8f279933b819 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:08.237508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-304313ab-04c7-426e-b272-5d416e1489b5 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.237759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.241999 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.263484 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-304313ab-04c7-426e-b272-5d416e1489b5 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=daf16ec1-52eb-4124-a2a3-9686f8c04aea,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:08.291566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] For port 53c382b9-237d-4077-af08-ab507ccd90dc, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:32:08.327906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-fdefe919-50fb-4bee-927b-0b7380c18d18 None None] Port d3220285-7992-4fb1-9ccf-a69cee14808d cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:32:08.352753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5bfb2a98-3694-4062-a64d-652a8bfc7fc4 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:32:08.360874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-304313ab-04c7-426e-b272-5d416e1489b5 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.362579 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-304313ab-04c7-426e-b272-5d416e1489b5 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5210795 Dec 10 14:32:08.365297 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59714) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:08.368919 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] For port 53c382b9-237d-4077-af08-ab507ccd90dc, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=53c382b9-237d-4077-af08-ab507ccd90dc,segment=NetworkSegment(215c5420-57ae-4a4f-882c-b978566f4fc2),segment_id=215c5420-57ae-4a4f-882c-b978566f4fc2)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:32:08.372596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8703da8b-4cd3-485c-919e-adb817024370 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'd8ec11cb-280a-43bc-9b67-0b9884e23c73', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:08.441958 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.455701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:08.456752 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:08.466757 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.503225 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.508367 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88997d90-9ab5-4875-9401-a4ad54c37116 None None] Pushing event updated for resources: {'Port': ['ID=d3220285-7992-4fb1-9ccf-a69cee14808d,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:08.544539 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8703da8b-4cd3-485c-919e-adb817024370 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.622705 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.641218 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Provisioning complete for port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:08.641218 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.690734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8703da8b-4cd3-485c-919e-adb817024370 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.717778 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.834915 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d26852ef-4934-4e23-98e3-03fca2136c67 None None] Pushing event updated for resources: {'Port': ['ID=53c382b9-237d-4077-af08-ab507ccd90dc,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:08.843260 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.854086 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:08.889646 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 662cdb4d-d8ff-490c-88c1-d69cb3577e0d up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:08.938243 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Allocated IP 172.20.0.2 (ff92c14f-f9fb-4f05-9886-7825120a4f21/4f430ec7-91c3-4707-a417-018d2e296df6/1af57c2e-8c3e-4123-86ea-7a0896813e59) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:08.975772 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.976821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:08.981466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.138371 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Port': ['ID=160f80b7-8b70-4c4b-b3c4-040c7a49c5de,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:09.193446 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network 606d90a8-f9cd-4aad-a9ea-8f279933b819 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:09.196575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:09.224426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:09.224943 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.253211 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.277533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8703da8b-4cd3-485c-919e-adb817024370 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.358100 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Pushing event updated for resources: {'Port': ['ID=40d25b7f-9687-4fec-b61f-4bd2b00daf0b,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:09.366990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8703da8b-4cd3-485c-919e-adb817024370 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6ed060c6-7625-4377-8ac1-8cd90bf665e3,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:09.377427 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.419635 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Router 48fa50cb-7624-4300-9594-221d351f4dd0 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103811) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:32:09.425018 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.465064 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] For port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=662cdb4d-d8ff-490c-88c1-d69cb3577e0d,segment=NetworkSegment(69f5a656-a617-4178-981e-491620f56b76),segment_id=69f5a656-a617-4178-981e-491620f56b76)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:09.466626 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.508923 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:09.517291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:09.524323 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:09.535646 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8703da8b-4cd3-485c-919e-adb817024370 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.535646 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8703da8b-4cd3-485c-919e-adb817024370 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 1.1687808 Dec 10 14:32:09.535975 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.540158 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59716) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:09.546430 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-f29fe7be-7af8-49d9-9f32-577d9f4617e0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'd8ec11cb-280a-43bc-9b67-0b9884e23c73', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:09.582630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:32:09.589818 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6bc430b6-a8cb-46dc-9c90-a4d0d3d77623 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "PUT /v2.0/routers/48fa50cb-7624-4300-9594-221d351f4dd0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0707591 Dec 10 14:32:09.592878 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59718) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:09.593031 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Pushing event updated for resources: {'Port': ['ID=1af57c2e-8c3e-4123-86ea-7a0896813e59,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:09.596744 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2061842-ec3b-4b6f-b065-244599e040af None None] Sync routers for ids ['48fa50cb-7624-4300-9594-221d351f4dd0'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:32:09.601951 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Floating IP 047e557e-05b9-4095-a4de-a0549f264671 associated. External IP: 172.26.2.107, port: aaad23d0-018e-4bc3-96f5-29b61ee40dc1. Dec 10 14:32:09.615491 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2061842-ec3b-4b6f-b065-244599e040af None None] Routers {'48fa50cb-7624-4300-9594-221d351f4dd0'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:09.616466 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d2061842-ec3b-4b6f-b065-244599e040af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['48fa50cb-7624-4300-9594-221d351f4dd0'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:09.707048 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Provisioning complete for port d3220285-7992-4fb1-9ccf-a69cee14808d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:09.713753 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.746418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.1 (ff92c14f-f9fb-4f05-9886-7825120a4f21/4f430ec7-91c3-4707-a417-018d2e296df6/347bc2eb-e3db-42a3-b785-8d842864077c) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:09.778809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f29fe7be-7af8-49d9-9f32-577d9f4617e0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.840348 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Attempting to bind port 1af57c2e-8c3e-4123-86ea-7a0896813e59 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:32:09.840718 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Attempting to bind port 1af57c2e-8c3e-4123-86ea-7a0896813e59 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:32:09.841082 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Attempting to bind port 1af57c2e-8c3e-4123-86ea-7a0896813e59 on network ff92c14f-f9fb-4f05-9886-7825120a4f21 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:09.858286 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:04Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:09.864195 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Pushing event updated for resources: {'Port': ['ID=662cdb4d-d8ff-490c-88c1-d69cb3577e0d,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:09.876303 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 32, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:32:09.876684 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Checking segment: {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:09.877097 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.877535 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Bound using segment: {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:32:09.878039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Bound port: 1af57c2e-8c3e-4123-86ea-7a0896813e59, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:32:09.878426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.885656 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d2061842-ec3b-4b6f-b065-244599e040af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:09.912086 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2061842-ec3b-4b6f-b065-244599e040af None None] Routers {'48fa50cb-7624-4300-9594-221d351f4dd0'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:09.912729 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d2061842-ec3b-4b6f-b065-244599e040af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['48fa50cb-7624-4300-9594-221d351f4dd0'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:09.939395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f29fe7be-7af8-49d9-9f32-577d9f4617e0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:09.944649 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9445a4cc-686c-4042-8ffb-a6a1aa85ff90 None None] The sync data for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv is: [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:04Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:32:09.974152 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-d2061842-ec3b-4b6f-b065-244599e040af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:09.985136 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2061842-ec3b-4b6f-b065-244599e040af None None] The sync data for ids ['48fa50cb-7624-4300-9594-221d351f4dd0'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:32:10.046458 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:32:10.051999 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f29fe7be-7af8-49d9-9f32-577d9f4617e0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.071833 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.083271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] For port 1af57c2e-8c3e-4123-86ea-7a0896813e59, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:32:10.089931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] For port 1af57c2e-8c3e-4123-86ea-7a0896813e59, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1af57c2e-8c3e-4123-86ea-7a0896813e59,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:32:10.100663 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] For port d3220285-7992-4fb1-9ccf-a69cee14808d, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d3220285-7992-4fb1-9ccf-a69cee14808d,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:10.131920 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f29fe7be-7af8-49d9-9f32-577d9f4617e0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=08d1cf04-0317-4f70-a201-82d4c943ddf7,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:10.136768 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.175143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.228430 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b56c2269-dca0-435f-aa16-1b080f012c49 None None] Network b0b8dc19-b292-40b4-8b6e-993b1d9437ae requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:10.261949 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:32:10.263942 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.289204 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-f29fe7be-7af8-49d9-9f32-577d9f4617e0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.293839 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f29fe7be-7af8-49d9-9f32-577d9f4617e0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.7490506 Dec 10 14:32:10.295418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59722) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:10.304632 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] Sync routers for ids ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:32:10.324385 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fc4a149-9120-47a4-9427-527c2fafb7f3 None None] Pushing event updated for resources: {'Port': ['ID=1af57c2e-8c3e-4123-86ea-7a0896813e59,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:10.333574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.347513 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.354076 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-74c40e48-b758-4d21-9048-20233696e8e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:32:10.355151 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-74c40e48-b758-4d21-9048-20233696e8e2 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "PUT /v2.0/routers/48fa50cb-7624-4300-9594-221d351f4dd0/add_router_interface HTTP/1.1" status: 400 len: 438 time: 0.7609642 Dec 10 14:32:10.358595 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59724) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:10.399405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.436754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] Routers {'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:10.437531 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:10.454051 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f436857c-3636-4068-ba97-d841d2925809 tempest-TestVolumeBootPattern-2074636446 tempest-TestVolumeBootPattern-2074636446-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 4.3914983 Dec 10 14:32:10.456851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Provisioning complete for port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:10.457220 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.458309 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.461655 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'tag': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:32:10.467199 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-32434619-2e0e-4412-a116-17d777f665e0" -d '{"events": [{"name": "network-changed", "server_uuid": "639cb4fb-fcb2-41bb-8528-734e490b8575", "tag": "aaad23d0-018e-4bc3-96f5-29b61ee40dc1"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:32:10.496642 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.523249 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.535103 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/08d1cf04-0317-4f70-a201-82d4c943ddf7 HTTP/1.1" status: 204 len: 168 time: 0.2372072 Dec 10 14:32:10.564504 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:32:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2dcd6662-6169-486a-8023-86ba08fdd72a x-openstack-request-id: req-2dcd6662-6169-486a-8023-86ba08fdd72a {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:32:10.564895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "639cb4fb-fcb2-41bb-8528-734e490b8575", "tag": "aaad23d0-018e-4bc3-96f5-29b61ee40dc1", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:32:10.565409 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-2dcd6662-6169-486a-8023-86ba08fdd72a {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:32:10.566098 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'tag': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1', 'status': 'completed', 'code': 200} Dec 10 14:32:10.566989 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59730) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:10.577130 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:10.579772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=08d1cf04-0317-4f70-a201-82d4c943ddf7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:10.614846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:10.640227 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:10.675685 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.676178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.676535 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.676881 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.677226 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.677620 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.678099 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.678440 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.678769 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.679410 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.680022 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.680885 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.681393 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17388c78-0f40-4217-b5e6-3a2968a5f52d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:10.862327 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.921787 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:10.930356 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88641b87-c535-4c4a-905d-504c06549f3c None None] Pushing event updated for resources: {'Port': ['ID=d3220285-7992-4fb1-9ccf-a69cee14808d,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:10.967493 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=347bc2eb-e3db-42a3-b785-8d842864077c,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:11.003191 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-011fd1a1-17a6-4d74-8cb2-fde2834ded18 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5731 time: 0.4110398 Dec 10 14:32:11.008644 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59732) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:11.042071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32434619-2e0e-4412-a116-17d777f665e0 req-b2bafbee-24c3-44b8-8671-cda77c6f8b9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:11.044268 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-32434619-2e0e-4412-a116-17d777f665e0 req-b2bafbee-24c3-44b8-8671-cda77c6f8b9a service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1098 time: 0.4406631 Dec 10 14:32:11.137003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 53c382b9-237d-4077-af08-ab507ccd90dc up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:11.141171 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] Set router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:11.177074 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8a9c-89b9-4077-9e53-61c43002ad08 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.215306 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8a9c-89b9-4077-9e53-61c43002ad08 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.283957 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32434619-2e0e-4412-a116-17d777f665e0 req-6366b19b-925f-47cd-912a-e906b7bc15c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:11.287029 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-32434619-2e0e-4412-a116-17d777f665e0 req-6366b19b-925f-47cd-912a-e906b7bc15c4 service neutron] 10.222.0.39 "GET /v2.0/networks?id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f HTTP/1.1" status: 200 len: 913 time: 0.2345152 Dec 10 14:32:11.334643 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Provisioning complete for port 160f80b7-8b70-4c4b-b3c4-040c7a49c5de triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:11.335018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.415628 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-32434619-2e0e-4412-a116-17d777f665e0 req-9cbdbcdd-9622-478c-9c06-400b3c355a4a service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1 HTTP/1.1" status: 200 len: 999 time: 0.1161644 Dec 10 14:32:11.429596 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8a9c-89b9-4077-9e53-61c43002ad08 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.464311 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8a9c-89b9-4077-9e53-61c43002ad08 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.473402 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59734) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:11.474904 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d4ac8a9c-89b9-4077-9e53-61c43002ad08 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/6ed060c6-7625-4377-8ac1-8cd90bf665e3 HTTP/1.1" status: 204 len: 168 time: 0.4523301 Dec 10 14:32:11.478589 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Port 160f80b7-8b70-4c4b-b3c4-040c7a49c5de cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:32:11.523801 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32434619-2e0e-4412-a116-17d777f665e0 req-068d0430-5422-4281-92d9-06eaf5e11751 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:11.525564 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-32434619-2e0e-4412-a116-17d777f665e0 req-068d0430-5422-4281-92d9-06eaf5e11751 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=d34297eb-b45e-40a3-93a5-fff721097da7 HTTP/1.1" status: 200 len: 851 time: 0.1010001 Dec 10 14:32:11.526057 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 53c382b9-237d-4077-af08-ab507ccd90dc triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:11.526539 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.536573 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ac8a9c-89b9-4077-9e53-61c43002ad08 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=6ed060c6-7625-4377-8ac1-8cd90bf665e3,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:11.571743 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.586615 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Provisioning complete for port 53c382b9-237d-4077-af08-ab507ccd90dc triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:11.586990 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.603123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32434619-2e0e-4412-a116-17d777f665e0 req-774810ef-2f29-44eb-82b8-43f2eb41734b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:11.604536 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-32434619-2e0e-4412-a116-17d777f665e0 req-774810ef-2f29-44eb-82b8-43f2eb41734b service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0694644 Dec 10 14:32:11.629818 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3e79d063-e0a3-4d09-ae1e-b3eca53b937d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5190 time: 0.1544690 Dec 10 14:32:11.632361 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59736) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:11.707966 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fcd720d3-f371-436a-9eec-0943061b8921 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.718168 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fcd720d3-f371-436a-9eec-0943061b8921 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.754838 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.762207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227'}], 'enable_snat': True}, 'gw_port_id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:23Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'gw_port': {'id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:3d:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1170, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '047e557e-05b9-4095-a4de-a0549f264671', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'floating_ip_address': '172.26.2.107', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'port_id': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1334, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'mac_address': 'fa:16:3e:56:71:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:32:07Z', 'updated_at': '2021-12-10T14:32:07Z', 'revision_number': 0, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cf294aa3-861a-4d96-9cb0-1603daad8c42', 'name': '', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'mac_address': 'fa:16:3e:12:06:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 1180, 'fixed_ips': [{'subnet_id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:30Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 5, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'subnets': [{'id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:11.771043 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.804048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Deleting port 160f80b7-8b70-4c4b-b3c4-040c7a49c5de {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:11.804443 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.806967 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] Checking router: f78b2a0b-2685-4e50-9ccf-f76675b8f1ff for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:32:11.843469 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] Routers {'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:11.844099 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:11.847926 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] For port 53c382b9-237d-4077-af08-ab507ccd90dc, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=53c382b9-237d-4077-af08-ab507ccd90dc,segment=NetworkSegment(215c5420-57ae-4a4f-882c-b978566f4fc2),segment_id=215c5420-57ae-4a4f-882c-b978566f4fc2)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:11.865847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fcd720d3-f371-436a-9eec-0943061b8921 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.874873 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-fcd720d3-f371-436a-9eec-0943061b8921 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.880065 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-fcd720d3-f371-436a-9eec-0943061b8921 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/daf16ec1-52eb-4124-a2a3-9686f8c04aea HTTP/1.1" status: 204 len: 168 time: 0.2424765 Dec 10 14:32:11.880065 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59738) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:11.885820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe497a8c-64c7-4ef1-a9c3-d86bc0279442 None None] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:11.902346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcd720d3-f371-436a-9eec-0943061b8921 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=daf16ec1-52eb-4124-a2a3-9686f8c04aea,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:11.938075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.939421 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 662cdb4d-d8ff-490c-88c1-d69cb3577e0d up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:11.945306 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:11.977940 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3718611f-f35b-4c14-b722-b3c9eb1c2ef3 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4649 time: 0.0947816 Dec 10 14:32:11.978170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59740) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:11.992308 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Calling delete_port for 160f80b7-8b70-4c4b-b3c4-040c7a49c5de owned by network:router_interface {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:11.993743 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-32434619-2e0e-4412-a116-17d777f665e0 req-9c2ff428-d494-4877-a123-9e54cc4a7f4d service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3671672 Dec 10 14:32:12.018893 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bc1bfa07-b233-43d7-bd1c-d1eaa8332220 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.055763 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bc1bfa07-b233-43d7-bd1c-d1eaa8332220 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.058747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.105682 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-32434619-2e0e-4412-a116-17d777f665e0 req-a4d79678-4892-4db1-9907-8b8959ea299b service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1028559 Dec 10 14:32:12.120901 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:32:12.121250 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-9e0523ea-4b31-4a3f-815d-c6f9a2cb0aae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:32:12.122131 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.131588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Pushing event updated for resources: {'Port': ['ID=53c382b9-237d-4077-af08-ab507ccd90dc,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:12.146178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] Set router f78b2a0b-2685-4e50-9ccf-f76675b8f1ff gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:12.184615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bc1bfa07-b233-43d7-bd1c-d1eaa8332220 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.198569 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bc1bfa07-b233-43d7-bd1c-d1eaa8332220 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.199457 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bc1bfa07-b233-43d7-bd1c-d1eaa8332220 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/ba0b7472-32f8-48d6-8a7e-b1abd22f88e6 HTTP/1.1" status: 204 len: 168 time: 0.2203526 Dec 10 14:32:12.205168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59742) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:12.209151 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc1bfa07-b233-43d7-bd1c-d1eaa8332220 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=ba0b7472-32f8-48d6-8a7e-b1abd22f88e6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:12.231146 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.236035 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=347bc2eb-e3db-42a3-b785-8d842864077c,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:12.267953 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:12.269290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.313244 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4e6e49b3-3014-470a-b2a1-3cf1a2f7211e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4108 time: 0.1068041 Dec 10 14:32:12.316182 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59744) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:12.329932 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.373993 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8262e13d-d9fb-4cbf-abcd-9e0ae6ac687f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.376416 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Port': ['ID=160f80b7-8b70-4c4b-b3c4-040c7a49c5de,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:12.394400 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8262e13d-d9fb-4cbf-abcd-9e0ae6ac687f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.417552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:12.422055 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:12.612612 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.620822 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8262e13d-d9fb-4cbf-abcd-9e0ae6ac687f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.627878 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d3220285-7992-4fb1-9ccf-a69cee14808d up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:12.640037 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8262e13d-d9fb-4cbf-abcd-9e0ae6ac687f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:12.647764 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8262e13d-d9fb-4cbf-abcd-9e0ae6ac687f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/99fc3083-cdf9-4dc0-bd75-f558b50157a7 HTTP/1.1" status: 204 len: 168 time: 0.3282547 Dec 10 14:32:12.672262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59746) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:12.708955 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8262e13d-d9fb-4cbf-abcd-9e0ae6ac687f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=99fc3083-cdf9-4dc0-bd75-f558b50157a7,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:12.778196 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f6b8035d-af50-412c-822b-ec81193458fe tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1030629 Dec 10 14:32:12.781337 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9e515e57-cb88-4daa-8042-7c6664cc1317 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:32:12.782237 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59748) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:12.809986 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227'}], 'enable_snat': True}, 'gw_port_id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:23Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'gw_port': {'id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:3d:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1170, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '047e557e-05b9-4095-a4de-a0549f264671', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'floating_ip_address': '172.26.2.107', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'port_id': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1334, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'mac_address': 'fa:16:3e:56:71:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:32:07Z', 'updated_at': '2021-12-10T14:32:07Z', 'revision_number': 0, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cf294aa3-861a-4d96-9cb0-1603daad8c42', 'name': '', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'mac_address': 'fa:16:3e:12:06:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 1180, 'fixed_ips': [{'subnet_id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:30Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 5, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'subnets': [{'id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:12.890634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Router 48fa50cb-7624-4300-9594-221d351f4dd0 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:32:13.023041 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:32:13.028329 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6e086658-aaf8-498b-955d-9ea000ad0431 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "PUT /v2.0/routers/48fa50cb-7624-4300-9594-221d351f4dd0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6687005 Dec 10 14:32:13.038789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:32:13.038789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-de1e5460-c5e3-4a68-b82f-f22c33f37b7e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.038789 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59750) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:13.042601 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c17ac2e-ca4f-490a-a52d-df70414863ec None None] Sync routers for ids ['48fa50cb-7624-4300-9594-221d351f4dd0'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:32:13.052452 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5f71870a-7cc6-4bcf-8e9b-0d69e40eae88 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/routers/9e515e57-cb88-4daa-8042-7c6664cc1317/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3434644 Dec 10 14:32:13.055157 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59752) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:13.059325 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c17ac2e-ca4f-490a-a52d-df70414863ec None None] Routers {'48fa50cb-7624-4300-9594-221d351f4dd0'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:13.060303 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8c17ac2e-ca4f-490a-a52d-df70414863ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['48fa50cb-7624-4300-9594-221d351f4dd0'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:13.083022 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Sync routers for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:32:13.088381 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-c67c2b20-d277-41a3-982d-b5409e4c9079 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] delete failed (client error): The resource could not be found. Dec 10 14:32:13.090102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-575493b4-4c22-494d-a1fb-b8a3c199954d None None] The sync data for ids ['f78b2a0b-2685-4e50-9ccf-f76675b8f1ff'] in dv-neutron-821401-2-hyperv is: [{'id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'name': 'tempest-TestVolumeBootPattern-2025304854-router', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227'}], 'enable_snat': True}, 'gw_port_id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:30:23Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'gw_port': {'id': '40d334eb-b103-4069-ab9a-9a2090c6f40b', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:3d:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1170, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:24Z', 'updated_at': '2021-12-10T14:30:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '047e557e-05b9-4095-a4de-a0549f264671', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'floating_ip_address': '172.26.2.107', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'port_id': 'aaad23d0-018e-4bc3-96f5-29b61ee40dc1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1334, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'mac_address': 'fa:16:3e:56:71:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '639cb4fb-fcb2-41bb-8528-734e490b8575', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:32:07Z', 'updated_at': '2021-12-10T14:32:07Z', 'revision_number': 0, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cf294aa3-861a-4d96-9cb0-1603daad8c42', 'name': '', 'network_id': 'e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f', 'tenant_id': 'a1d5a7f281834a22aee867878a76c226', 'mac_address': 'fa:16:3e:12:06:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f78b2a0b-2685-4e50-9ccf-f76675b8f1ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 1180, 'fixed_ips': [{'subnet_id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:30:30Z', 'updated_at': '2021-12-10T14:30:41Z', 'revision_number': 5, 'project_id': 'a1d5a7f281834a22aee867878a76c226', 'subnets': [{'id': 'd34297eb-b45e-40a3-93a5-fff721097da7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:32:13.094355 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c67c2b20-d277-41a3-982d-b5409e4c9079 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/routers/tempest-non_exist_router-1779228864 HTTP/1.1" status: 404 len: 335 time: 0.0548389 Dec 10 14:32:13.094939 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59754) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:13.105351 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a59fa180-098c-4cf8-92a7-597bd5369264 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'router': {'external_gateway_info': {'network_id': '48fa50cb-7624-4300-9594-221d351f4dd0'}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:13.107754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d3220285-7992-4fb1-9ccf-a69cee14808d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:13.108402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.120368 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8c17ac2e-ca4f-490a-a52d-df70414863ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:13.156086 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-de1e5460-c5e3-4a68-b82f-f22c33f37b7e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.163958 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c17ac2e-ca4f-490a-a52d-df70414863ec None None] Routers {'48fa50cb-7624-4300-9594-221d351f4dd0'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:13.165266 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8c17ac2e-ca4f-490a-a52d-df70414863ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['48fa50cb-7624-4300-9594-221d351f4dd0'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:13.167080 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Provisioning complete for port 1af57c2e-8c3e-4123-86ea-7a0896813e59 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:13.168023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.233575 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-8c17ac2e-ca4f-490a-a52d-df70414863ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:13.234548 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c17ac2e-ca4f-490a-a52d-df70414863ec None None] The sync data for ids ['48fa50cb-7624-4300-9594-221d351f4dd0'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:32:13.239038 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:13.241922 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:13.392420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.392420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.392420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.392420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.392420 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.393027 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.393386 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.393927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.394486 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.399671 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dd4f997f-1fd7-4ffd-a2bc-9356207ac29e tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/networks HTTP/1.1" status: 200 len: 6366 time: 0.3434544 Dec 10 14:32:13.400607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59756) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:13.425751 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a59fa180-098c-4cf8-92a7-597bd5369264 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.437635 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:13.484273 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f4592ec-09e9-4bc1-97b6-e051e7b6ac3c None None] New status for floating IP 047e557e-05b9-4095-a4de-a0549f264671: ACTIVE {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:32:13.496728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1af57c2e-8c3e-4123-86ea-7a0896813e59 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:13.510580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.511132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.512068 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.512705 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.513212 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.514363 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.514870 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.515374 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.515872 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:13.520711 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-6626b38e-fded-45cf-bf96-39a589c23fc3 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 5841 time: 0.1162477 Dec 10 14:32:13.521021 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59758) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:13.535917 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.570444 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-a59fa180-098c-4cf8-92a7-597bd5369264 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] update failed (client error): The resource could not be found. Dec 10 14:32:13.575071 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a59fa180-098c-4cf8-92a7-597bd5369264 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "PUT /v2.0/routers/48fa50cb-7624-4300-9594-221d351f4dd0 HTTP/1.1" status: 404 len: 339 time: 0.4705815 Dec 10 14:32:13.575071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-de1e5460-c5e3-4a68-b82f-f22c33f37b7e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.575340 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59760) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:13.581317 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-18756432'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:13.582641 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-de1e5460-c5e3-4a68-b82f-f22c33f37b7e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.587542 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-de1e5460-c5e3-4a68-b82f-f22c33f37b7e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/d8ec11cb-280a-43bc-9b67-0b9884e23c73 HTTP/1.1" status: 204 len: 168 time: 0.8036108 Dec 10 14:32:13.587977 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59762) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:13.604982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de1e5460-c5e3-4a68-b82f-f22c33f37b7e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8ec11cb-280a-43bc-9b67-0b9884e23c73,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:13.641470 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-215b630a-89ae-4ac1-8e6d-6df050a29704 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0523202 Dec 10 14:32:13.647097 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59764) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:13.650406 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-05303a24-9c7e-497f-a287-7c3146cd9e50 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-secgroup--525645846'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:13.662137 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] For port 1af57c2e-8c3e-4123-86ea-7a0896813e59, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1af57c2e-8c3e-4123-86ea-7a0896813e59,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:13.709395 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 1af57c2e-8c3e-4123-86ea-7a0896813e59 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:13.709790 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.720600 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Made reservation on behalf of f4458d42f98847a7909268deb386f7a6 for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:13.724439 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.758445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] vlan segment allocate from pool success with {'vlan_id': 375, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:32:13.763216 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.772841 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.773210 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Added segment e234b2cd-f80c-460d-932e-e69ddc7c3fa1 of type vlan for network 6f123031-4246-43ac-959a-b1e973207559 Dec 10 14:32:13.822233 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05303a24-9c7e-497f-a287-7c3146cd9e50 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.842956 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Provisioning complete for port 347bc2eb-e3db-42a3-b785-8d842864077c triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:13.843331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.843824 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.869883 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Pushing event updated for resources: {'Port': ['ID=1af57c2e-8c3e-4123-86ea-7a0896813e59,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:13.919226 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05303a24-9c7e-497f-a287-7c3146cd9e50 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.923940 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Port 347bc2eb-e3db-42a3-b785-8d842864077c cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:32:13.930916 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 2, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:13.971676 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Checking router: 9e515e57-cb88-4daa-8042-7c6664cc1317 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:32:13.972035 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Updating router 9e515e57-cb88-4daa-8042-7c6664cc1317 port 347bc2eb-e3db-42a3-b785-8d842864077c binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:32:13.976783 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Provisioning complete for port 53c382b9-237d-4077-af08-ab507ccd90dc triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:13.977023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-98179de5-e084-436f-9f5d-441590f1cf2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:13.985839 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05303a24-9c7e-497f-a287-7c3146cd9e50 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.017120 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.026311 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:14.026715 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.027141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.109279 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f57d71b5-47d7-492e-9bf0-4a5a64c6dbce tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3590 time: 0.5867069 Dec 10 14:32:14.120405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 53c382b9-237d-4077-af08-ab507ccd90dc up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:14.126605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-05303a24-9c7e-497f-a287-7c3146cd9e50 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.130593 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-05303a24-9c7e-497f-a287-7c3146cd9e50 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4815509 Dec 10 14:32:14.133749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59768) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:14.139240 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-e235a6a9-b41d-41fd-892a-23e3bd93fee9 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': '39d60b70-a631-4e23-b177-84c1ae4de05d', 'direction': 'ingress', 'protocol': 17}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:14.151440 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05303a24-9c7e-497f-a287-7c3146cd9e50 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=39d60b70-a631-4e23-b177-84c1ae4de05d,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:14.153822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Network': ['ID=6f123031-4246-43ac-959a-b1e973207559,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:14.205852 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 6f123031-4246-43ac-959a-b1e973207559 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:32:14.243359 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-cc359ed7-5afc-42b1-b0cf-fd753ccde38b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.6636982 Dec 10 14:32:14.243716 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59770) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:14.249258 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'subnet': {'network_id': '6f123031-4246-43ac-959a-b1e973207559', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:14.374621 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 53c382b9-237d-4077-af08-ab507ccd90dc triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:14.374892 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.386368 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59772) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:14.400043 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e235a6a9-b41d-41fd-892a-23e3bd93fee9 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.453202 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Made reservation on behalf of f4458d42f98847a7909268deb386f7a6 for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:14.456766 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.456947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b6ccc809-6c4e-44ff-8c4b-2f94b2f9d73d None None] Provisioning complete for port 347bc2eb-e3db-42a3-b785-8d842864077c triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:14.457292 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b6ccc809-6c4e-44ff-8c4b-2f94b2f9d73d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.484846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e235a6a9-b41d-41fd-892a-23e3bd93fee9 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.518316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d47ea909-ef61-4940-9280-5ec21a20fd14 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1684533937', 'description': 'tempest-secgroup-smoke-1684533937 description', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:14.553522 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b6ccc809-6c4e-44ff-8c4b-2f94b2f9d73d None None] Port 347bc2eb-e3db-42a3-b785-8d842864077c cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:32:14.556991 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e235a6a9-b41d-41fd-892a-23e3bd93fee9 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.569790 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1af57c2e-8c3e-4123-86ea-7a0896813e59 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:14.573753 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e235a6a9-b41d-41fd-892a-23e3bd93fee9 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e6cdcb46-71ca-4a09-80d8-dd36ee701760,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:14.644865 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.655694 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d47ea909-ef61-4940-9280-5ec21a20fd14 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.658453 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 1af57c2e-8c3e-4123-86ea-7a0896813e59 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:14.658844 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.726202 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d47ea909-ef61-4940-9280-5ec21a20fd14 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.743573 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d3220285-7992-4fb1-9ccf-a69cee14808d up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:14.746453 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.781333 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.782229 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e235a6a9-b41d-41fd-892a-23e3bd93fee9 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.783544 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e235a6a9-b41d-41fd-892a-23e3bd93fee9 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.6479363 Dec 10 14:32:14.786719 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59776) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:14.833011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d47ea909-ef61-4940-9280-5ec21a20fd14 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.856512 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Subnet': ['ID=396a84ed-c2c1-42fe-8967-2994b6403a4b,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:14.862486 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Checking segment: {'id': 'e234b2cd-f80c-460d-932e-e69ddc7c3fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '6f123031-4246-43ac-959a-b1e973207559'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:14.863169 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network hostable DHCP agents. Network: 6f123031-4246-43ac-959a-b1e973207559, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:32:14.885206 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d47ea909-ef61-4940-9280-5ec21a20fd14 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:14.887946 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e0bc2c0d-eba8-442a-879c-8a554910ba04 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.916468 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e0bc2c0d-eba8-442a-879c-8a554910ba04 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.952583 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d47ea909-ef61-4940-9280-5ec21a20fd14 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:14.954201 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d47ea909-ef61-4940-9280-5ec21a20fd14 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.5664387 Dec 10 14:32:14.957108 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59778) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:14.962668 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-eb66350a-6210-406c-8d9d-f1fa19fe33d1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'c40cfa2a-e16a-4a4e-ba09-a7e9a602332c', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:14.982648 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network 6f123031-4246-43ac-959a-b1e973207559 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:32:14.996781 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da248752-5349-49a4-bb18-377d30b6f82b None None] Pushing event updated for resources: {'Port': ['ID=347bc2eb-e3db-42a3-b785-8d842864077c,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:15.044155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port d3220285-7992-4fb1-9ccf-a69cee14808d triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:15.044608 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.065939 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb66350a-6210-406c-8d9d-f1fa19fe33d1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.071315 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 6f123031-4246-43ac-959a-b1e973207559) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:15.075482 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Attempting to bind port 347bc2eb-e3db-42a3-b785-8d842864077c on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:32:15.076431 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Attempting to bind port 347bc2eb-e3db-42a3-b785-8d842864077c by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:32:15.076818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Attempting to bind port 347bc2eb-e3db-42a3-b785-8d842864077c on network ff92c14f-f9fb-4f05-9886-7825120a4f21 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:15.077227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e0bc2c0d-eba8-442a-879c-8a554910ba04 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.078229 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:15.079266 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.080561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e0bc2c0d-eba8-442a-879c-8a554910ba04 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.081872 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e0bc2c0d-eba8-442a-879c-8a554910ba04 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/39d60b70-a631-4e23-b177-84c1ae4de05d HTTP/1.1" status: 204 len: 168 time: 0.2933459 Dec 10 14:32:15.085174 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59780) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:15.101923 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72fbe65c-9ad8-4703-a477-7544f29bec7a None None] Network 6f123031-4246-43ac-959a-b1e973207559 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:15.104069 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0bc2c0d-eba8-442a-879c-8a554910ba04 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=39d60b70-a631-4e23-b177-84c1ae4de05d,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:15.122199 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 32, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:32:15.122199 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Checking segment: {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:15.125390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.125390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Bound using segment: {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:32:15.125390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Bound port: 347bc2eb-e3db-42a3-b785-8d842864077c, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:32:15.125390 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.155225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb66350a-6210-406c-8d9d-f1fa19fe33d1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.157149 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0dcff6da-2f0e-414e-b3f9-9835002ba1d1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0694971 Dec 10 14:32:15.161568 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59782) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:15.166296 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-bfe365f8-de31-4569-b5a4-a214de440f56 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-secgroup--659689488'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:15.210769 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-22fba548-aadc-4fdd-94f8-1aae62cced8e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.9658325 Dec 10 14:32:15.219614 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59784) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:15.226379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-4656fbfb-e6fc-41c2-83f8-76832080ade1 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'router': {'external_gateway_info': {'network_id': '6f123031-4246-43ac-959a-b1e973207559'}}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:15.296785 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb66350a-6210-406c-8d9d-f1fa19fe33d1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.328880 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] For port 347bc2eb-e3db-42a3-b785-8d842864077c, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:32:15.332401 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] For port 347bc2eb-e3db-42a3-b785-8d842864077c, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=347bc2eb-e3db-42a3-b785-8d842864077c,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:32:15.338073 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-6f123031-4246-43ac-959a-b1e973207559', 'network_id': '6f123031-4246-43ac-959a-b1e973207559', 'project_id': 'f4458d42f98847a7909268deb386f7a6', 'fixed_ips': [{'subnet_id': '396a84ed-c2c1-42fe-8967-2994b6403a4b'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:32:15.338872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.343613 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-28dd6a78-0e67-437e-8e79-267c26d1d067 None None] Provisioning complete for port 347bc2eb-e3db-42a3-b785-8d842864077c triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:15.343978 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-28dd6a78-0e67-437e-8e79-267c26d1d067 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.368070 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bfe365f8-de31-4569-b5a4-a214de440f56 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.370044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb66350a-6210-406c-8d9d-f1fa19fe33d1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=950bb2ad-3f3d-46f5-86c2-8efd55826bae,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:15.442950 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-28dd6a78-0e67-437e-8e79-267c26d1d067 None None] Port 347bc2eb-e3db-42a3-b785-8d842864077c cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:32:15.444890 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.568742 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:15.569402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:15.574733 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da248752-5349-49a4-bb18-377d30b6f82b None None] Pushing event updated for resources: {'Port': ['ID=347bc2eb-e3db-42a3-b785-8d842864077c,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:15.621801 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Allocated IP 2001:db8:1::2 (6f123031-4246-43ac-959a-b1e973207559/396a84ed-c2c1-42fe-8967-2994b6403a4b/0d9189b2-98f2-4404-a2da-b4866e8e3146) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:15.750198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-eb66350a-6210-406c-8d9d-f1fa19fe33d1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.751593 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-eb66350a-6210-406c-8d9d-f1fa19fe33d1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7932889 Dec 10 14:32:15.754415 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59786) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:15.759565 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-85e2301f-3b72-4c9c-9702-6bb8e33161ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'c40cfa2a-e16a-4a4e-ba09-a7e9a602332c', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:15.771632 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:15.792164 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-4656fbfb-e6fc-41c2-83f8-76832080ade1 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.832382 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-9e1298cf-ca5b-4ad8-a0bb-3fa7731ed097 None None] Provisioning complete for port 347bc2eb-e3db-42a3-b785-8d842864077c triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:15.832754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e1298cf-ca5b-4ad8-a0bb-3fa7731ed097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.833762 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bfe365f8-de31-4569-b5a4-a214de440f56 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.852558 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85e2301f-3b72-4c9c-9702-6bb8e33161ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.916120 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85e2301f-3b72-4c9c-9702-6bb8e33161ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.940410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bfe365f8-de31-4569-b5a4-a214de440f56 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.984806 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85e2301f-3b72-4c9c-9702-6bb8e33161ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:15.990422 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe365f8-de31-4569-b5a4-a214de440f56 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cae69784-d8af-4be5-af35-c32a0b993c10,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:16.003630 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e2301f-3b72-4c9c-9702-6bb8e33161ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=01c3b2d3-d96f-4709-a11c-603971fb1b70,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:16.012083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.037632 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-4656fbfb-e6fc-41c2-83f8-76832080ade1 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 10 14:32:16.039309 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-4656fbfb-e6fc-41c2-83f8-76832080ade1 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "PUT /v2.0/routers/48fa50cb-7624-4300-9594-221d351f4dd0 HTTP/1.1" status: 400 len: 364 time: 0.8185937 Dec 10 14:32:16.042695 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59788) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:16.085722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e1298cf-ca5b-4ad8-a0bb-3fa7731ed097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.118896 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-bfe365f8-de31-4569-b5a4-a214de440f56 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.119398 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.119552 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85e2301f-3b72-4c9c-9702-6bb8e33161ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.126799 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-bfe365f8-de31-4569-b5a4-a214de440f56 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.9579039 Dec 10 14:32:16.127047 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-85e2301f-3b72-4c9c-9702-6bb8e33161ab tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3650565 Dec 10 14:32:16.127047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59790) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:16.127047 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59792) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:16.133353 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f2fe1569-9c11-4454-9074-6a7e82ccea0c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'c40cfa2a-e16a-4a4e-ba09-a7e9a602332c', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:16.134121 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9e1298cf-ca5b-4ad8-a0bb-3fa7731ed097 None None] For port 347bc2eb-e3db-42a3-b785-8d842864077c, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=347bc2eb-e3db-42a3-b785-8d842864077c,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:16.145099 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a1a53954-45bc-4713-b2da-b8cf39a32dee tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-secgroup--729599571'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:16.179405 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Network 6f123031-4246-43ac-959a-b1e973207559 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:16.185104 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:16.189701 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:16.193309 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Pushing event updated for resources: {'Port': ['ID=0d9189b2-98f2-4404-a2da-b4866e8e3146,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:16.203813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:15Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:16.243083 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e1298cf-ca5b-4ad8-a0bb-3fa7731ed097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.247342 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2fe1569-9c11-4454-9074-6a7e82ccea0c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.252255 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-316e0f45-a1b1-47cb-b61c-283d1cf8fcd8 None None] The sync data for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv is: [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:15Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:32:16.321030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Attempting to bind port 0d9189b2-98f2-4404-a2da-b4866e8e3146 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:32:16.321402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Attempting to bind port 0d9189b2-98f2-4404-a2da-b4866e8e3146 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': 'e234b2cd-f80c-460d-932e-e69ddc7c3fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '6f123031-4246-43ac-959a-b1e973207559'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:32:16.321780 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Attempting to bind port 0d9189b2-98f2-4404-a2da-b4866e8e3146 on network 6f123031-4246-43ac-959a-b1e973207559 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:16.340487 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 32, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:32:16.340899 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Checking segment: {'id': 'e234b2cd-f80c-460d-932e-e69ddc7c3fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '6f123031-4246-43ac-959a-b1e973207559'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:16.341860 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.342266 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Bound using segment: {'id': 'e234b2cd-f80c-460d-932e-e69ddc7c3fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '6f123031-4246-43ac-959a-b1e973207559'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:32:16.342754 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Bound port: 0d9189b2-98f2-4404-a2da-b4866e8e3146, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e234b2cd-f80c-460d-932e-e69ddc7c3fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '6f123031-4246-43ac-959a-b1e973207559'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:32:16.343175 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.347460 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2fe1569-9c11-4454-9074-6a7e82ccea0c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.365977 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1a53954-45bc-4713-b2da-b8cf39a32dee tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.378735 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e1298cf-ca5b-4ad8-a0bb-3fa7731ed097 None None] Pushing event updated for resources: {'Port': ['ID=347bc2eb-e3db-42a3-b785-8d842864077c,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:16.415129 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.447416 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] For port 0d9189b2-98f2-4404-a2da-b4866e8e3146, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:32:16.451145 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] For port 0d9189b2-98f2-4404-a2da-b4866e8e3146, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0d9189b2-98f2-4404-a2da-b4866e8e3146,segment=NetworkSegment(e234b2cd-f80c-460d-932e-e69ddc7c3fa1),segment_id=e234b2cd-f80c-460d-932e-e69ddc7c3fa1)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:32:16.455140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2fe1569-9c11-4454-9074-6a7e82ccea0c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.484381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2fe1569-9c11-4454-9074-6a7e82ccea0c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=966f2d8b-fb6f-487b-bffe-51fc7d8c1bb9,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:16.489179 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1a53954-45bc-4713-b2da-b8cf39a32dee tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.534317 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.558800 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f2fe1569-9c11-4454-9074-6a7e82ccea0c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.562683 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f2fe1569-9c11-4454-9074-6a7e82ccea0c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4321480 Dec 10 14:32:16.562683 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1a53954-45bc-4713-b2da-b8cf39a32dee tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.571362 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59794) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:16.578995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ae3ce5ef-19e5-4fc6-953a-7084d876c469 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'c40cfa2a-e16a-4a4e-ba09-a7e9a602332c', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:16.609289 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7847434-2667-46c1-a980-6a19eac51e82 None None] Pushing event updated for resources: {'Port': ['ID=0d9189b2-98f2-4404-a2da-b4866e8e3146,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:16.616592 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a53954-45bc-4713-b2da-b8cf39a32dee tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6da8b38d-7cbb-47b2-85a4-5fd8ce654bd8,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:16.647133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1a53954-45bc-4713-b2da-b8cf39a32dee tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.651124 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a1a53954-45bc-4713-b2da-b8cf39a32dee tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5193999 Dec 10 14:32:16.655058 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59796) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:16.666147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-cc29bf6d-2c2a-4777-bec7-a97a88e8af3a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'cae69784-d8af-4be5-af35-c32a0b993c10', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '6da8b38d-7cbb-47b2-85a4-5fd8ce654bd8', 'remote_ip_prefix': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:16.740608 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Allocated IP 2001:db8::1 (95325c3b-2663-4cb7-b976-32008e9b218c/f2977c1e-c9e6-4d98-846b-2d9306118f4f/d0b5e89f-e04f-4bf2-9031-4d2ca154ca39) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:16.803672 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae3ce5ef-19e5-4fc6-953a-7084d876c469 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.866843 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc29bf6d-2c2a-4777-bec7-a97a88e8af3a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.886904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae3ce5ef-19e5-4fc6-953a-7084d876c469 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.914918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:16.976745 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae3ce5ef-19e5-4fc6-953a-7084d876c469 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.008102 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc29bf6d-2c2a-4777-bec7-a97a88e8af3a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.010009 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae3ce5ef-19e5-4fc6-953a-7084d876c469 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=496e15c0-4920-470e-abe3-c3a47dcbec9f,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:17.053976 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.099132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc29bf6d-2c2a-4777-bec7-a97a88e8af3a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.102813 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network 95325c3b-2663-4cb7-b976-32008e9b218c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:17.106125 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:17.111814 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:17.112389 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.122846 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc29bf6d-2c2a-4777-bec7-a97a88e8af3a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9bf2c32a-bd21-40b3-8d82-873bbf121da4,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:17.130093 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae3ce5ef-19e5-4fc6-953a-7084d876c469 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.134577 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ae3ce5ef-19e5-4fc6-953a-7084d876c469 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5592289 Dec 10 14:32:17.135504 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59798) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:17.140712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-e670ebb7-6973-4f14-bfc5-b96027af5e62 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'c40cfa2a-e16a-4a4e-ba09-a7e9a602332c', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:17.197579 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Port': ['ID=d0b5e89f-e04f-4bf2-9031-4d2ca154ca39,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:17.211902 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-cc29bf6d-2c2a-4777-bec7-a97a88e8af3a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.213526 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-cc29bf6d-2c2a-4777-bec7-a97a88e8af3a tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.5590816 Dec 10 14:32:17.216799 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59800) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:17.246308 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3d1138c1-aa89-4f13-861d-e0b1bbb39453 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.255572 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3d1138c1-aa89-4f13-861d-e0b1bbb39453 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.272668 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-e670ebb7-6973-4f14-bfc5-b96027af5e62 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:32:17.281348 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e670ebb7-6973-4f14-bfc5-b96027af5e62 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.353895 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.375436 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3d1138c1-aa89-4f13-861d-e0b1bbb39453 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.385322 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-3d1138c1-aa89-4f13-861d-e0b1bbb39453 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.389965 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-3d1138c1-aa89-4f13-861d-e0b1bbb39453 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/9bf2c32a-bd21-40b3-8d82-873bbf121da4 HTTP/1.1" status: 204 len: 168 time: 0.1714141 Dec 10 14:32:17.396396 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59802) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:17.415050 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e670ebb7-6973-4f14-bfc5-b96027af5e62 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.422033 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d1138c1-aa89-4f13-861d-e0b1bbb39453 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9bf2c32a-bd21-40b3-8d82-873bbf121da4,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:17.459270 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-b3dd0064-f50c-4261-a34f-e41db2034b4b tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0615754 Dec 10 14:32:17.475693 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59804) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:17.486629 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-58a585c5-c982-490d-b37d-cfd4f555c59c None None] Provisioning complete for port d0b5e89f-e04f-4bf2-9031-4d2ca154ca39 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:17.487198 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-58a585c5-c982-490d-b37d-cfd4f555c59c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.499142 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e670ebb7-6973-4f14-bfc5-b96027af5e62 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.523829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e670ebb7-6973-4f14-bfc5-b96027af5e62 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=606076da-b271-4dee-8c5a-fe90cd2eda31,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:17.562759 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-58a585c5-c982-490d-b37d-cfd4f555c59c None None] Port d0b5e89f-e04f-4bf2-9031-4d2ca154ca39 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:32:17.596546 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3b907523-4a4d-4f90-bbca-885f847c579f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.598304 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e670ebb7-6973-4f14-bfc5-b96027af5e62 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.599755 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e670ebb7-6973-4f14-bfc5-b96027af5e62 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4625933 Dec 10 14:32:17.602707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59806) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:17.607528 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0fc04cd0-b71c-4fa1-95c3-88859a7ae6a3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': 'c40cfa2a-e16a-4a4e-ba09-a7e9a602332c', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:17.670649 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3b907523-4a4d-4f90-bbca-885f847c579f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.705213 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-0fc04cd0-b71c-4fa1-95c3-88859a7ae6a3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:32:17.714734 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0fc04cd0-b71c-4fa1-95c3-88859a7ae6a3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.777784 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.780422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9aff503e-b636-4939-a375-5cee9583338b None None] Network 6f123031-4246-43ac-959a-b1e973207559 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:17.792742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0fc04cd0-b71c-4fa1-95c3-88859a7ae6a3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.819088 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3b907523-4a4d-4f90-bbca-885f847c579f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.821793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3b907523-4a4d-4f90-bbca-885f847c579f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.822948 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3b907523-4a4d-4f90-bbca-885f847c579f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/6da8b38d-7cbb-47b2-85a4-5fd8ce654bd8 HTTP/1.1" status: 204 len: 168 time: 0.3462362 Dec 10 14:32:17.825787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59808) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:17.838623 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b907523-4a4d-4f90-bbca-885f847c579f tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6da8b38d-7cbb-47b2-85a4-5fd8ce654bd8,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:17.850170 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.850974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.894551 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-bc31edb9-2736-4154-a150-861760075c02 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4544 time: 0.0643702 Dec 10 14:32:17.894957 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59810) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:17.903916 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0fc04cd0-b71c-4fa1-95c3-88859a7ae6a3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.919678 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-89ad46f4-9cfe-496a-a93b-f843c34977ed None None] Provisioning complete for port 0d9189b2-98f2-4404-a2da-b4866e8e3146 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:17.920320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-89ad46f4-9cfe-496a-a93b-f843c34977ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:17.947034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event updated for resources: {'Port': ['ID=d0b5e89f-e04f-4bf2-9031-4d2ca154ca39,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:17.978515 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fc04cd0-b71c-4fa1-95c3-88859a7ae6a3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1eadd4c5-837c-4000-b163-6e59a0aa2649,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:17.995373 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Network 95325c3b-2663-4cb7-b976-32008e9b218c is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:17.998190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:18.014039 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-89ad46f4-9cfe-496a-a93b-f843c34977ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.022722 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c65f02c6-4acb-41c8-93f5-2c2cc0900253 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.059585 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-89ad46f4-9cfe-496a-a93b-f843c34977ed None None] For port 0d9189b2-98f2-4404-a2da-b4866e8e3146, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0d9189b2-98f2-4404-a2da-b4866e8e3146,segment=NetworkSegment(e234b2cd-f80c-460d-932e-e69ddc7c3fa1),segment_id=e234b2cd-f80c-460d-932e-e69ddc7c3fa1)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:18.064666 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0fc04cd0-b71c-4fa1-95c3-88859a7ae6a3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.076996 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0fc04cd0-b71c-4fa1-95c3-88859a7ae6a3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4723175 Dec 10 14:32:18.091872 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c65f02c6-4acb-41c8-93f5-2c2cc0900253 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.146937 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-89ad46f4-9cfe-496a-a93b-f843c34977ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.165664 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Router 48fa50cb-7624-4300-9594-221d351f4dd0 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:32:18.252794 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89ad46f4-9cfe-496a-a93b-f843c34977ed None None] Pushing event updated for resources: {'Port': ['ID=0d9189b2-98f2-4404-a2da-b4866e8e3146,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:18.264979 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c65f02c6-4acb-41c8-93f5-2c2cc0900253 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.268178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c65f02c6-4acb-41c8-93f5-2c2cc0900253 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.270948 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c65f02c6-4acb-41c8-93f5-2c2cc0900253 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/cae69784-d8af-4be5-af35-c32a0b993c10 HTTP/1.1" status: 204 len: 168 time: 0.3749888 Dec 10 14:32:18.275944 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59824) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:18.297534 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0d9189b2-98f2-4404-a2da-b4866e8e3146 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:18.372394 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:32:18.374023 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-080396bf-d1fc-433a-9a0b-52d79939b5f3 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0981939 Dec 10 14:32:18.375223 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c65f02c6-4acb-41c8-93f5-2c2cc0900253 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cae69784-d8af-4be5-af35-c32a0b993c10,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:18.381378 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59826) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:18.386027 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-dd8be6e8-659e-4198-83bf-495a0e3671a0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-secgroup--1229687315'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:18.399298 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7e116c87-c799-497b-90c2-e952c04bcb5e tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "PUT /v2.0/routers/48fa50cb-7624-4300-9594-221d351f4dd0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3555532 Dec 10 14:32:18.403567 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59828) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:18.405334 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-75d06a5b-ff78-41bc-b463-665642f57220 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1684533937&fields=id&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 267 time: 0.0989957 Dec 10 14:32:18.409047 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3f071136-582b-45ee-93ef-cd5f13daf7eb None None] Provisioning complete for port 0d9189b2-98f2-4404-a2da-b4866e8e3146 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:18.409546 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f071136-582b-45ee-93ef-cd5f13daf7eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.413403 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e214023e-de9e-45fa-91b9-0cb975e3772e None None] Sync routers for ids ['48fa50cb-7624-4300-9594-221d351f4dd0'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:32:18.464580 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e214023e-de9e-45fa-91b9-0cb975e3772e None None] Routers {'48fa50cb-7624-4300-9594-221d351f4dd0'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:18.465544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e214023e-de9e-45fa-91b9-0cb975e3772e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['48fa50cb-7624-4300-9594-221d351f4dd0'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:18.507992 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e214023e-de9e-45fa-91b9-0cb975e3772e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:18.515659 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0d9189b2-98f2-4404-a2da-b4866e8e3146 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:18.521392 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.521570 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd8be6e8-659e-4198-83bf-495a0e3671a0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.527619 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-a9acdf67-e829-4ffb-9e0f-35edfab77e42 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:18.529904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-16b5b4ec-d8ff-4b8b-86cd-f2484b44edf5 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.530171 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-a9acdf67-e829-4ffb-9e0f-35edfab77e42 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/networks?id=ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 200 len: 797 time: 0.1159225 Dec 10 14:32:18.548374 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-28d8183a-b6b1-4ec8-ad74-2cac60f365df tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/quotas/c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 375 time: 0.0109932 Dec 10 14:32:18.611352 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-417c2a30-0d6f-4118-9247-ac78f78b7b65 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0554273 Dec 10 14:32:18.648101 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-16b5b4ec-d8ff-4b8b-86cd-f2484b44edf5 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 10 14:32:18.652965 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-16b5b4ec-d8ff-4b8b-86cd-f2484b44edf5 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/routers/48fa50cb-7624-4300-9594-221d351f4dd0 HTTP/1.1" status: 409 len: 329 time: 0.2444754 Dec 10 14:32:18.654381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59830) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:18.721853 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e214023e-de9e-45fa-91b9-0cb975e3772e None None] Routers {'48fa50cb-7624-4300-9594-221d351f4dd0'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:18.722544 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e214023e-de9e-45fa-91b9-0cb975e3772e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['48fa50cb-7624-4300-9594-221d351f4dd0'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:18.730025 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-15da01e5-7c47-46b7-ba21-a1595f3ae4fb service neutron] 10.222.0.57 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1042495 Dec 10 14:32:18.748595 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd8be6e8-659e-4198-83bf-495a0e3671a0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.784958 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-e214023e-de9e-45fa-91b9-0cb975e3772e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:18.785665 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e214023e-de9e-45fa-91b9-0cb975e3772e None None] The sync data for ids ['48fa50cb-7624-4300-9594-221d351f4dd0'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:32:18.825378 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-aaa434b7-4b99-41ec-82bb-dea9322cbeb0 service neutron] 10.222.0.57 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0940738 Dec 10 14:32:18.847326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd8be6e8-659e-4198-83bf-495a0e3671a0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.853768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 347bc2eb-e3db-42a3-b785-8d842864077c up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:18.887966 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd8be6e8-659e-4198-83bf-495a0e3671a0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=726caab2-acf5-4168-948c-2fd239ee573b,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:18.902190 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 347bc2eb-e3db-42a3-b785-8d842864077c triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:18.902560 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.950024 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-06e10b5f-5c59-45e9-a116-5c23a23abec6 None None] Provisioning complete for port d0b5e89f-e04f-4bf2-9031-4d2ca154ca39 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:18.950389 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-06e10b5f-5c59-45e9-a116-5c23a23abec6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.960483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dd8be6e8-659e-4198-83bf-495a0e3671a0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:18.962034 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dd8be6e8-659e-4198-83bf-495a0e3671a0 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.5796194 Dec 10 14:32:18.964962 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59832) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:18.971138 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-ac223664-3fa4-4a41-b664-a666c333abc4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': '726caab2-acf5-4168-948c-2fd239ee573b', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:19.019931 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-06e10b5f-5c59-45e9-a116-5c23a23abec6 None None] Port d0b5e89f-e04f-4bf2-9031-4d2ca154ca39 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:32:19.094435 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ed6d0ecf-5b31-4055-a889-c6b13984251d req-afff0063-4397-4719-9721-304f600f1c80 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 210 time: 0.0370555 Dec 10 14:32:19.095372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac223664-3fa4-4a41-b664-a666c333abc4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.095654 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.157393 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac223664-3fa4-4a41-b664-a666c333abc4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.259119 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac223664-3fa4-4a41-b664-a666c333abc4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.277716 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac223664-3fa4-4a41-b664-a666c333abc4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0f1b7d78-6605-4bfa-8e91-2d44a830b49e,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:19.347045 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-ac223664-3fa4-4a41-b664-a666c333abc4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.348322 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ac223664-3fa4-4a41-b664-a666c333abc4 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.3810065 Dec 10 14:32:19.351324 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59844) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:19.354613 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Deleting port d0b5e89f-e04f-4bf2-9031-4d2ca154ca39 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:19.355310 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.384543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d8907bd-8740-48ed-91d7-68420129d348 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.391182 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d8907bd-8740-48ed-91d7-68420129d348 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.448232 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.460529 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Calling delete_port for d0b5e89f-e04f-4bf2-9031-4d2ca154ca39 owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:19.487883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d8907bd-8740-48ed-91d7-68420129d348 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.493333 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-0d8907bd-8740-48ed-91d7-68420129d348 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.494540 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0d8907bd-8740-48ed-91d7-68420129d348 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/0f1b7d78-6605-4bfa-8e91-2d44a830b49e HTTP/1.1" status: 204 len: 168 time: 0.1422975 Dec 10 14:32:19.499476 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59848) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:19.510087 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d8907bd-8740-48ed-91d7-68420129d348 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=0f1b7d78-6605-4bfa-8e91-2d44a830b49e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:19.545143 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f2e9063b-c44a-4bf4-9307-6182e4c5a505 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0451458 Dec 10 14:32:19.551046 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59850) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:19.599658 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0cc8abf-8348-485d-acbb-7066a6fade9c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.622359 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0cc8abf-8348-485d-acbb-7066a6fade9c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.716565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0cc8abf-8348-485d-acbb-7066a6fade9c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.717236 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.719354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b0cc8abf-8348-485d-acbb-7066a6fade9c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.720538 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b0cc8abf-8348-485d-acbb-7066a6fade9c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/726caab2-acf5-4168-948c-2fd239ee573b HTTP/1.1" status: 204 len: 168 time: 0.1715345 Dec 10 14:32:19.724861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59852) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:19.741678 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0cc8abf-8348-485d-acbb-7066a6fade9c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=726caab2-acf5-4168-948c-2fd239ee573b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:19.747463 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Port': ['ID=d0b5e89f-e04f-4bf2-9031-4d2ca154ca39,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:19.781650 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-906c461c-143d-435b-9245-d0e73e90f680 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0518653 Dec 10 14:32:19.783066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59854) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:19.787699 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-8622fd11-4f55-4861-8199-4bb7a696a124 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-secgroup--1455715514'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:19.857682 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.870702 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8622fd11-4f55-4861-8199-4bb7a696a124 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:19.953914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8622fd11-4f55-4861-8199-4bb7a696a124 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.031328 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Router 48fa50cb-7624-4300-9594-221d351f4dd0 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:32:20.032134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8622fd11-4f55-4861-8199-4bb7a696a124 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.048600 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0d9189b2-98f2-4404-a2da-b4866e8e3146 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:20.067741 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8622fd11-4f55-4861-8199-4bb7a696a124 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d0c59df9-6fa1-4145-b3cd-0384ccff5b4f,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:20.101155 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0d9189b2-98f2-4404-a2da-b4866e8e3146 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:20.101588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.112983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-8622fd11-4f55-4861-8199-4bb7a696a124 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.114766 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8622fd11-4f55-4861-8199-4bb7a696a124 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3305533 Dec 10 14:32:20.117379 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59856) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.122680 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-94d4b983-8a36-4777-a180-8f1e0249a8af tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'd0c59df9-6fa1-4145-b3cd-0384ccff5b4f', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:20.124316 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:32:20.129755 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-e5d007e0-08d3-4d5f-8bd4-9075c7cba8fb tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "PUT /v2.0/routers/48fa50cb-7624-4300-9594-221d351f4dd0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4740312 Dec 10 14:32:20.136960 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bb77bf1-a264-47e1-9fa9-59a3e3854e8b None None] Sync routers for ids ['48fa50cb-7624-4300-9594-221d351f4dd0'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:32:20.146679 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59860) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.160570 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bb77bf1-a264-47e1-9fa9-59a3e3854e8b None None] Routers {'48fa50cb-7624-4300-9594-221d351f4dd0'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:20.161709 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5bb77bf1-a264-47e1-9fa9-59a3e3854e8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['48fa50cb-7624-4300-9594-221d351f4dd0'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:20.227986 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.api.v2.resource [None req-0af49f95-adc2-449c-847b-d74e7362cd74 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] show failed (client error): The resource could not be found. Dec 10 14:32:20.228588 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-94311800-a861-42de-a332-054419d16009 req-ef05d33a-0b71-4588-a02d-37e2062fc17b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 210 time: 0.0389204 Dec 10 14:32:20.230249 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5bb77bf1-a264-47e1-9fa9-59a3e3854e8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:20.234115 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0af49f95-adc2-449c-847b-d74e7362cd74 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "GET /v2.0/routers/tempest-non_exist_router-1526653167 HTTP/1.1" status: 404 len: 335 time: 0.0863886 Dec 10 14:32:20.236163 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59862) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.241060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-c34f7044-9480-4030-9e71-e33d0eff5923 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Request body: {'router': {'name': 'new_name'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:20.245088 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94d4b983-8a36-4777-a180-8f1e0249a8af tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.252213 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bb77bf1-a264-47e1-9fa9-59a3e3854e8b None None] Routers {'48fa50cb-7624-4300-9594-221d351f4dd0'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:20.252946 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5bb77bf1-a264-47e1-9fa9-59a3e3854e8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['48fa50cb-7624-4300-9594-221d351f4dd0'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:20.277293 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-c34f7044-9480-4030-9e71-e33d0eff5923 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] update failed (client error): The resource could not be found. Dec 10 14:32:20.278358 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c34f7044-9480-4030-9e71-e33d0eff5923 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "PUT /v2.0/routers/tempest-non_exist_router-969708947 HTTP/1.1" status: 404 len: 334 time: 0.0411708 Dec 10 14:32:20.287263 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59864) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.300616 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-5bb77bf1-a264-47e1-9fa9-59a3e3854e8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:20.301268 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bb77bf1-a264-47e1-9fa9-59a3e3854e8b None None] The sync data for ids ['48fa50cb-7624-4300-9594-221d351f4dd0'] in dv-neutron-821401-2-hyperv is: [] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:32:20.345439 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94d4b983-8a36-4777-a180-8f1e0249a8af tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.350324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-0dbe471b-5508-48fa-898f-253a026c9bf9 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Deleting subnet 396a84ed-c2c1-42fe-8967-2994b6403a4b {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:32:20.353548 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0dbe471b-5508-48fa-898f-253a026c9bf9 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.394602 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0dbe471b-5508-48fa-898f-253a026c9bf9 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.419221 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94d4b983-8a36-4777-a180-8f1e0249a8af tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.437183 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94d4b983-8a36-4777-a180-8f1e0249a8af tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ff234bc-4147-4de1-9247-25106e993cd2,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:20.484064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-94d4b983-8a36-4777-a180-8f1e0249a8af tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.485245 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-94d4b983-8a36-4777-a180-8f1e0249a8af tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3667195 Dec 10 14:32:20.487978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59866) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.518842 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a6a3e659-eadc-46bf-bfbe-9013b17e1ced tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules/4ff234bc-4147-4de1-9247-25106e993cd2 HTTP/1.1" status: 200 len: 763 time: 0.0298064 Dec 10 14:32:20.521502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59868) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.528516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0dbe471b-5508-48fa-898f-253a026c9bf9 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.561947 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-8b6ea8bb-2b52-4366-9972-b764b11b94fd tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0393085 Dec 10 14:32:20.564522 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59870) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.590366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82bc6e7b-b8e3-4f5f-ba12-4de159866cc1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.598809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82bc6e7b-b8e3-4f5f-ba12-4de159866cc1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.654951 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0dbe471b-5508-48fa-898f-253a026c9bf9 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.681969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82bc6e7b-b8e3-4f5f-ba12-4de159866cc1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.687789 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-82bc6e7b-b8e3-4f5f-ba12-4de159866cc1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.687980 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dbe471b-5508-48fa-898f-253a026c9bf9 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Subnet': ['ID=396a84ed-c2c1-42fe-8967-2994b6403a4b,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:20.689377 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-82bc6e7b-b8e3-4f5f-ba12-4de159866cc1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/4ff234bc-4147-4de1-9247-25106e993cd2 HTTP/1.1" status: 204 len: 168 time: 0.1239316 Dec 10 14:32:20.691884 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59872) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.693180 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0dbe471b-5508-48fa-898f-253a026c9bf9 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.696985 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0dbe471b-5508-48fa-898f-253a026c9bf9 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/subnets/396a84ed-c2c1-42fe-8967-2994b6403a4b HTTP/1.1" status: 204 len: 168 time: 0.4085422 Dec 10 14:32:20.700245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-396b3ce8-d7d9-4dde-8a34-f0d93cd2ffcc None None] Network 6f123031-4246-43ac-959a-b1e973207559 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:20.700495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82bc6e7b-b8e3-4f5f-ba12-4de159866cc1 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=4ff234bc-4147-4de1-9247-25106e993cd2,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:20.702724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59874) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.797106 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.811504 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-75f80e41-03e6-43da-9d3c-2a9f41be5f62 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1103051 Dec 10 14:32:20.812045 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59876) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:20.817565 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-73140382-a141-4445-9dfe-2e96f8fc401c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'd0c59df9-6fa1-4145-b3cd-0384ccff5b4f', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:20.854784 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] DHCP port deletion for 6f123031-4246-43ac-959a-b1e973207559 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:32:20.912373 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Deleting port 0d9189b2-98f2-4404-a2da-b4866e8e3146 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:20.912757 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.917483 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-73140382-a141-4445-9dfe-2e96f8fc401c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.975646 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-73140382-a141-4445-9dfe-2e96f8fc401c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.979041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] For port 0d9189b2-98f2-4404-a2da-b4866e8e3146, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0d9189b2-98f2-4404-a2da-b4866e8e3146,segment=NetworkSegment(e234b2cd-f80c-460d-932e-e69ddc7c3fa1),segment_id=e234b2cd-f80c-460d-932e-e69ddc7c3fa1)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:20.979435 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:20.991977 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Calling delete_port for 0d9189b2-98f2-4404-a2da-b4866e8e3146 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:21.019675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-68048ac6-b3e0-4347-9b05-b7d0a1e4fdde tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:21.021108 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-68048ac6-b3e0-4347-9b05-b7d0a1e4fdde tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/networks?id=ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 200 len: 797 time: 0.2220900 Dec 10 14:32:21.031326 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Deleting port 0d9189b2-98f2-4404-a2da-b4866e8e3146 {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:21.031668 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.048449 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-73140382-a141-4445-9dfe-2e96f8fc401c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.071384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73140382-a141-4445-9dfe-2e96f8fc401c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=097558d9-72d8-4c53-83b8-b1a675a5bb2b,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:21.133105 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] For port 0d9189b2-98f2-4404-a2da-b4866e8e3146, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0d9189b2-98f2-4404-a2da-b4866e8e3146,segment=NetworkSegment(e234b2cd-f80c-460d-932e-e69ddc7c3fa1),segment_id=e234b2cd-f80c-460d-932e-e69ddc7c3fa1)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:21.133483 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.145774 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.147498 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-73140382-a141-4445-9dfe-2e96f8fc401c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.148717 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-73140382-a141-4445-9dfe-2e96f8fc401c tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3353407 Dec 10 14:32:21.160263 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59880) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:21.165363 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Calling delete_port for 0d9189b2-98f2-4404-a2da-b4866e8e3146 owned by network:dhcp {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:21.174970 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-58bdf44a-be3b-48f2-9929-5f5ce9533f96 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 380 time: 0.1405413 Dec 10 14:32:21.178401 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-302decb5-32b0-4a61-be80-b4cb3c9a0d72 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules/097558d9-72d8-4c53-83b8-b1a675a5bb2b HTTP/1.1" status: 200 len: 763 time: 0.0169778 Dec 10 14:32:21.183647 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59882) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:21.187891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'port': {'device_id': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'admin_state_up': True, 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'security_groups': ['c40cfa2a-e16a-4a4e-ba09-a7e9a602332c']}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:21.197067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Pushing event deleted for resources: {'Port': ['ID=0d9189b2-98f2-4404-a2da-b4866e8e3146,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:21.205574 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] No DVR routers for this DVR port 0d9189b2-98f2-4404-a2da-b4866e8e3146 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:32:21.208128 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.208479 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.208823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.209229 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.209679 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.210012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.210473 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.210810 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.211145 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.211474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.211804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.212212 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.212722 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4cf0b8d-490e-498e-b398-d0a7dd5ccbcd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:32:21.327758 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fa343f7-85eb-480c-990e-2cd6a0134413 req-8012d20e-0e21-4e58-9f61-c83a26da2ad0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 210 time: 0.0261121 Dec 10 14:32:21.336473 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2fb0ae9b-4c0c-4b19-8f4f-ac0730b2f5c3 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.1423225 Dec 10 14:32:21.337927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59888) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:21.370427 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.373668 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e3c4f32a-8972-450b-aa11-034ceb01cd92 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.383015 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e3c4f32a-8972-450b-aa11-034ceb01cd92 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.401374 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Port': ['ID=0d9189b2-98f2-4404-a2da-b4866e8e3146,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:21.408069 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] No DVR routers for this DVR port 0d9189b2-98f2-4404-a2da-b4866e8e3146 on host dv-neutron-821401-2-hyperv {{(pid=103810) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:32:21.522160 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e3c4f32a-8972-450b-aa11-034ceb01cd92 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.530092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-e3c4f32a-8972-450b-aa11-034ceb01cd92 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.531340 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-e3c4f32a-8972-450b-aa11-034ceb01cd92 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/097558d9-72d8-4c53-83b8-b1a675a5bb2b HTTP/1.1" status: 204 len: 168 time: 0.1924322 Dec 10 14:32:21.536919 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59890) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:21.543854 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c4f32a-8972-450b-aa11-034ceb01cd92 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=097558d9-72d8-4c53-83b8-b1a675a5bb2b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:21.582763 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7093c553-fc7f-4430-bb06-8581e036060e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0445769 Dec 10 14:32:21.585300 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59892) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:21.590344 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-2e248981-a7cf-48a4-b30b-60bf833f9d38 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'd0c59df9-6fa1-4145-b3cd-0384ccff5b4f', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:21.687574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e248981-a7cf-48a4-b30b-60bf833f9d38 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.749572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e248981-a7cf-48a4-b30b-60bf833f9d38 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.813848 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e248981-a7cf-48a4-b30b-60bf833f9d38 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.830583 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:21.832226 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e248981-a7cf-48a4-b30b-60bf833f9d38 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5557eeaf-c090-45b1-9665-b7ef77b7a9a5,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:21.834288 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.855633 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.883799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2e248981-a7cf-48a4-b30b-60bf833f9d38 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.884256 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f123031-4246-43ac-959a-b1e973207559']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:21.885091 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2e248981-a7cf-48a4-b30b-60bf833f9d38 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2988009 Dec 10 14:32:21.887736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59894) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:21.905750 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-f05d1720-1510-4de9-93ec-67717fb8c1ca tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules/5557eeaf-c090-45b1-9665-b7ef77b7a9a5 HTTP/1.1" status: 200 len: 764 time: 0.0164235 Dec 10 14:32:21.908147 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59896) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:21.921016 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e234b2cd-f80c-460d-932e-e69ddc7c3fa1') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:21.921322 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e234b2cd-f80c-460d-932e-e69ddc7c3fa1') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:21.937891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.949595 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1bda10c2-2678-48d8-9577-7a2d14cc5fe2 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4114 time: 0.0403533 Dec 10 14:32:21.952864 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59898) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:21.959424 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.977502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c644e0c-a4d4-4ec4-92cf-31163b675a2e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.985034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c644e0c-a4d4-4ec4-92cf-31163b675a2e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.986403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Releasing vlan 375 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:32:21.986810 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: self.session.flush() Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:32:21.989861 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:32:22.054173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0d9189b2-98f2-4404-a2da-b4866e8e3146 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:32:22.070893 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.11 (ff92c14f-f9fb-4f05-9886-7825120a4f21/4f430ec7-91c3-4707-a417-018d2e296df6/37d9fbb5-c2f9-411a-ae51-98084b4cbb01) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:22.077053 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 0d9189b2-98f2-4404-a2da-b4866e8e3146 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:32:22.077741 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0d9189b2-98f2-4404-a2da-b4866e8e3146 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:32:22.093771 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c644e0c-a4d4-4ec4-92cf-31163b675a2e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.099589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-2c644e0c-a4d4-4ec4-92cf-31163b675a2e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.102498 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-2c644e0c-a4d4-4ec4-92cf-31163b675a2e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-group-rules/5557eeaf-c090-45b1-9665-b7ef77b7a9a5 HTTP/1.1" status: 204 len: 168 time: 0.1469495 Dec 10 14:32:22.105338 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59900) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:22.117580 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c644e0c-a4d4-4ec4-92cf-31163b675a2e tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=5557eeaf-c090-45b1-9665-b7ef77b7a9a5,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:22.157621 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-7235d27c-1f18-40e7-9948-99f994909b61 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0511458 Dec 10 14:32:22.160425 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59902) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:22.172717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.181262 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.185878 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/networks/6f123031-4246-43ac-959a-b1e973207559 HTTP/1.1" status: 204 len: 168 time: 1.4826021 Dec 10 14:32:22.188219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59904) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:22.204146 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f2333a-7e31-4db2-b9ef-7534129893a6 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Network': ['ID=6f123031-4246-43ac-959a-b1e973207559,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:22.252717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.269622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-5f7c5511-b4d4-4458-a694-a4403365c018 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Deleting subnet 521465a1-ba8d-4123-9da4-889e47221956 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:32:22.271794 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a2aac1-31c8-46fd-82f0-e91d4bbcf8da tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.277700 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5f7c5511-b4d4-4458-a694-a4403365c018 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.327492 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a2aac1-31c8-46fd-82f0-e91d4bbcf8da tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.339517 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.349220 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5f7c5511-b4d4-4458-a694-a4403365c018 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.385475 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:22.389360 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:22.393195 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:22.400533 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:22.456874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:22.458313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.504495 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ffd45a-3fc0-4320-9fb6-6bd01f145a34 req-a139bfbb-4091-4294-8e98-4d9470c37495 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:22.506151 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c9ffd45a-3fc0-4320-9fb6-6bd01f145a34 req-a139bfbb-4091-4294-8e98-4d9470c37495 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 932 time: 0.1004298 Dec 10 14:32:22.510896 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a2aac1-31c8-46fd-82f0-e91d4bbcf8da tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.514074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a2a2aac1-31c8-46fd-82f0-e91d4bbcf8da tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.515178 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a2a2aac1-31c8-46fd-82f0-e91d4bbcf8da tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/d0c59df9-6fa1-4145-b3cd-0384ccff5b4f HTTP/1.1" status: 204 len: 168 time: 0.3536563 Dec 10 14:32:22.518007 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59908) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:22.528883 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5f7c5511-b4d4-4458-a694-a4403365c018 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.536926 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-d3c1e101-7e82-4065-aca7-f7f02ce72412 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3545475 Dec 10 14:32:22.560887 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Request body: {'port': {'device_id': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:22.564903 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a2aac1-31c8-46fd-82f0-e91d4bbcf8da tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0c59df9-6fa1-4145-b3cd-0384ccff5b4f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:22.608387 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-6456168a-d2e5-40ad-a890-a44e9edbb8ba tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0891287 Dec 10 14:32:22.609221 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59910) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:22.618617 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-a1b2f33a-d8d7-4aa0-aff7-a7cb8ef4496b tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group': {'name': 'tempest-secgroup--23141436'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:22.624830 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c9ffd45a-3fc0-4320-9fb6-6bd01f145a34 req-d538a2d0-a9c8-4549-8932-f363f210c7c7 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1067283 Dec 10 14:32:22.655194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.672896 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-612b9311-ccfa-4ad5-a86d-932f4c869a8d None None] Provisioning complete for port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:22.674422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-612b9311-ccfa-4ad5-a86d-932f4c869a8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.713666 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5f7c5511-b4d4-4458-a694-a4403365c018 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.714423 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-612b9311-ccfa-4ad5-a86d-932f4c869a8d None None] Port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:32:22.735264 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1b2f33a-d8d7-4aa0-aff7-a7cb8ef4496b tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.759906 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f7c5511-b4d4-4458-a694-a4403365c018 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Subnet': ['ID=521465a1-ba8d-4123-9da4-889e47221956,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:22.761939 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-5f7c5511-b4d4-4458-a694-a4403365c018 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.765624 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5f7c5511-b4d4-4458-a694-a4403365c018 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/subnets/521465a1-ba8d-4123-9da4-889e47221956 HTTP/1.1" status: 204 len: 168 time: 0.5761905 Dec 10 14:32:22.767892 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59912) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:22.770939 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50e6bca3-fb90-4add-82ec-ba5e8532069e None None] Network b0b8dc19-b292-40b4-8b6e-993b1d9437ae requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:22.832433 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-95932cf1-b203-447e-918c-e77c39cfd367 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Deleting subnet ddedaae7-20f0-4b7a-94cb-f962123b7632 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:32:22.836483 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95932cf1-b203-447e-918c-e77c39cfd367 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.882141 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95932cf1-b203-447e-918c-e77c39cfd367 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.942154 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-232e432e-fd07-45a4-8cb1-dc53a8c68172 None None] DHCP port deletion for b0b8dc19-b292-40b4-8b6e-993b1d9437ae request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:32:22.967052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1b2f33a-d8d7-4aa0-aff7-a7cb8ef4496b tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.980707 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95932cf1-b203-447e-918c-e77c39cfd367 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:22.995622 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-232e432e-fd07-45a4-8cb1-dc53a8c68172 None None] Deleting port 53c382b9-237d-4077-af08-ab507ccd90dc {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:22.995984 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-232e432e-fd07-45a4-8cb1-dc53a8c68172 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.044045 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 {{(pid=103810) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:32:23.048987 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1b2f33a-d8d7-4aa0-aff7-a7cb8ef4496b tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.059183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.060421 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-232e432e-fd07-45a4-8cb1-dc53a8c68172 None None] For port 53c382b9-237d-4077-af08-ab507ccd90dc, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=53c382b9-237d-4077-af08-ab507ccd90dc,segment=NetworkSegment(215c5420-57ae-4a4f-882c-b978566f4fc2),segment_id=215c5420-57ae-4a4f-882c-b978566f4fc2)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:23.060818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-232e432e-fd07-45a4-8cb1-dc53a8c68172 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.073686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-232e432e-fd07-45a4-8cb1-dc53a8c68172 None None] Calling delete_port for 53c382b9-237d-4077-af08-ab507ccd90dc owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:23.099405 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b2f33a-d8d7-4aa0-aff7-a7cb8ef4496b tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f31ca9f4-ae83-49d8-8508-7ee57902b17e,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:23.128465 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95932cf1-b203-447e-918c-e77c39cfd367 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.129059 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.provisioning_blocks [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Transition to ACTIVE for port object 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 will not be triggered until provisioned by entity L2. {{(pid=103810) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:32:23.158718 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95932cf1-b203-447e-918c-e77c39cfd367 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Subnet': ['ID=ddedaae7-20f0-4b7a-94cb-f962123b7632,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:23.160937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-95932cf1-b203-447e-918c-e77c39cfd367 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.165982 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-a1b2f33a-d8d7-4aa0-aff7-a7cb8ef4496b tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.167131 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-95932cf1-b203-447e-918c-e77c39cfd367 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/subnets/ddedaae7-20f0-4b7a-94cb-f962123b7632 HTTP/1.1" status: 204 len: 168 time: 0.3979044 Dec 10 14:32:23.168593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85bea4d2-703b-4dc4-b405-141581b795f7 None None] Network 606d90a8-f9cd-4aad-a9ea-8f279933b819 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:23.177246 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-a1b2f33a-d8d7-4aa0-aff7-a7cb8ef4496b tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5536079 Dec 10 14:32:23.177397 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59916) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:23.179366 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59918) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:23.184298 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8268807b-9d09-41f0-91f6-7c527abf954d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Request body: {'security_group_rule': {'security_group_id': 'f31ca9f4-ae83-49d8-8508-7ee57902b17e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:23.225233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.252456 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.255654 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-232e432e-fd07-45a4-8cb1-dc53a8c68172 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.297693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-232e432e-fd07-45a4-8cb1-dc53a8c68172 None None] No DVR routers for this DVR port 53c382b9-237d-4077-af08-ab507ccd90dc on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:32:23.302419 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232e432e-fd07-45a4-8cb1-dc53a8c68172 None None] Pushing event deleted for resources: {'Port': ['ID=53c382b9-237d-4077-af08-ab507ccd90dc,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:23.366575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.370594 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Pushing event updated for resources: {'Port': ['ID=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:23.380147 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8268807b-9d09-41f0-91f6-7c527abf954d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.399570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b0b8dc19-b292-40b4-8b6e-993b1d9437ae']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:23.413831 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '215c5420-57ae-4a4f-882c-b978566f4fc2') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:23.414381 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '215c5420-57ae-4a4f-882c-b978566f4fc2') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:23.429621 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.444839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Attempting to bind port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:32:23.445220 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Attempting to bind port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:32:23.445538 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Attempting to bind port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 on network ff92c14f-f9fb-4f05-9886-7825120a4f21 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:23.449101 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75e04773-5851-4519-861b-ce14788c2eb0 None None] DHCP port deletion for 606d90a8-f9cd-4aad-a9ea-8f279933b819 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:32:23.455815 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.456348 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 on network ff92c14f-f9fb-4f05-9886-7825120a4f21 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:32:23.456553 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Attempting to bind port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 on network ff92c14f-f9fb-4f05-9886-7825120a4f21 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:23.467575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Releasing vlan 350 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:32:23.467952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.469299 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8268807b-9d09-41f0-91f6-7c527abf954d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.470403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 32, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:32:23.470820 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Checking segment: {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:23.471202 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Bound using segment: {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:32:23.471634 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Bound port: 37d9fbb5-c2f9-411a-ae51-98084b4cbb01, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'}}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:32:23.471975 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.520301 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-75e04773-5851-4519-861b-ce14788c2eb0 None None] Deleting port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:23.520888 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-75e04773-5851-4519-861b-ce14788c2eb0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.534810 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8268807b-9d09-41f0-91f6-7c527abf954d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:32:23.543568 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:32:23.574225 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8268807b-9d09-41f0-91f6-7c527abf954d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1f6182f6-fce5-4f49-8c15-887b3dc40121,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:23.583588 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] For port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:32:23.590511 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] For port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:32:23.600778 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-75e04773-5851-4519-861b-ce14788c2eb0 None None] For port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=662cdb4d-d8ff-490c-88c1-d69cb3577e0d,segment=NetworkSegment(69f5a656-a617-4178-981e-491620f56b76),segment_id=69f5a656-a617-4178-981e-491620f56b76)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:23.601170 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-75e04773-5851-4519-861b-ce14788c2eb0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.613194 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.616893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-75e04773-5851-4519-861b-ce14788c2eb0 None None] Calling delete_port for 662cdb4d-d8ff-490c-88c1-d69cb3577e0d owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:23.618152 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.621694 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/networks/b0b8dc19-b292-40b4-8b6e-993b1d9437ae HTTP/1.1" status: 204 len: 168 time: 0.4525175 Dec 10 14:32:23.624282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59920) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:23.638863 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b02245-e027-4861-827f-8b511acb3721 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Network': ['ID=b0b8dc19-b292-40b4-8b6e-993b1d9437ae,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:23.640406 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8268807b-9d09-41f0-91f6-7c527abf954d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.641722 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8268807b-9d09-41f0-91f6-7c527abf954d tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4612184 Dec 10 14:32:23.644846 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59922) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:23.695352 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.749445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fb916ac-b57f-4623-8069-a5ef365768f3 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.754931 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:23.755634 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.757098 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] 10.222.0.39 "PUT /v2.0/ports/37d9fbb5-c2f9-411a-ae51-98084b4cbb01 HTTP/1.1" status: 200 len: 1094 time: 1.2106800 Dec 10 14:32:23.757652 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:32:23.760003 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08e0b23d-33b7-4648-9c62-6753e0765b38" -d '{"events": [{"name": "network-changed", "server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:32:23.779291 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.785026 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-75e04773-5851-4519-861b-ce14788c2eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.811542 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b71253c8-bc7e-46cd-85d0-8cc369b07d8d service neutron] Pushing event updated for resources: {'Port': ['ID=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:23.838088 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75e04773-5851-4519-861b-ce14788c2eb0 None None] Pushing event deleted for resources: {'Port': ['ID=662cdb4d-d8ff-490c-88c1-d69cb3577e0d,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:23.846247 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:32:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-487da2e1-6638-42b8-8173-5d2ad5ecac1a x-openstack-request-id: req-487da2e1-6638-42b8-8173-5d2ad5ecac1a {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:32:23.846554 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:32:23.846809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-487da2e1-6638-42b8-8173-5d2ad5ecac1a {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:32:23.847221 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'status': 'completed', 'code': 200} Dec 10 14:32:23.852429 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fb916ac-b57f-4623-8069-a5ef365768f3 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.854402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75e04773-5851-4519-861b-ce14788c2eb0 None None] No DVR routers for this DVR port 662cdb4d-d8ff-490c-88c1-d69cb3577e0d on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:32:23.871401 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd99937d-fe45-4fbe-af20-ccd4f9428cc1 req-9283cb11-b459-4d9f-86ce-772780698ee4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:23.874035 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cd99937d-fe45-4fbe-af20-ccd4f9428cc1 req-9283cb11-b459-4d9f-86ce-772780698ee4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 944 time: 0.1532295 Dec 10 14:32:23.946538 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cd99937d-fe45-4fbe-af20-ccd4f9428cc1 req-88a1a014-fdfa-420a-9a4f-c7852595f13b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0617831 Dec 10 14:32:23.955003 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:23.980324 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['606d90a8-f9cd-4aad-a9ea-8f279933b819']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:23.991385 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '69f5a656-a617-4178-981e-491620f56b76') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:23.991687 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '69f5a656-a617-4178-981e-491620f56b76') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:23.996372 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fb916ac-b57f-4623-8069-a5ef365768f3 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.000548 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fb916ac-b57f-4623-8069-a5ef365768f3 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.004036 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9fb916ac-b57f-4623-8069-a5ef365768f3 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/f31ca9f4-ae83-49d8-8508-7ee57902b17e HTTP/1.1" status: 204 len: 168 time: 0.3558943 Dec 10 14:32:24.004233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0b23d-33b7-4648-9c62-6753e0765b38 req-9fc3a66c-84a0-421e-b243-d03607ea24af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:24.005066 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-08e0b23d-33b7-4648-9c62-6753e0765b38 req-9fc3a66c-84a0-421e-b243-d03607ea24af service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 1097 time: 0.0992918 Dec 10 14:32:24.005720 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59928) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:24.007305 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.014195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb916ac-b57f-4623-8069-a5ef365768f3 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f31ca9f4-ae83-49d8-8508-7ee57902b17e,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:24.067798 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 53c382b9-237d-4077-af08-ab507ccd90dc no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:32:24.082260 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.096854 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 53c382b9-237d-4077-af08-ab507ccd90dc {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:32:24.097201 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 53c382b9-237d-4077-af08-ab507ccd90dc not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:32:24.097678 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 662cdb4d-d8ff-490c-88c1-d69cb3577e0d no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:32:24.123820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 662cdb4d-d8ff-490c-88c1-d69cb3577e0d {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:32:24.124326 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 662cdb4d-d8ff-490c-88c1-d69cb3577e0d not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:32:24.149707 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Releasing vlan 374 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:32:24.150095 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:32:24.153097 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:32:24.222638 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8708fe08-d3a5-4888-a952-6cb31321fa90 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.2131369 Dec 10 14:32:24.225606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59930) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:24.269521 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-58c44160-520c-46b9-b717-1648f9a37322 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.0425828 Dec 10 14:32:24.272309 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59932) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:24.288208 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.api.v2.resource [None req-a0cb2864-db8d-4cbf-be41-1e8589cc74b7 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] delete failed (client error): The resource could not be found. Dec 10 14:32:24.289308 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a0cb2864-db8d-4cbf-be41-1e8589cc74b7 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "DELETE /v2.0/security-groups/f31ca9f4-ae83-49d8-8508-7ee57902b17e HTTP/1.1" status: 404 len: 347 time: 0.0158629 Dec 10 14:32:24.290144 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0b23d-33b7-4648-9c62-6753e0765b38 req-b7d98a20-b4b9-4476-91d2-03dd46b48eef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:24.291604 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-08e0b23d-33b7-4648-9c62-6753e0765b38 req-b7d98a20-b4b9-4476-91d2-03dd46b48eef service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&shared=False HTTP/1.1" status: 200 len: 898 time: 0.2695131 Dec 10 14:32:24.293022 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59934) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:24.339995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.344482 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-0798b3d2-571e-4ebb-a4fd-1f7745f620b7 tempest-SecGroupTest-1961409400 tempest-SecGroupTest-1961409400-project] 10.222.0.57 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0503876 Dec 10 14:32:24.387510 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.393245 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/networks/606d90a8-f9cd-4aad-a9ea-8f279933b819 HTTP/1.1" status: 204 len: 168 time: 0.7633948 Dec 10 14:32:24.393541 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59938) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:24.424516 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfbacac9-be01-4967-9950-c398393ea170 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Network': ['ID=606d90a8-f9cd-4aad-a9ea-8f279933b819,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:24.466625 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-96b308a3-701b-42a2-be31-5cd8ce2bbf91 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Deleting subnet f2977c1e-c9e6-4d98-846b-2d9306118f4f {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:32:24.470006 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96b308a3-701b-42a2-be31-5cd8ce2bbf91 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.491965 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0b23d-33b7-4648-9c62-6753e0765b38 req-95d62e3b-1574-4422-8e07-f66e29e231cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:24.494281 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-08e0b23d-33b7-4648-9c62-6753e0765b38 req-95d62e3b-1574-4422-8e07-f66e29e231cd service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1946497 Dec 10 14:32:24.515736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96b308a3-701b-42a2-be31-5cd8ce2bbf91 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.583318 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-67a2a2a1-2526-4444-badf-e4dd1dd7b0c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:24.584938 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-67a2a2a1-2526-4444-badf-e4dd1dd7b0c7 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 1097 time: 0.0441194 Dec 10 14:32:24.606665 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96b308a3-701b-42a2-be31-5cd8ce2bbf91 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.630556 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-e2e5932c-1b95-45a9-8f90-7c4307329e70 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37d9fbb5-c2f9-411a-ae51-98084b4cbb01 HTTP/1.1" status: 200 len: 217 time: 0.0354552 Dec 10 14:32:24.682717 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-77cae8ec-8776-4d47-be40-d444f0126afd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:24.684237 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-77cae8ec-8776-4d47-be40-d444f0126afd service neutron] 10.222.0.39 "GET /v2.0/subnets?id=4f430ec7-91c3-4707-a417-018d2e296df6 HTTP/1.1" status: 200 len: 834 time: 0.0466824 Dec 10 14:32:24.705110 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96b308a3-701b-42a2-be31-5cd8ce2bbf91 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.732770 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-02f008b1-974e-4071-a6a0-075e6671482b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:24.734443 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-02f008b1-974e-4071-a6a0-075e6671482b service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=ff92c14f-f9fb-4f05-9886-7825120a4f21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0431759 Dec 10 14:32:24.737064 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b308a3-701b-42a2-be31-5cd8ce2bbf91 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Subnet': ['ID=f2977c1e-c9e6-4d98-846b-2d9306118f4f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:24.740847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-96b308a3-701b-42a2-be31-5cd8ce2bbf91 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.744372 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-96b308a3-701b-42a2-be31-5cd8ce2bbf91 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/subnets/f2977c1e-c9e6-4d98-846b-2d9306118f4f HTTP/1.1" status: 204 len: 168 time: 0.3497767 Dec 10 14:32:24.746912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59942) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:24.749618 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-211a151a-e73a-4208-a492-f185177c0bac None None] Network 95325c3b-2663-4cb7-b976-32008e9b218c requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:24.815221 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59944) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:24.856577 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.868859 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-6d6de8de-fca5-435a-9567-62a6f57616e2 service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1224742 Dec 10 14:32:24.872854 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:32:24.925298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Deleting port 21c21f2e-6cb8-441b-be34-168cc8bdad54 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:24.925298 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:24.935760 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0427645-a949-44c6-8d9a-a5bd680299a3 None None] DHCP port deletion for 95325c3b-2663-4cb7-b976-32008e9b218c request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:32:24.986925 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-5d1a3049-1c43-457a-931d-aa79dd939f3b req-2c6571f7-e0a8-4d04-a0d4-b8704b1625cf service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1071222 Dec 10 14:32:25.022909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f0427645-a949-44c6-8d9a-a5bd680299a3 None None] Deleting port 21c21f2e-6cb8-441b-be34-168cc8bdad54 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:25.022909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0427645-a949-44c6-8d9a-a5bd680299a3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.023325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] For port 21c21f2e-6cb8-441b-be34-168cc8bdad54, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=21c21f2e-6cb8-441b-be34-168cc8bdad54,segment=NetworkSegment(d6a31439-d437-47ff-a395-ec941c2c5ae5),segment_id=d6a31439-d437-47ff-a395-ec941c2c5ae5)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:25.023325 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.050329 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Calling delete_port for 21c21f2e-6cb8-441b-be34-168cc8bdad54 owned by network:dhcp {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:25.088231 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-dd4ba9b5-2143-4a2d-8e2d-96ca5a2e17f5 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=cf8b14e3e25f4adcabbee7425543627e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2694771 Dec 10 14:32:25.088701 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59950) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:25.089686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-f0427645-a949-44c6-8d9a-a5bd680299a3 None None] For port 21c21f2e-6cb8-441b-be34-168cc8bdad54, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=21c21f2e-6cb8-441b-be34-168cc8bdad54,segment=NetworkSegment(d6a31439-d437-47ff-a395-ec941c2c5ae5),segment_id=d6a31439-d437-47ff-a395-ec941c2c5ae5)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:25.090230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0427645-a949-44c6-8d9a-a5bd680299a3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.105315 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-f0427645-a949-44c6-8d9a-a5bd680299a3 None None] Calling delete_port for 21c21f2e-6cb8-441b-be34-168cc8bdad54 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:25.136997 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f816e91-4712-46bc-b7f4-5d122ff9903b req-abe9b10f-7590-443b-a005-839abc7cc9ea tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:25.139085 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9f816e91-4712-46bc-b7f4-5d122ff9903b req-abe9b10f-7590-443b-a005-839abc7cc9ea tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 944 time: 0.1057010 Dec 10 14:32:25.160641 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae69fd5b-7a93-41aa-90fe-7e625a5b86ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.186763 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae69fd5b-7a93-41aa-90fe-7e625a5b86ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.276280 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-f0427645-a949-44c6-8d9a-a5bd680299a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.303311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0427645-a949-44c6-8d9a-a5bd680299a3 None None] Pushing event deleted for resources: {'Port': ['ID=21c21f2e-6cb8-441b-be34-168cc8bdad54,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:25.308044 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0427645-a949-44c6-8d9a-a5bd680299a3 None None] No DVR routers for this DVR port 21c21f2e-6cb8-441b-be34-168cc8bdad54 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:32:25.322850 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae69fd5b-7a93-41aa-90fe-7e625a5b86ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.327498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ae69fd5b-7a93-41aa-90fe-7e625a5b86ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.331128 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ae69fd5b-7a93-41aa-90fe-7e625a5b86ff admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/b13e9baa-1c83-4c2c-ae3b-484c215e409d HTTP/1.1" status: 204 len: 168 time: 0.2389183 Dec 10 14:32:25.338397 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae69fd5b-7a93-41aa-90fe-7e625a5b86ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b13e9baa-1c83-4c2c-ae3b-484c215e409d,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:25.480061 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.507671 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9f816e91-4712-46bc-b7f4-5d122ff9903b req-95d782f4-84a3-4bda-b862-a6a00e906d43 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3570771 Dec 10 14:32:25.510520 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Port': ['ID=21c21f2e-6cb8-441b-be34-168cc8bdad54,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:25.514752 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] No DVR routers for this DVR port 21c21f2e-6cb8-441b-be34-168cc8bdad54 on host dv-neutron-821401-2-hyperv {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:32:25.594234 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.614153 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['95325c3b-2663-4cb7-b976-32008e9b218c']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:25.625011 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd6a31439-d437-47ff-a395-ec941c2c5ae5') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:25.625314 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd6a31439-d437-47ff-a395-ec941c2c5ae5') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:25.635092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.648943 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.655160 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Releasing vlan 360 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:32:25.655550 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: self.session.flush() Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:32:25.658570 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:32:25.801635 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.813197 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:25.816419 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/networks/95325c3b-2663-4cb7-b976-32008e9b218c HTTP/1.1" status: 204 len: 168 time: 1.0684464 Dec 10 14:32:25.819418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59962) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:25.826457 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf814b-21e3-4fdf-aeed-ba2dfd5cc306 tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Pushing event deleted for resources: {'Network': ['ID=95325c3b-2663-4cb7-b976-32008e9b218c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:25.868262 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-2c4445f9-2f0e-4838-9ba4-493fc05c2e1c tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "GET /v2.0/ports?device_id=48fa50cb-7624-4300-9594-221d351f4dd0 HTTP/1.1" status: 200 len: 205 time: 0.0470054 Dec 10 14:32:25.870870 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59964) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:25.948188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-624cc25c-b50a-4b5c-8391-8ed5df7f109b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for router, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.047366 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 21c21f2e-6cb8-441b-be34-168cc8bdad54 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:32:26.069271 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 21c21f2e-6cb8-441b-be34-168cc8bdad54 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:32:26.069729 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 21c21f2e-6cb8-441b-be34-168cc8bdad54 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:32:26.378517 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59976) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:26.406433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-624cc25c-b50a-4b5c-8391-8ed5df7f109b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.408588 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-624cc25c-b50a-4b5c-8391-8ed5df7f109b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.479219 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1141590422-network', 'tenant_id': '4b12868550ef4f659847071e62f6882f'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:26.555890 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-624cc25c-b50a-4b5c-8391-8ed5df7f109b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.556446 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-624cc25c-b50a-4b5c-8391-8ed5df7f109b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Fanout notify agent at l3_agent the message router_deleted on router 48fa50cb-7624-4300-9594-221d351f4dd0 {{(pid=103810) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:32:26.565350 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-624cc25c-b50a-4b5c-8391-8ed5df7f109b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.565350 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-624cc25c-b50a-4b5c-8391-8ed5df7f109b tempest-RoutersNegativeIpV6Test-277278072 tempest-RoutersNegativeIpV6Test-277278072-project] 10.222.0.57 "DELETE /v2.0/routers/48fa50cb-7624-4300-9594-221d351f4dd0 HTTP/1.1" status: 204 len: 168 time: 0.6930509 Dec 10 14:32:26.598864 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Made reservation on behalf of 4b12868550ef4f659847071e62f6882f for: {'network': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:26.602454 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.645548 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.679744 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70bf1da1-5b22-4621-8f4a-1b40b1498dfa req-77aba4fe-28c0-4870-8d00-70213d1074ac tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:26.681219 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70bf1da1-5b22-4621-8f4a-1b40b1498dfa req-77aba4fe-28c0-4870-8d00-70213d1074ac tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 944 time: 0.1007867 Dec 10 14:32:26.755562 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-70bf1da1-5b22-4621-8f4a-1b40b1498dfa req-7a9c9735-3090-4926-a958-49882af6c13d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663466 Dec 10 14:32:26.784140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.853654 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.876605 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] vlan segment allocate from pool success with {'vlan_id': 388, 'physical_network': 'physnet1'} {{(pid=103811) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:32:26.892032 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=582c34e2-740e-49c4-a015-d7b71682d4b2,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:26.898821 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.899108 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.segments_db [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Added segment c6545aad-1c01-4ae8-b7b9-2156c317c6c7 of type vlan for network 4414830e-4c49-4bd5-8894-e99e87440d26 Dec 10 14:32:26.941807 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:26.977564 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 59986) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:27.030614 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:27.031607 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:27.032200 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:27.114970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] Pushing event updated for resources: {'Network': ['ID=4414830e-4c49-4bd5-8894-e99e87440d26,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:27.126328 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 4414830e-4c49-4bd5-8894-e99e87440d26 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:32:27.126995 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9fa7f008-2d02-42af-baba-6f312f1ce130 admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7473345 Dec 10 14:32:27.130131 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59990) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:27.136500 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Request body: {'subnet': {'network_id': '4414830e-4c49-4bd5-8894-e99e87440d26', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1141590422-subnet', 'tenant_id': '4b12868550ef4f659847071e62f6882f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:27.141873 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-319c4120-1b25-48dd-9527-d2aa3b63bf7a admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=f4458d42f98847a7909268deb386f7a6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1631274 Dec 10 14:32:27.144706 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 59992) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:27.212904 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65873935-96e2-40f6-8541-60a985a4071a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:27.235978 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65873935-96e2-40f6-8541-60a985a4071a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:27.266210 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Made reservation on behalf of 4b12868550ef4f659847071e62f6882f for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:27.268521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:27.391560 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65873935-96e2-40f6-8541-60a985a4071a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:27.394694 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-65873935-96e2-40f6-8541-60a985a4071a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:27.395850 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-65873935-96e2-40f6-8541-60a985a4071a admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/3be15a4e-d5cd-4077-9264-0f926a9f4c59 HTTP/1.1" status: 204 len: 168 time: 0.2501991 Dec 10 14:32:27.411790 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65873935-96e2-40f6-8541-60a985a4071a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3be15a4e-d5cd-4077-9264-0f926a9f4c59,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:27.521773 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:27.579112 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=26e870ff-5a32-4053-b785-99b500e83258,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:27.588000 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Checking segment: {'id': 'c6545aad-1c01-4ae8-b7b9-2156c317c6c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '4414830e-4c49-4bd5-8894-e99e87440d26'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:27.588418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Network hostable DHCP agents. Network: 4414830e-4c49-4bd5-8894-e99e87440d26, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:32:27.698781 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Network 4414830e-4c49-4bd5-8894-e99e87440d26 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:32:27.807318 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 4414830e-4c49-4bd5-8894-e99e87440d26) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:27.814675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:27.814675 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:27.816745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f256a32-49b9-4eee-9b7e-ea5540482814 None None] Network 4414830e-4c49-4bd5-8894-e99e87440d26 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:27.872641 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed71fa5-8710-4f6a-a6bf-94a1ac9bef08 req-693cee6a-d92c-412b-a5ac-28a072527153 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:27.874170 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0ed71fa5-8710-4f6a-a6bf-94a1ac9bef08 req-693cee6a-d92c-412b-a5ac-28a072527153 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 944 time: 0.0497324 Dec 10 14:32:27.884764 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-5723fca3-1b35-4c67-b6f0-01c21a9934a1 admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.7529979 Dec 10 14:32:27.920474 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f850ddcf-18c7-48c6-866f-5f499f5afe72 None None] Network 4414830e-4c49-4bd5-8894-e99e87440d26 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:27.931211 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0ed71fa5-8710-4f6a-a6bf-94a1ac9bef08 req-4c6c0084-024c-4371-b2c9-5f4e2284e61a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509915 Dec 10 14:32:28.088984 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:32:28.184615 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:28.196702 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'port_id': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'mac_address': 'fa:16:3e:fe:2d:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:32:28.238150 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:28.251017 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:32:28.270272 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:28.329311 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:28.381535 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:28.546804 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['37d9fbb5-c2f9-411a-ae51-98084b4cbb01'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:32:28.649494 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60012) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:28.655422 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1416024637-network', 'tenant_id': 'e3ca448fb6a84e11b108538a432d6c3b'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:28.750686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Made reservation on behalf of e3ca448fb6a84e11b108538a432d6c3b for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:28.753377 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:28.762138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:28.844082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:28.973344 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:28.994829 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] vlan segment allocate from pool success with {'vlan_id': 382, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:32:29.010598 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df669caf-f3da-4a1b-adfb-28cf6650db2a,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:29.013574 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:29.014191 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Added segment 19ca669f-a378-4ae7-9ff6-52012395ef2c of type vlan for network 6591c195-a5db-4d43-a56b-893ea07b7bc0 Dec 10 14:32:29.052924 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f9436c-11d5-4d09-bfb6-ce2cf469768f req-f2865a52-fc4f-4e09-b72c-dd23136c15f2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:29.054574 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f4f9436c-11d5-4d09-bfb6-ce2cf469768f req-f2865a52-fc4f-4e09-b72c-dd23136c15f2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 945 time: 0.0563190 Dec 10 14:32:29.055420 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:29.105464 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f4f9436c-11d5-4d09-bfb6-ce2cf469768f req-bb92ae1e-4fb2-406d-856c-13caed30f254 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444160 Dec 10 14:32:29.115802 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:29.116808 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:29.117445 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:29.207777 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5565336 Dec 10 14:32:29.216961 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1981e007-0aa0-4154-bced-d870eccf2b76 admin admin] Pushing event updated for resources: {'Network': ['ID=6591c195-a5db-4d43-a56b-893ea07b7bc0,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:29.217321 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60016) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:29.223445 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Request body: {'subnet': {'network_id': '6591c195-a5db-4d43-a56b-893ea07b7bc0', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1416024637-subnet', 'tenant_id': 'e3ca448fb6a84e11b108538a432d6c3b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:29.228025 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network 6591c195-a5db-4d43-a56b-893ea07b7bc0 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:32:29.310190 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Made reservation on behalf of e3ca448fb6a84e11b108538a432d6c3b for: {'subnet': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:29.312560 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126683548'] for subnet, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:29.544337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126567934', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126683522'] for subnet, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:29.599034 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=787fa6eb-c6bd-4fba-b1a0-01c626f0fe57,revision_number=0']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:29.607631 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Checking segment: {'id': '19ca669f-a378-4ae7-9ff6-52012395ef2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '6591c195-a5db-4d43-a56b-893ea07b7bc0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:29.607969 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Network hostable DHCP agents. Network: 6591c195-a5db-4d43-a56b-893ea07b7bc0, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103811) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:32:29.709714 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Network 6591c195-a5db-4d43-a56b-893ea07b7bc0 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103811) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:32:29.807208 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, 6591c195-a5db-4d43-a56b-893ea07b7bc0) {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:29.811632 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:29.812227 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:29.817013 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38042e60-6943-413b-ac30-6cabc00f748f None None] Network 6591c195-a5db-4d43-a56b-893ea07b7bc0 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:29.901860 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-d9ff0512-2402-4905-89dd-61605274efd1 admin admin] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.6822388 Dec 10 14:32:30.055305 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4026d705-857a-437a-a459-7cddc0fc2506 None None] Network 6591c195-a5db-4d43-a56b-893ea07b7bc0 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:32:30.113068 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:30.231075 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41bb788d-26ee-4ff7-8420-3e6fda82df8b req-33701dda-c3c6-40f6-9ee5-0400827c8ff7 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:30.233125 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-41bb788d-26ee-4ff7-8420-3e6fda82df8b req-33701dda-c3c6-40f6-9ee5-0400827c8ff7 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 945 time: 0.0538843 Dec 10 14:32:30.286624 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-41bb788d-26ee-4ff7-8420-3e6fda82df8b req-4dd7da26-c3e7-40b8-96e3-5afc3bbe6587 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471015 Dec 10 14:32:30.310686 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:32:30.314700 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:30.315075 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:30.392245 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:30.399875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b752e85-e029-4da6-9494-d760b39ab81c req-da47998a-5631-47a1-aff5-145122a98941 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:30.401498 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-da47998a-5631-47a1-aff5-145122a98941 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/networks?id=4414830e-4c49-4bd5-8894-e99e87440d26 HTTP/1.1" status: 200 len: 812 time: 0.1059563 Dec 10 14:32:30.415242 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:32:30.416976 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-65e0d364-d5ab-44ed-996c-69676c63ae87 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/quotas/4b12868550ef4f659847071e62f6882f HTTP/1.1" status: 200 len: 375 time: 0.0092146 Dec 10 14:32:30.417767 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16a34892-50c5-417e-88df-bb71814f3c3f" -d '{"events": [{"server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "name": "network-vif-plugged", "status": "completed", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:32:30.431619 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:30.451574 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-dd11037a-61c4-454b-a4bb-38964c3f86fb tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=4b12868550ef4f659847071e62f6882f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0278089 Dec 10 14:32:30.457831 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:32:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e085299-b649-4686-8d89-035bd4719fc6 x-openstack-request-id: req-2e085299-b649-4686-8d89-035bd4719fc6 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:32:30.460088 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "name": "network-vif-plugged", "status": "completed", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:32:30.460088 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-2e085299-b649-4686-8d89-035bd4719fc6 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:32:30.460088 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'code': 200} Dec 10 14:32:30.499361 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:30.549598 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d1d90146-0d30-4630-90d2-c6423cda37e1 service neutron] 10.222.0.57 "GET /v2.0/networks/4414830e-4c49-4bd5-8894-e99e87440d26?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895469 Dec 10 14:32:30.550758 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:30.640816 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-c923c786-597a-46d5-91f5-59c8d98d88c9 service neutron] 10.222.0.57 "GET /v2.0/networks/4414830e-4c49-4bd5-8894-e99e87440d26?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850885 Dec 10 14:32:30.751933 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0dae338-6dd4-4c62-b322-4bdd57f778e5 req-ec1d2fd4-ae96-4630-837d-47948834b1d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:30.753446 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b0dae338-6dd4-4c62-b322-4bdd57f778e5 req-ec1d2fd4-ae96-4630-837d-47948834b1d0 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 1099 time: 0.0416172 Dec 10 14:32:30.799837 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b0dae338-6dd4-4c62-b322-4bdd57f778e5 req-549a1cdc-c0c1-4e73-8aaf-7f2766575c90 service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395381 Dec 10 14:32:30.895605 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d6ebca20-b17b-455f-8c49-be85b6e6e53c req-a82c1449-2f86-43af-908a-8a6d14d78889 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 210 time: 0.0274880 Dec 10 14:32:31.092799 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:31.409833 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-466a5d2d-9d30-4ffe-af99-07ce24a2eaae req-ad1e9365-da9b-4757-98a6-d18018efe652 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:31.411834 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-466a5d2d-9d30-4ffe-af99-07ce24a2eaae req-ad1e9365-da9b-4757-98a6-d18018efe652 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 946 time: 0.0561879 Dec 10 14:32:31.462150 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-466a5d2d-9d30-4ffe-af99-07ce24a2eaae req-b8d02ae9-06ce-41e2-b09e-441967600fd5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442386 Dec 10 14:32:31.992457 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4188b199-fd99-4c53-9178-60bf9f600631 req-f22acc82-6a6f-4026-ba05-ebddb7feb9e0 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 210 time: 0.0291247 Dec 10 14:32:32.578144 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8501b466-fb16-4221-92ec-f8e78f133d9b req-e726a052-cebb-4cb9-b3c5-b26066a35539 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:32.579610 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8501b466-fb16-4221-92ec-f8e78f133d9b req-e726a052-cebb-4cb9-b3c5-b26066a35539 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 946 time: 0.0508907 Dec 10 14:32:32.629604 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8501b466-fb16-4221-92ec-f8e78f133d9b req-48678fe3-f4ee-4953-a599-291512403f87 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441406 Dec 10 14:32:32.749472 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ad61ba0-c871-46c0-8b15-8ca7acc00898 req-4d8eaedc-65cf-40c8-b7aa-3a1ac9ebff9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:32.750854 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3ad61ba0-c871-46c0-8b15-8ca7acc00898 req-4d8eaedc-65cf-40c8-b7aa-3a1ac9ebff9a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 946 time: 0.0564978 Dec 10 14:32:32.802617 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3ad61ba0-c871-46c0-8b15-8ca7acc00898 req-d64b1105-8636-4556-94ef-77b142ea2b3e tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457380 Dec 10 14:32:32.824532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60058) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:32.881486 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-791c59c8-1eae-4096-98f1-b1313a992a46 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:33.039066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b752e85-e029-4da6-9494-d760b39ab81c req-33f32b57-10ef-44d5-9aa8-441692110da4 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:33.040650 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-33f32b57-10ef-44d5-9aa8-441692110da4 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.39 "GET /v2.0/networks?id=4414830e-4c49-4bd5-8894-e99e87440d26 HTTP/1.1" status: 200 len: 812 time: 0.1140041 Dec 10 14:32:33.045970 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5264ef77-af53-45b3-b196-7fce4b0e3385 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:33.049450 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5264ef77-af53-45b3-b196-7fce4b0e3385 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 1094 time: 0.2224038 Dec 10 14:32:33.051238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60064) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:33.055297 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Request body: {'port': {'device_id': 'bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c', 'network_id': '4414830e-4c49-4bd5-8894-e99e87440d26', 'admin_state_up': True, 'tenant_id': '4b12868550ef4f659847071e62f6882f'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:33.057789 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'floatingip': {'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'port_id': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address': '172.20.0.11'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:33.108924 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d8127945-23a4-4a74-a05c-2af02d192660 req-bf3574e5-df37-4458-8b1b-d20fb3293db2 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 210 time: 0.0369396 Dec 10 14:32:33.184737 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:33.282140 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:33.324723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Made reservation on behalf of 4b12868550ef4f659847071e62f6882f for: {'port': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:32:33.326702 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:33.403561 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.26.2.17 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/8d6d3c26-6f73-451b-9101-5cecfaf1b614) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:33.465661 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Allocated IP 172.20.0.10 (4414830e-4c49-4bd5-8894-e99e87440d26/26e870ff-5a32-4053-b785-99b500e83258/100e72fa-800a-4374-82c0-0532b627893f) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:32:33.509567 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:33.613307 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:33.613835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:33.654588 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:33.657603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:33.660162 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:33.694357 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=8d6d3c26-6f73-451b-9101-5cecfaf1b614,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:33.722384 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:33.768057 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Network 4414830e-4c49-4bd5-8894-e99e87440d26 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:32:33.771218 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:32:33.774998 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:32:33.798046 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Pushing event updated for resources: {'Port': ['ID=100e72fa-800a-4374-82c0-0532b627893f,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:33.826194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:33.826918 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:33.924372 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-131d1ea9-49b3-4ea6-a652-8d6d29aa4c0c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8730335 Dec 10 14:32:33.937738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Request body: {'port': {'device_id': 'bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:32:33.999163 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.170856 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.263294 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 100e72fa-800a-4374-82c0-0532b627893f {{(pid=103810) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:32:34.271025 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.285091 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.provisioning_blocks [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Transition to ACTIVE for port object 100e72fa-800a-4374-82c0-0532b627893f will not be triggered until provisioned by entity L2. {{(pid=103810) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:32:34.285963 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3b3455d-852d-4eba-8b64-104313dbe29d req-dc9e84fb-e8d4-4034-a06d-68c010757ebb tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:34.292141 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d3b3455d-852d-4eba-8b64-104313dbe29d req-dc9e84fb-e8d4-4034-a06d-68c010757ebb tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 932 time: 0.1000543 Dec 10 14:32:34.335131 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d3b3455d-852d-4eba-8b64-104313dbe29d req-31b8121f-7f70-43c8-a7a8-f2abb6fa72dc tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414026 Dec 10 14:32:34.384173 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.393274 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.438314 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Pushing event updated for resources: {'Port': ['ID=100e72fa-800a-4374-82c0-0532b627893f,revision_number=2']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:34.506041 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Attempting to bind port 100e72fa-800a-4374-82c0-0532b627893f on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:32:34.506386 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Attempting to bind port 100e72fa-800a-4374-82c0-0532b627893f by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': 'c6545aad-1c01-4ae8-b7b9-2156c317c6c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '4414830e-4c49-4bd5-8894-e99e87440d26'}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:32:34.506714 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Attempting to bind port 100e72fa-800a-4374-82c0-0532b627893f on network 4414830e-4c49-4bd5-8894-e99e87440d26 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:34.511082 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Port 100e72fa-800a-4374-82c0-0532b627893f on network 4414830e-4c49-4bd5-8894-e99e87440d26 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:32:34.511404 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Attempting to bind port 100e72fa-800a-4374-82c0-0532b627893f on network 4414830e-4c49-4bd5-8894-e99e87440d26 {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:32:34.516407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 32, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:32:34.516684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Checking segment: {'id': 'c6545aad-1c01-4ae8-b7b9-2156c317c6c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '4414830e-4c49-4bd5-8894-e99e87440d26'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:32:34.517068 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Bound using segment: {'id': 'c6545aad-1c01-4ae8-b7b9-2156c317c6c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '4414830e-4c49-4bd5-8894-e99e87440d26'} {{(pid=103810) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:32:34.517566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.managers [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Bound port: 100e72fa-800a-4374-82c0-0532b627893f, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c6545aad-1c01-4ae8-b7b9-2156c317c6c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 388, 'network_id': '4414830e-4c49-4bd5-8894-e99e87440d26'}}] {{(pid=103810) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:32:34.517929 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.551167 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.581123 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] For port 100e72fa-800a-4374-82c0-0532b627893f, host hv-neutron-8214, cleared binding levels {{(pid=103810) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:32:34.584122 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] For port 100e72fa-800a-4374-82c0-0532b627893f, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=100e72fa-800a-4374-82c0-0532b627893f,segment=NetworkSegment(c6545aad-1c01-4ae8-b7b9-2156c317c6c7),segment_id=c6545aad-1c01-4ae8-b7b9-2156c317c6c7)] {{(pid=103810) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:32:34.652564 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.718354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=8d6d3c26-6f73-451b-9101-5cecfaf1b614,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:34.729515 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.835401 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Floating IP 529eeae4-12df-409f-b0c7-cb50814eba97 associated. External IP: 172.26.2.17, port: 37d9fbb5-c2f9-411a-ae51-98084b4cbb01. Dec 10 14:32:34.893614 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-127408521'] for port, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.932133 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:34.932766 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:34.934163 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] 10.222.0.39 "PUT /v2.0/ports/100e72fa-800a-4374-82c0-0532b627893f HTTP/1.1" status: 200 len: 1094 time: 1.0010214 Dec 10 14:32:34.934610 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c', 'tag': '100e72fa-800a-4374-82c0-0532b627893f'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:32:34.936898 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b5cd7d15-0807-46d3-8eb7-3cf574a738d2" -d '{"events": [{"name": "network-changed", "server_uuid": "bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c", "tag": "100e72fa-800a-4374-82c0-0532b627893f"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:32:34.959598 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9052457-7e8b-4a71-a144-c9b818c00076 service neutron] Pushing event updated for resources: {'Port': ['ID=100e72fa-800a-4374-82c0-0532b627893f,revision_number=3']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:34.977459 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:32:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f1499c5-95b8-4131-85a0-8606f37f578f x-openstack-request-id: req-5f1499c5-95b8-4131-85a0-8606f37f578f {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:32:34.977995 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c", "tag": "100e72fa-800a-4374-82c0-0532b627893f", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:32:34.978254 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-5f1499c5-95b8-4131-85a0-8606f37f578f {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:32:34.978669 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c', 'tag': '100e72fa-800a-4374-82c0-0532b627893f', 'status': 'completed', 'code': 200} Dec 10 14:32:35.044406 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5cd7d15-0807-46d3-8eb7-3cf574a738d2 req-3166a947-d708-450b-8a34-bb462158a860 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:35.045861 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b5cd7d15-0807-46d3-8eb7-3cf574a738d2 req-3166a947-d708-450b-8a34-bb462158a860 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=4b12868550ef4f659847071e62f6882f&device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 1097 time: 0.0452545 Dec 10 14:32:35.081005 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9e515e57-cb88-4daa-8042-7c6664cc1317 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:32:35.147988 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5cd7d15-0807-46d3-8eb7-3cf574a738d2 req-27123b74-8911-478d-a135-30c7b2094406 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:35.149608 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b5cd7d15-0807-46d3-8eb7-3cf574a738d2 req-27123b74-8911-478d-a135-30c7b2094406 service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=4b12868550ef4f659847071e62f6882f&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0960121 Dec 10 14:32:35.167064 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-76591b22-9e9c-49d3-930c-15819f279582 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:35.190384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:32:35.200109 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] Sync routers for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:32:35.211694 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:35.212320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:35.256272 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5cd7d15-0807-46d3-8eb7-3cf574a738d2 req-d38ad327-3a8c-4238-bff5-6e8ebb035e4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:35.258043 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-b5cd7d15-0807-46d3-8eb7-3cf574a738d2 req-d38ad327-3a8c-4238-bff5-6e8ebb035e4c service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1002133 Dec 10 14:32:35.289516 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:35.321951 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3fd30946-9da7-4297-9b33-6215f58fc4c2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2687399 Dec 10 14:32:35.322297 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60074) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:35.326981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:32:35.326981 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75dfb6da-8655-44b9-adc7-b596bc110a31" -d '{"events": [{"name": "network-changed", "server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:32:35.327259 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:35.366577 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b752e85-e029-4da6-9494-d760b39ab81c req-e6b6cce4-1232-413c-a739-6b1b52a5fc0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:35.369019 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-e6b6cce4-1232-413c-a739-6b1b52a5fc0f service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=4b12868550ef4f659847071e62f6882f&device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 1097 time: 0.0724511 Dec 10 14:32:35.403465 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-44f0aa80-d8a2-46c8-879b-be7845b33856 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 991 time: 0.0736649 Dec 10 14:32:35.405291 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:32:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a73d19f2-c9b6-4042-8c6c-a6c7f825d16b x-openstack-request-id: req-a73d19f2-c9b6-4042-8c6c-a6c7f825d16b {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:32:35.405613 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:32:35.405871 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-a73d19f2-c9b6-4042-8c6c-a6c7f825d16b {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:32:35.406279 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'status': 'completed', 'code': 200} Dec 10 14:32:35.434235 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-a55e9232-964d-4403-83b2-c7cb4d113373 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=100e72fa-800a-4374-82c0-0532b627893f HTTP/1.1" status: 200 len: 217 time: 0.0558310 Dec 10 14:32:35.500694 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b752e85-e029-4da6-9494-d760b39ab81c req-ad8b561b-9095-44d9-8637-b785857dd6f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:35.502351 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-ad8b561b-9095-44d9-8637-b785857dd6f4 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=26e870ff-5a32-4053-b785-99b500e83258 HTTP/1.1" status: 200 len: 852 time: 0.0605514 Dec 10 14:32:35.548382 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-c71a2a39-e764-4340-bd91-b08d69196c78 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=4414830e-4c49-4bd5-8894-e99e87440d26&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0333869 Dec 10 14:32:35.655654 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '529eeae4-12df-409f-b0c7-cb50814eba97', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.17', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'port_id': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1398, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'mac_address': 'fa:16:3e:fe:2d:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:32:33Z', 'updated_at': '2021-12-10T14:32:33Z', 'revision_number': 0, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:35.664362 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-4e036eea-aca9-4bbf-b098-6b1df3a25e90 service neutron] 10.222.0.39 "GET /v2.0/networks/4414830e-4c49-4bd5-8894-e99e87440d26?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1141880 Dec 10 14:32:35.690060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] Checking router: 9e515e57-cb88-4daa-8042-7c6664cc1317 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:32:35.705518 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:32:35.706449 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:32:35Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:35.790864 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [req-2b752e85-e029-4da6-9494-d760b39ab81c req-030e693d-fd5c-456b-b8c1-6fc7e8627426 service neutron] 10.222.0.39 "GET /v2.0/networks/4414830e-4c49-4bd5-8894-e99e87440d26?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1189499 Dec 10 14:32:35.836988 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-d6340977-db65-4fc8-9c63-2d0bdbaf78cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:35.838540 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-d6340977-db65-4fc8-9c63-2d0bdbaf78cb service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 1099 time: 0.4301016 Dec 10 14:32:35.843610 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:32:35.850000 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06284f1b-6ec4-4eb6-b0a4-20205a0cca0c req-b8a0592f-409e-469b-a38d-ba21f9192033 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:35.854621 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-06284f1b-6ec4-4eb6-b0a4-20205a0cca0c req-b8a0592f-409e-469b-a38d-ba21f9192033 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 944 time: 0.3896627 Dec 10 14:32:36.025362 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-06284f1b-6ec4-4eb6-b0a4-20205a0cca0c req-c8be1080-7f89-42aa-a6db-8388b408cc9d tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1648457 Dec 10 14:32:36.047634 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-17f4dfe0-a234-4cd3-86e8-34624a5b3ba0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:36.049160 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-17f4dfe0-a234-4cd3-86e8-34624a5b3ba0 service neutron] 10.222.0.39 "GET /v2.0/networks?id=ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 200 len: 898 time: 0.1966200 Dec 10 14:32:36.087591 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '529eeae4-12df-409f-b0c7-cb50814eba97', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.17', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'port_id': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1398, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'mac_address': 'fa:16:3e:fe:2d:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:32:33Z', 'updated_at': '2021-12-10T14:32:33Z', 'revision_number': 0, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:36.118945 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e45a63b-5cf1-4fe7-9f62-f367261b1b63 None None] The sync data for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv is: [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '529eeae4-12df-409f-b0c7-cb50814eba97', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.17', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'port_id': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1398, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'mac_address': 'fa:16:3e:fe:2d:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:32:33Z', 'updated_at': '2021-12-10T14:32:33Z', 'revision_number': 0, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:32:36.183672 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-55161dbe-e1a1-4934-bc58-16ac444abc21 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37d9fbb5-c2f9-411a-ae51-98084b4cbb01 HTTP/1.1" status: 200 len: 999 time: 0.1263394 Dec 10 14:32:36.190178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:36.246378 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-6c5ccf96-cac8-4709-bf32-b4eb89c26152 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:36.247904 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-6c5ccf96-cac8-4709-bf32-b4eb89c26152 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=4f430ec7-91c3-4707-a417-018d2e296df6 HTTP/1.1" status: 200 len: 834 time: 0.0563049 Dec 10 14:32:36.329349 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-9fb28309-15fa-4545-b12e-efa013bbf938 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:36.334980 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-9fb28309-15fa-4545-b12e-efa013bbf938 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=ff92c14f-f9fb-4f05-9886-7825120a4f21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0764251 Dec 10 14:32:36.357707 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39ce10e4-d441-4d1b-8ec4-57359692a76e None None] New status for floating IP 529eeae4-12df-409f-b0c7-cb50814eba97: ACTIVE {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:32:36.405927 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60080) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:36.431736 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-179cd1ac-8f4a-453e-8ddc-153ce1f3bf28 service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0919335 Dec 10 14:32:36.533075 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-75dfb6da-8655-44b9-adc7-b596bc110a31 req-791ad335-2fa1-4323-b6d5-8084dc8e2cb7 service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0920255 Dec 10 14:32:36.545344 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-23d37a43-a5b4-40b4-a4fc-d6e7c4eb70e9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 991 time: 0.1381011 Dec 10 14:32:37.148261 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b66296bc-34a0-4fed-ae0d-9e8482ab61f3 req-38048ac9-569a-4b32-af25-9a9648762e72 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:37.149761 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b66296bc-34a0-4fed-ae0d-9e8482ab61f3 req-38048ac9-569a-4b32-af25-9a9648762e72 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 944 time: 0.0503039 Dec 10 14:32:37.196336 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b66296bc-34a0-4fed-ae0d-9e8482ab61f3 req-93c1685e-95d9-42ab-88b9-f20cf301b2f3 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399382 Dec 10 14:32:37.549171 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60086) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:37.558236 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:37.618188 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0215ab88-f9e8-4458-b0b3-78513de6fb47 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 993 time: 0.0674565 Dec 10 14:32:38.158351 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 100e72fa-800a-4374-82c0-0532b627893f details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:32:38.256526 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 100e72fa-800a-4374-82c0-0532b627893f, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=100e72fa-800a-4374-82c0-0532b627893f,segment=NetworkSegment(c6545aad-1c01-4ae8-b7b9-2156c317c6c7),segment_id=c6545aad-1c01-4ae8-b7b9-2156c317c6c7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:38.268358 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '100e72fa-800a-4374-82c0-0532b627893f', 'network_id': '4414830e-4c49-4bd5-8894-e99e87440d26', 'port_id': '100e72fa-800a-4374-82c0-0532b627893f', 'mac_address': 'fa:16:3e:0e:7f:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 388, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '26e870ff-5a32-4053-b785-99b500e83258', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:32:38.306441 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:38.320638 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 100e72fa-800a-4374-82c0-0532b627893f {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:32:38.324714 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc4e0508-85ab-411a-986e-0892010d6582 req-f1952638-b0c5-47ee-b8f6-73b3d65b941e tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:38.329264 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-bc4e0508-85ab-411a-986e-0892010d6582 req-f1952638-b0c5-47ee-b8f6-73b3d65b941e tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 944 time: 0.0632184 Dec 10 14:32:38.341107 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 100e72fa-800a-4374-82c0-0532b627893f, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=100e72fa-800a-4374-82c0-0532b627893f,segment=NetworkSegment(c6545aad-1c01-4ae8-b7b9-2156c317c6c7),segment_id=c6545aad-1c01-4ae8-b7b9-2156c317c6c7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:38.374813 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-bc4e0508-85ab-411a-986e-0892010d6582 req-a311316d-dc1c-4f9d-9e0f-1e7538ac62bc tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423911 Dec 10 14:32:38.418340 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:38.465518 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=100e72fa-800a-4374-82c0-0532b627893f,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:38.641797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['100e72fa-800a-4374-82c0-0532b627893f'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:32:38.813140 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:39.272952 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-c86f67cd-89cb-4683-aba5-6ac078ea51d1 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0407968 Dec 10 14:32:39.356891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-f2f42d5f-883f-449e-8d30-bb5c8437f102 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:39.359101 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-f2f42d5f-883f-449e-8d30-bb5c8437f102 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1098 time: 0.0415127 Dec 10 14:32:39.491786 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-47a2feb8-cee8-4726-bccb-87f183edc0a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:39.493309 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-47a2feb8-cee8-4726-bccb-87f183edc0a3 service neutron] 10.222.0.39 "GET /v2.0/networks?id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f HTTP/1.1" status: 200 len: 913 time: 0.1149423 Dec 10 14:32:39.509371 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe24188-e758-4af1-a38c-7027f1e09a48 req-6d14f93d-89ce-4a9d-ba63-b0e753904b1b tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:39.510786 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ffe24188-e758-4af1-a38c-7027f1e09a48 req-6d14f93d-89ce-4a9d-ba63-b0e753904b1b tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 945 time: 0.0672967 Dec 10 14:32:39.604538 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-2b9c2432-2585-4420-8fce-276868f44dab service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1 HTTP/1.1" status: 200 len: 1001 time: 0.0926540 Dec 10 14:32:39.609662 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-ffe24188-e758-4af1-a38c-7027f1e09a48 req-ecf2427d-010a-4b44-8c2c-22bc989c2a18 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919044 Dec 10 14:32:39.653021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-ced28c5c-1e79-4155-b1a2-e7b874235149 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:39.655457 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-ced28c5c-1e79-4155-b1a2-e7b874235149 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=d34297eb-b45e-40a3-93a5-fff721097da7 HTTP/1.1" status: 200 len: 851 time: 0.0438180 Dec 10 14:32:39.700143 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-e784595e-e14e-42d4-b25b-aac06bfafc38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:39.701654 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-e784595e-e14e-42d4-b25b-aac06bfafc38 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0396421 Dec 10 14:32:39.793071 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-03ae4798-69e5-4ddf-b8d4-b0676a72ef6a service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843165 Dec 10 14:32:39.880438 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8ecbbb77-7392-499b-90c0-51cdf8ac903e req-6658c0c8-5453-4261-8cda-179f172a9d58 service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0790315 Dec 10 14:32:40.173137 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 100e72fa-800a-4374-82c0-0532b627893f up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:32:40.275673 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port 100e72fa-800a-4374-82c0-0532b627893f completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:32:40.279764 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port 100e72fa-800a-4374-82c0-0532b627893f triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:32:40.280129 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:40.353728 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:40.375197 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '100e72fa-800a-4374-82c0-0532b627893f'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:32:40.377438 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7829556-783d-4803-b011-b7e722ebe00a" -d '{"events": [{"server_uuid": "bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c", "name": "network-vif-plugged", "status": "completed", "tag": "100e72fa-800a-4374-82c0-0532b627893f"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:32:40.390674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 100e72fa-800a-4374-82c0-0532b627893f, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=100e72fa-800a-4374-82c0-0532b627893f,segment=NetworkSegment(c6545aad-1c01-4ae8-b7b9-2156c317c6c7),segment_id=c6545aad-1c01-4ae8-b7b9-2156c317c6c7)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:40.412998 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:32:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0d4dd14-d67f-4ce9-8501-a6a421925c41 x-openstack-request-id: req-e0d4dd14-d67f-4ce9-8501-a6a421925c41 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:32:40.413292 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c", "name": "network-vif-plugged", "status": "completed", "tag": "100e72fa-800a-4374-82c0-0532b627893f", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:32:40.413648 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-e0d4dd14-d67f-4ce9-8501-a6a421925c41 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:32:40.414049 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '100e72fa-800a-4374-82c0-0532b627893f', 'code': 200} Dec 10 14:32:40.441920 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:40.497495 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=100e72fa-800a-4374-82c0-0532b627893f,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:40.673908 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd73f1c-c696-4fc1-bc35-dd1fece93e9c req-fec4a940-4750-43ec-a8cb-110a3720612e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:40.675463 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6bd73f1c-c696-4fc1-bc35-dd1fece93e9c req-fec4a940-4750-43ec-a8cb-110a3720612e service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 1099 time: 0.0473287 Dec 10 14:32:40.759168 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d378c4c-2425-46f7-aa5e-bdfb77628552 req-c6f7ebcc-3f19-48ca-b785-aa00492e24e9 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:40.760577 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9d378c4c-2425-46f7-aa5e-bdfb77628552 req-c6f7ebcc-3f19-48ca-b785-aa00492e24e9 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0828857 Dec 10 14:32:40.762611 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6bd73f1c-c696-4fc1-bc35-dd1fece93e9c req-3a170170-dcd6-4c03-91c8-28448de8ef85 service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768139 Dec 10 14:32:40.813027 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9d378c4c-2425-46f7-aa5e-bdfb77628552 req-84550468-890b-471d-90c1-9e711d432d24 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429847 Dec 10 14:32:41.931029 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78e80bb-3f10-4d19-a5c0-4a7d754fb432 req-dceb5a3b-f5d5-4363-8b9f-60a51aa12066 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:41.932597 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e78e80bb-3f10-4d19-a5c0-4a7d754fb432 req-dceb5a3b-f5d5-4363-8b9f-60a51aa12066 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0489340 Dec 10 14:32:41.986926 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-e78e80bb-3f10-4d19-a5c0-4a7d754fb432 req-0889fc55-7113-433b-9ee5-ea348f0e0a18 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476758 Dec 10 14:32:43.103687 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c07bdee-cc1d-4be2-886f-b0a4d5aeeab3 req-57a817e5-ea63-44ec-825e-ef5ec913c3b5 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:43.105158 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7c07bdee-cc1d-4be2-886f-b0a4d5aeeab3 req-57a817e5-ea63-44ec-825e-ef5ec913c3b5 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0488954 Dec 10 14:32:43.151505 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-7c07bdee-cc1d-4be2-886f-b0a4d5aeeab3 req-0e9be8c0-a0e6-4076-84d4-4cf3b389d630 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403759 Dec 10 14:32:43.265401 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d63e01b-21f6-4d65-8dd9-90d97c350a87 req-65ccbef8-d7b5-423c-8b0e-53fe59566121 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:43.266820 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8d63e01b-21f6-4d65-8dd9-90d97c350a87 req-65ccbef8-d7b5-423c-8b0e-53fe59566121 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0490787 Dec 10 14:32:43.314559 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8d63e01b-21f6-4d65-8dd9-90d97c350a87 req-3931acd8-b6de-4bc7-ba02-d8debdb3d508 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417743 Dec 10 14:32:43.782373 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75b049d-62b9-49c2-ae8a-f1f9cabd18c1 req-22ed03e7-8167-4739-9aa0-9e6c1ea8295a tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:43.783881 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c75b049d-62b9-49c2-ae8a-f1f9cabd18c1 req-22ed03e7-8167-4739-9aa0-9e6c1ea8295a tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0529172 Dec 10 14:32:43.832519 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c75b049d-62b9-49c2-ae8a-f1f9cabd18c1 req-ee15df9d-2c1e-4fec-bda7-f1782b60e173 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414801 Dec 10 14:32:44.948338 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f6e64bc-2ff7-4c68-bfd7-bb5a52f82f7b req-a34522ec-8ee6-4326-a027-d2215a46d216 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:44.949803 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8f6e64bc-2ff7-4c68-bfd7-bb5a52f82f7b req-a34522ec-8ee6-4326-a027-d2215a46d216 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0486507 Dec 10 14:32:44.996613 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-8f6e64bc-2ff7-4c68-bfd7-bb5a52f82f7b req-d75edaa7-a9e9-41c0-b494-caa0685b123d tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406144 Dec 10 14:32:45.357211 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37efd733-f548-4116-8e73-26d99784c1f4 req-9108d53e-076a-429d-bff6-5d9731554c93 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:45.360647 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-37efd733-f548-4116-8e73-26d99784c1f4 req-9108d53e-076a-429d-bff6-5d9731554c93 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0535309 Dec 10 14:32:45.410433 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-37efd733-f548-4116-8e73-26d99784c1f4 req-1c8a3829-08ad-4086-b86b-5fe5c7374de2 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455847 Dec 10 14:32:45.456706 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28146097-abff-4b5f-b10e-b962b2081627 req-0dfaabe3-492e-4de0-b51a-278d055f57e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:45.458192 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-28146097-abff-4b5f-b10e-b962b2081627 req-0dfaabe3-492e-4de0-b51a-278d055f57e1 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=4b12868550ef4f659847071e62f6882f&device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 1099 time: 0.0399871 Dec 10 14:32:45.553482 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28146097-abff-4b5f-b10e-b962b2081627 req-5b134ccb-a1f5-4a0a-b5d7-2ded85b0a3e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:45.555287 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-28146097-abff-4b5f-b10e-b962b2081627 req-5b134ccb-a1f5-4a0a-b5d7-2ded85b0a3e7 service neutron] 10.222.0.39 "GET /v2.0/networks?id=4414830e-4c49-4bd5-8894-e99e87440d26 HTTP/1.1" status: 200 len: 913 time: 0.0899439 Dec 10 14:32:45.598285 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-28146097-abff-4b5f-b10e-b962b2081627 req-656ac353-3cd6-4275-923d-87449ef7e312 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=100e72fa-800a-4374-82c0-0532b627893f HTTP/1.1" status: 200 len: 217 time: 0.0352018 Dec 10 14:32:45.646185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28146097-abff-4b5f-b10e-b962b2081627 req-967cd3ce-3007-49eb-9b9d-cd6a07210ea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:45.647613 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-28146097-abff-4b5f-b10e-b962b2081627 req-967cd3ce-3007-49eb-9b9d-cd6a07210ea2 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=26e870ff-5a32-4053-b785-99b500e83258 HTTP/1.1" status: 200 len: 852 time: 0.0425766 Dec 10 14:32:45.682426 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-28146097-abff-4b5f-b10e-b962b2081627 req-1dae9b4d-fe1f-4929-ab29-5279ad348a41 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=4414830e-4c49-4bd5-8894-e99e87440d26&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0241892 Dec 10 14:32:45.775517 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-28146097-abff-4b5f-b10e-b962b2081627 req-2077f44a-64a8-4946-aabb-99539e1213d7 service neutron] 10.222.0.39 "GET /v2.0/networks/4414830e-4c49-4bd5-8894-e99e87440d26?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833397 Dec 10 14:32:45.872027 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-28146097-abff-4b5f-b10e-b962b2081627 req-f65be945-0049-4158-828d-c5328af78cfa service neutron] 10.222.0.39 "GET /v2.0/networks/4414830e-4c49-4bd5-8894-e99e87440d26?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884750 Dec 10 14:32:46.540695 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0f1f0d-544f-441e-99ed-9195dfe76304 req-ecb3677b-bf42-4197-a893-d60ae9cbb642 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:46.542537 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2a0f1f0d-544f-441e-99ed-9195dfe76304 req-ecb3677b-bf42-4197-a893-d60ae9cbb642 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0573876 Dec 10 14:32:46.596396 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-2a0f1f0d-544f-441e-99ed-9195dfe76304 req-244238ce-3508-4d19-983c-8cc5b57f9ca5 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437365 Dec 10 14:32:47.711951 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300812f-362e-4f94-bbc2-ca076c031d85 req-fa1da518-a700-4801-b3de-6151046c8a57 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:47.713469 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d300812f-362e-4f94-bbc2-ca076c031d85 req-fa1da518-a700-4801-b3de-6151046c8a57 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0497425 Dec 10 14:32:47.760798 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d300812f-362e-4f94-bbc2-ca076c031d85 req-a2556676-f6b9-4dde-8c8b-6e080fb03842 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409713 Dec 10 14:32:48.204663 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-031d8db3-ed5f-4388-840b-4aa3361945c9 req-a98924f0-840c-4ae0-973c-0b80fcf812e4 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:48.206153 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-031d8db3-ed5f-4388-840b-4aa3361945c9 req-a98924f0-840c-4ae0-973c-0b80fcf812e4 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0481164 Dec 10 14:32:48.255702 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-031d8db3-ed5f-4388-840b-4aa3361945c9 req-8dd08fe8-9f98-494c-8588-30b2ef7d6c5e tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435166 Dec 10 14:32:49.374994 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dcc966-a64a-4f38-a51c-478e1eb62a06 req-592fa981-8b17-4d7d-a5f3-22fd6d216da9 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:49.376459 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-92dcc966-a64a-4f38-a51c-478e1eb62a06 req-592fa981-8b17-4d7d-a5f3-22fd6d216da9 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0489032 Dec 10 14:32:49.423813 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-92dcc966-a64a-4f38-a51c-478e1eb62a06 req-6c2487f6-4077-4ced-a4d0-4d72b06e5967 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412652 Dec 10 14:32:49.776395 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85d8875-c1a2-4d6c-be89-db1842e844f7 req-e7ac1fcf-7e27-40f1-9e56-7d88c32c2688 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:49.777888 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d85d8875-c1a2-4d6c-be89-db1842e844f7 req-e7ac1fcf-7e27-40f1-9e56-7d88c32c2688 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0504117 Dec 10 14:32:49.828211 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d85d8875-c1a2-4d6c-be89-db1842e844f7 req-e96f20f8-6cc7-455c-8e4c-a0033fd1f437 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428147 Dec 10 14:32:49.886597 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b98ba971-7604-49de-ad91-508eb966f978 req-7cc863bf-01df-406b-8723-6da0b2e2a199 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:49.888115 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b98ba971-7604-49de-ad91-508eb966f978 req-7cc863bf-01df-406b-8723-6da0b2e2a199 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=4b12868550ef4f659847071e62f6882f&device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 1099 time: 0.0434501 Dec 10 14:32:50.032351 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b98ba971-7604-49de-ad91-508eb966f978 req-6d2ce936-af67-47cc-a805-16134e2f79b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:50.033841 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b98ba971-7604-49de-ad91-508eb966f978 req-6d2ce936-af67-47cc-a805-16134e2f79b3 service neutron] 10.222.0.39 "GET /v2.0/networks?id=4414830e-4c49-4bd5-8894-e99e87440d26 HTTP/1.1" status: 200 len: 913 time: 0.1379621 Dec 10 14:32:50.079788 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b98ba971-7604-49de-ad91-508eb966f978 req-55ecfe9e-8250-483f-b9cf-7c766c0f4201 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=100e72fa-800a-4374-82c0-0532b627893f HTTP/1.1" status: 200 len: 217 time: 0.0387962 Dec 10 14:32:50.127749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b98ba971-7604-49de-ad91-508eb966f978 req-2fc877a7-ed03-465e-bd06-73d216117183 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:50.129200 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b98ba971-7604-49de-ad91-508eb966f978 req-2fc877a7-ed03-465e-bd06-73d216117183 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=26e870ff-5a32-4053-b785-99b500e83258 HTTP/1.1" status: 200 len: 852 time: 0.0429502 Dec 10 14:32:50.161106 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b98ba971-7604-49de-ad91-508eb966f978 req-b7cfaabe-e83e-48bb-b5fe-6f7793be0b08 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=4414830e-4c49-4bd5-8894-e99e87440d26&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249996 Dec 10 14:32:50.252916 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b98ba971-7604-49de-ad91-508eb966f978 req-b6349e41-a6c5-4fed-b308-199925959378 service neutron] 10.222.0.39 "GET /v2.0/networks/4414830e-4c49-4bd5-8894-e99e87440d26?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848897 Dec 10 14:32:50.342789 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b98ba971-7604-49de-ad91-508eb966f978 req-5d318e50-38be-4a02-9edb-71d20d347c86 service neutron] 10.222.0.39 "GET /v2.0/networks/4414830e-4c49-4bd5-8894-e99e87440d26?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820131 Dec 10 14:32:50.952104 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da2314f3-3411-41ea-adfa-6a2ebd6b913a req-6ff272d9-4972-4a92-8205-9499a56833bd tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:50.953609 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-da2314f3-3411-41ea-adfa-6a2ebd6b913a req-6ff272d9-4972-4a92-8205-9499a56833bd tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0513341 Dec 10 14:32:51.003720 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-da2314f3-3411-41ea-adfa-6a2ebd6b913a req-02bb28e7-8eb6-4a3a-9165-ed8d6a75a1b2 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441244 Dec 10 14:32:52.126122 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158c6e9a-e88c-4dbf-87b7-6e141654f1ad req-6aa41cab-3999-4916-a44d-e2535379e961 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:52.127593 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-158c6e9a-e88c-4dbf-87b7-6e141654f1ad req-6aa41cab-3999-4916-a44d-e2535379e961 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0533745 Dec 10 14:32:52.174753 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-158c6e9a-e88c-4dbf-87b7-6e141654f1ad req-0697f7f6-7501-4675-b7bf-408e2ddbc7a6 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409849 Dec 10 14:32:52.647535 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4b9e24-6a06-4435-9cab-81ad272092e9 req-435a4005-e4db-48a6-9092-5463ff00ec93 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:52.648914 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-bf4b9e24-6a06-4435-9cab-81ad272092e9 req-435a4005-e4db-48a6-9092-5463ff00ec93 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0478864 Dec 10 14:32:52.697162 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-bf4b9e24-6a06-4435-9cab-81ad272092e9 req-78e000e9-05f0-496b-8bf0-e30644b094dd tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413008 Dec 10 14:32:53.816018 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260479c5-532d-456d-afea-8eb3bd0d7f67 req-b90cb336-2b4c-42a2-9a66-167c91efd1bf tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:53.817539 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-260479c5-532d-456d-afea-8eb3bd0d7f67 req-b90cb336-2b4c-42a2-9a66-167c91efd1bf tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0523539 Dec 10 14:32:53.864485 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-260479c5-532d-456d-afea-8eb3bd0d7f67 req-c448f6d4-6090-46e5-98d9-267b5ac7071c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408018 Dec 10 14:32:54.647470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94966e09-a75d-45e8-a116-545725f69ac4 req-5602b709-4912-43d9-9236-ca9c98624dfc tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:54.648842 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-94966e09-a75d-45e8-a116-545725f69ac4 req-5602b709-4912-43d9-9236-ca9c98624dfc tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.39 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0565145 Dec 10 14:32:54.739471 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-94966e09-a75d-45e8-a116-545725f69ac4 req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Deleting port 100e72fa-800a-4374-82c0-0532b627893f {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:32:54.739809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-94966e09-a75d-45e8-a116-545725f69ac4 req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:54.833974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-94966e09-a75d-45e8-a116-545725f69ac4 req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] For port 100e72fa-800a-4374-82c0-0532b627893f, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=100e72fa-800a-4374-82c0-0532b627893f,segment=NetworkSegment(c6545aad-1c01-4ae8-b7b9-2156c317c6c7),segment_id=c6545aad-1c01-4ae8-b7b9-2156c317c6c7)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:32:54.834749 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-94966e09-a75d-45e8-a116-545725f69ac4 req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:54.846063 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-94966e09-a75d-45e8-a116-545725f69ac4 req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Calling delete_port for 100e72fa-800a-4374-82c0-0532b627893f owned by compute:nova {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:32:55.015797 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec7799c-702b-4806-b240-5968e36aae91 req-8a2aeb45-479a-4aee-a3c5-37a9a0c2809c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:32:55.017467 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0ec7799c-702b-4806-b240-5968e36aae91 req-8a2aeb45-479a-4aee-a3c5-37a9a0c2809c tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/ports?device_id=bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c HTTP/1.1" status: 200 len: 946 time: 0.0847330 Dec 10 14:32:55.065131 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0ec7799c-702b-4806-b240-5968e36aae91 req-5715b8ba-3a74-492a-9cc9-251fbc58d2e4 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.57 "GET /v2.0/security-groups?id=582c34e2-740e-49c4-a015-d7b71682d4b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417342 Dec 10 14:32:55.066172 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-94966e09-a75d-45e8-a116-545725f69ac4 req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:55.080471 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['100e72fa-800a-4374-82c0-0532b627893f'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:32:55.095225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Pushing event deleted for resources: {'Port': ['ID=100e72fa-800a-4374-82c0-0532b627893f,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:55.139656 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-94966e09-a75d-45e8-a116-545725f69ac4 req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] No DVR routers for this DVR port 100e72fa-800a-4374-82c0-0532b627893f on host hv-neutron-8214 {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:32:55.142232 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-94966e09-a75d-45e8-a116-545725f69ac4 req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:55.145689 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-94966e09-a75d-45e8-a116-545725f69ac4 req-bee0c147-ada0-422c-987b-9254c2770586 tempest-TestServerAdvancedOps-701218324 tempest-TestServerAdvancedOps-701218324-project] 10.222.0.39 "DELETE /v2.0/ports/100e72fa-800a-4374-82c0-0532b627893f HTTP/1.1" status: 204 len: 173 time: 0.4895525 Dec 10 14:32:55.146212 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c', 'name': 'network-vif-deleted', 'tag': '100e72fa-800a-4374-82c0-0532b627893f'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:32:55.148481 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ee83f61-8ad8-4a76-ba85-e2667d19d672" -d '{"events": [{"server_uuid": "bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c", "name": "network-vif-deleted", "tag": "100e72fa-800a-4374-82c0-0532b627893f"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:32:55.183410 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:32:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef061aa6-e2b3-440c-a232-3c96db3b3000 x-openstack-request-id: req-ef061aa6-e2b3-440c-a232-3c96db3b3000 {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:32:55.183736 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c", "name": "network-vif-deleted", "tag": "100e72fa-800a-4374-82c0-0532b627893f", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:32:55.183995 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-ef061aa6-e2b3-440c-a232-3c96db3b3000 {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:32:55.184396 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bdc9cc53-c68c-46c3-b3eb-e8f08ca4467c', 'name': 'network-vif-deleted', 'tag': '100e72fa-800a-4374-82c0-0532b627893f', 'status': 'completed', 'code': 200} Dec 10 14:32:56.129634 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60148) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:56.176774 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-c8f62379-2950-4ff8-876a-6e6e9ef52adf admin admin] Deleting subnet 26e870ff-5a32-4053-b785-99b500e83258 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:32:56.179821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c8f62379-2950-4ff8-876a-6e6e9ef52adf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.213654 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c8f62379-2950-4ff8-876a-6e6e9ef52adf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.252546 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c8f62379-2950-4ff8-876a-6e6e9ef52adf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.383892 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c8f62379-2950-4ff8-876a-6e6e9ef52adf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.407140 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f62379-2950-4ff8-876a-6e6e9ef52adf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=26e870ff-5a32-4053-b785-99b500e83258,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:56.416621 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-c8f62379-2950-4ff8-876a-6e6e9ef52adf admin admin] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.416760 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-c8f62379-2950-4ff8-876a-6e6e9ef52adf admin admin] 10.222.0.57 "DELETE /v2.0/subnets/26e870ff-5a32-4053-b785-99b500e83258 HTTP/1.1" status: 204 len: 168 time: 0.2860255 Dec 10 14:32:56.419201 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60150) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:56.489168 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.565313 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.584686 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4414830e-4c49-4bd5-8894-e99e87440d26']}} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:56.593980 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c6545aad-1c01-4ae8-b7b9-2156c317c6c7') {'for_net_delete': True} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:56.594282 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.services.segments.db [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c6545aad-1c01-4ae8-b7b9-2156c317c6c7') {} {{(pid=103810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:56.603724 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-127408147'] for segment, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.617000 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.622891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] Releasing vlan 388 on physical network physnet1 to pool {{(pid=103810) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:32:56.623267 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-127408557'] for segment, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: Traceback (most recent call last): Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: timer() Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: cb(*args, **kw) Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: return func(*args, **kwargs) Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: self._notify() Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: self.callback(batched_events) Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: event.method(event) Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: return f(self, *a, **k) Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._get(url).json() Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: return self.request(url, 'GET', **kwargs) Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:32:56.625521 dv-neutron-821401-2-hyperv neutron-server[103810]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:32:56.743863 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.749044 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.752324 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] 10.222.0.57 "DELETE /v2.0/networks/4414830e-4c49-4bd5-8894-e99e87440d26 HTTP/1.1" status: 204 len: 168 time: 0.3321431 Dec 10 14:32:56.755280 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60152) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:56.763566 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdaee87c-c8b1-44db-954d-39002653fadc admin admin] Pushing event deleted for resources: {'Network': ['ID=4414830e-4c49-4bd5-8894-e99e87440d26,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:56.801549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_v2 [None req-a3ff7b73-8ee2-432c-b811-203ec5d2a8ab admin admin] Deleting subnet 787fa6eb-c6bd-4fba-b1a0-01c626f0fe57 {{(pid=103811) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:32:56.804730 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3ff7b73-8ee2-432c-b811-203ec5d2a8ab admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.845487 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3ff7b73-8ee2-432c-b811-203ec5d2a8ab admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126500594'] for subnet, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:56.883111 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3ff7b73-8ee2-432c-b811-203ec5d2a8ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.013369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3ff7b73-8ee2-432c-b811-203ec5d2a8ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126567481', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126683643'] for subnet, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.041265 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3ff7b73-8ee2-432c-b811-203ec5d2a8ab admin admin] Pushing event deleted for resources: {'Subnet': ['ID=787fa6eb-c6bd-4fba-b1a0-01c626f0fe57,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:57.043316 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-a3ff7b73-8ee2-432c-b811-203ec5d2a8ab admin admin] Publish callbacks [] for subnet, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.047170 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a3ff7b73-8ee2-432c-b811-203ec5d2a8ab admin admin] 10.222.0.57 "DELETE /v2.0/subnets/787fa6eb-c6bd-4fba-b1a0-01c626f0fe57 HTTP/1.1" status: 204 len: 168 time: 0.2908521 Dec 10 14:32:57.049676 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60154) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:57.117165 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.198195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.218809 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6591c195-a5db-4d43-a56b-893ea07b7bc0']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:57.227874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '19ca669f-a378-4ae7-9ff6-52012395ef2c') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:57.228173 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '19ca669f-a378-4ae7-9ff6-52012395ef2c') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:32:57.237374 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.250078 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.255842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] Releasing vlan 382 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:32:57.256224 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:32:57.257888 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:32:57.407073 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.412615 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.415958 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] 10.222.0.57 "DELETE /v2.0/networks/6591c195-a5db-4d43-a56b-893ea07b7bc0 HTTP/1.1" status: 204 len: 168 time: 0.3653593 Dec 10 14:32:57.427123 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f2db9ef-bc02-4ebf-8936-2116f48af581 admin admin] Pushing event deleted for resources: {'Network': ['ID=6591c195-a5db-4d43-a56b-893ea07b7bc0,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:57.806464 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60160) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:57.848421 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-84058314-8106-469a-b580-29e0493af068 admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=4b12868550ef4f659847071e62f6882f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0406148 Dec 10 14:32:57.850787 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60164) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:57.897289 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8836e03a-2790-4a52-aa52-89506e3c8886 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:57.918609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8836e03a-2790-4a52-aa52-89506e3c8886 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:58.006736 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8836e03a-2790-4a52-aa52-89506e3c8886 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:58.009490 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8836e03a-2790-4a52-aa52-89506e3c8886 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:58.010655 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8836e03a-2790-4a52-aa52-89506e3c8886 admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/582c34e2-740e-49c4-a015-d7b71682d4b2 HTTP/1.1" status: 204 len: 168 time: 0.1589332 Dec 10 14:32:58.018354 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8836e03a-2790-4a52-aa52-89506e3c8886 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=582c34e2-740e-49c4-a015-d7b71682d4b2,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:32:58.238149 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 100e72fa-800a-4374-82c0-0532b627893f no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:32:58.257239 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: 100e72fa-800a-4374-82c0-0532b627893f {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:32:58.257609 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 100e72fa-800a-4374-82c0-0532b627893f not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:32:58.561532 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60170) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:58.605529 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b96d0743-f52a-4442-a943-28550ccc74ec admin admin] 10.222.0.57 "GET /v2.0/security-groups?tenant_id=e3ca448fb6a84e11b108538a432d6c3b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0427630 Dec 10 14:32:58.608009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60172) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:32:58.654132 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1376b1b9-31df-498a-b460-2de91ea744bb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:58.675412 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1376b1b9-31df-498a-b460-2de91ea744bb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:58.778250 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1376b1b9-31df-498a-b460-2de91ea744bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:58.781793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-1376b1b9-31df-498a-b460-2de91ea744bb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:32:58.782971 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-1376b1b9-31df-498a-b460-2de91ea744bb admin admin] 10.222.0.57 "DELETE /v2.0/security-groups/df669caf-f3da-4a1b-adfb-28cf6650db2a HTTP/1.1" status: 204 len: 168 time: 0.1740785 Dec 10 14:32:58.790958 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1376b1b9-31df-498a-b460-2de91ea744bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df669caf-f3da-4a1b-adfb-28cf6650db2a,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:01.047498 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:01.872419 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:33:02.858603 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0f24c042-79b5-401e-9984-71aae0c8e646 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:05.165566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-697f0332-037f-4f2e-8360-d519e815c4ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:06.229224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:07.600832 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:08.626618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60184) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:08.700533 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d051246-e21d-4e68-94cb-d118b832ca76 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:08.701009 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d051246-e21d-4e68-94cb-d118b832ca76 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:08.701502 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d051246-e21d-4e68-94cb-d118b832ca76 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:08.703157 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-5d051246-e21d-4e68-94cb-d118b832ca76 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/ports?project_id=c0bfba20c10d46e1abb38c3a54bd852b&network_id=ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 200 len: 3000 time: 0.0756123 Dec 10 14:33:08.801425 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:10.479272 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60194) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:10.530136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7f84a36-a02c-443f-8889-23b3146d7ca5 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:10.531615 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-a7f84a36-a02c-443f-8889-23b3146d7ca5 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57 HTTP/1.1" status: 200 len: 814 time: 0.0512407 Dec 10 14:33:10.989772 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60200) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:10.998520 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-ecf63a78-f97a-4e06-9a38-792f8914b4a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:11.054739 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecf63a78-f97a-4e06-9a38-792f8914b4a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, before_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:11.194821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecf63a78-f97a-4e06-9a38-792f8914b4a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:11.263706 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecf63a78-f97a-4e06-9a38-792f8914b4a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:11.263983 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.l3_db [None req-ecf63a78-f97a-4e06-9a38-792f8914b4a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Floating IP 529eeae4-12df-409f-b0c7-cb50814eba97 disassociated. External IP: 172.26.2.17, port: 37d9fbb5-c2f9-411a-ae51-98084b4cbb01. Dec 10 14:33:11.487527 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ecf63a78-f97a-4e06-9a38-792f8914b4a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9e515e57-cb88-4daa-8042-7c6664cc1317 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:33:11.597361 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ecf63a78-f97a-4e06-9a38-792f8914b4a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:33:11.606520 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ecf63a78-f97a-4e06-9a38-792f8914b4a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:11.607029 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] Sync routers for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:33:11.617481 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:33:11.618096 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:33:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:33:11.628020 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ecf63a78-f97a-4e06-9a38-792f8914b4a1 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 689 time: 0.6330314 Dec 10 14:33:11.629090 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01'}] {{(pid=103810) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:33:11.631431 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}148f5189d488a03d2ead1a2838bc235f416a24bf5ef838da54bc9067d2f62e70" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0adac11a-38cb-46b9-9682-55c9f5905a48" -d '{"events": [{"name": "network-changed", "server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01"}]}' {{(pid=103810) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:33:11.631742 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60202) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:11.670914 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:33:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-57c03509-9139-4c79-900d-264ab19252b3 x-openstack-request-id: req-57c03509-9139-4c79-900d-264ab19252b3 {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:33:11.671272 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01", "status": "completed", "code": 200}]} {{(pid=103810) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:33:11.671737 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-57c03509-9139-4c79-900d-264ab19252b3 {{(pid=103810) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:33:11.672205 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'status': 'completed', 'code': 200} Dec 10 14:33:11.678671 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-da40f5b2-33a9-41d6-891a-cfaa774c5d85 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 689 time: 0.0455275 Dec 10 14:33:11.740124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-f03f564d-9c71-4f84-ba80-230d89dee1d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:11.741682 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-f03f564d-9c71-4f84-ba80-230d89dee1d4 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 1099 time: 0.0470173 Dec 10 14:33:11.835881 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-ef41be85-a01b-4505-943d-88082cabdf70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:11.837367 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-ef41be85-a01b-4505-943d-88082cabdf70 service neutron] 10.222.0.39 "GET /v2.0/networks?id=ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 200 len: 898 time: 0.0882189 Dec 10 14:33:11.883265 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-818d1369-a68f-4981-832f-19367637bd92 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37d9fbb5-c2f9-411a-ae51-98084b4cbb01 HTTP/1.1" status: 200 len: 217 time: 0.0391622 Dec 10 14:33:11.884947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:33:12.101241 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:33:12.134184 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] Checking router: 9e515e57-cb88-4daa-8042-7c6664cc1317 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:33:12.143200 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:33:12.143830 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:33:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:33:12.232443 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-177c3d99-f233-4bfe-aba1-755e6d7813f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:12.234008 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-177c3d99-f233-4bfe-aba1-755e6d7813f6 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=4f430ec7-91c3-4707-a417-018d2e296df6 HTTP/1.1" status: 200 len: 834 time: 0.3440554 Dec 10 14:33:12.255295 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:33:12.279827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-87503ba3-0988-4ad2-ba32-263b778c6c3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:12.281332 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-87503ba3-0988-4ad2-ba32-263b778c6c3e service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=ff92c14f-f9fb-4f05-9886-7825120a4f21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0400751 Dec 10 14:33:12.391624 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-62157c54-25b7-433c-adfe-da1f6d69b1c6 service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1028717 Dec 10 14:33:12.464489 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:33:12.484714 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-0adac11a-38cb-46b9-9682-55c9f5905a48 req-6378185e-07d9-4f5e-8ecc-a5c75466e4c8 service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862472 Dec 10 14:33:12.493177 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7530671c-c3a2-4494-aa9e-e237fbbdeb96 None None] The sync data for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv is: [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:33:12.682462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60210) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:12.719238 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87593e4d-cd5b-4891-8088-c2fd744637d1 None None] New status for floating IP 529eeae4-12df-409f-b0c7-cb50814eba97: DOWN {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:33:12.735858 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-ae944c1d-013f-4fea-8261-aa77156b4b95 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 689 time: 0.0521345 Dec 10 14:33:13.739698 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60212) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:13.786392 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-d2c2d635-b14a-49ab-8ba2-26fb694f9b15 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 687 time: 0.0454676 Dec 10 14:33:15.148372 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60216) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:15.152922 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-706354902', 'description': 'tempest-secgroup-smoke-706354902 description', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:15.234064 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:15.298420 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:15.361043 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:15.390096 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2c72741b-ea46-4131-bb0f-063f5db929b6,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:15.396895 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.397257 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.397635 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.397988 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.398417 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.398753 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.399086 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.399521 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.399864 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.400198 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.400572 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.400856 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.401216 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:15.460178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:15.461444 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-22202849-9865-4535-b8ea-3b35f98e1aba tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3120425 Dec 10 14:33:15.464381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60218) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:15.468960 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-4cfef9d0-d3e0-41bf-aee7-73c303aea5e5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '2c72741b-ea46-4131-bb0f-063f5db929b6', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:15.537157 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4cfef9d0-d3e0-41bf-aee7-73c303aea5e5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:15.590811 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4cfef9d0-d3e0-41bf-aee7-73c303aea5e5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:15.641132 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4cfef9d0-d3e0-41bf-aee7-73c303aea5e5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:15.660006 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cfef9d0-d3e0-41bf-aee7-73c303aea5e5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eea1131c-914f-407a-8ade-6a6ad6335849,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:15.734587 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-4cfef9d0-d3e0-41bf-aee7-73c303aea5e5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:15.735860 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-4cfef9d0-d3e0-41bf-aee7-73c303aea5e5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2705276 Dec 10 14:33:15.738747 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60220) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:15.743177 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-733f11a5-1220-4300-9928-2f92247ea434 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '2c72741b-ea46-4131-bb0f-063f5db929b6', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:15.834488 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-733f11a5-1220-4300-9928-2f92247ea434 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.161669 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-733f11a5-1220-4300-9928-2f92247ea434 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.251967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-733f11a5-1220-4300-9928-2f92247ea434 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.269746 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-733f11a5-1220-4300-9928-2f92247ea434 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=acb09110-c10f-440a-9551-f281a6211fcb,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:16.368418 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-733f11a5-1220-4300-9928-2f92247ea434 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.369709 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-733f11a5-1220-4300-9928-2f92247ea434 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.6300097 Dec 10 14:33:16.372472 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60222) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:16.376742 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-10316503-bd85-4ef7-8a24-d006a19764fb tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '2c72741b-ea46-4131-bb0f-063f5db929b6', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:16.473607 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-10316503-bd85-4ef7-8a24-d006a19764fb tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.528683 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-10316503-bd85-4ef7-8a24-d006a19764fb tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.616796 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-10316503-bd85-4ef7-8a24-d006a19764fb tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.634760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10316503-bd85-4ef7-8a24-d006a19764fb tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=481440dd-351d-4d09-affa-ad5413eb6f21,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:16.711363 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-10316503-bd85-4ef7-8a24-d006a19764fb tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.712596 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-10316503-bd85-4ef7-8a24-d006a19764fb tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3391607 Dec 10 14:33:16.715341 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60224) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:16.719786 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-f413a0ca-3b7a-419c-a724-81e33d88c216 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '2c72741b-ea46-4131-bb0f-063f5db929b6', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:16.810889 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f413a0ca-3b7a-419c-a724-81e33d88c216 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.866403 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f413a0ca-3b7a-419c-a724-81e33d88c216 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.943543 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f413a0ca-3b7a-419c-a724-81e33d88c216 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:16.961609 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f413a0ca-3b7a-419c-a724-81e33d88c216 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bc065168-0a14-4f81-a54c-f04e2ce409f0,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:17.048597 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-f413a0ca-3b7a-419c-a724-81e33d88c216 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:17.049852 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-f413a0ca-3b7a-419c-a724-81e33d88c216 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3335271 Dec 10 14:33:17.053157 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60226) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:17.057433 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-8f163ed9-2e5e-4acc-b1bc-f47de3989b89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '2c72741b-ea46-4131-bb0f-063f5db929b6', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:17.189600 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-8f163ed9-2e5e-4acc-b1bc-f47de3989b89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:33:17.194498 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8f163ed9-2e5e-4acc-b1bc-f47de3989b89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:17.251623 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8f163ed9-2e5e-4acc-b1bc-f47de3989b89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:17.320991 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8f163ed9-2e5e-4acc-b1bc-f47de3989b89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:17.340712 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f163ed9-2e5e-4acc-b1bc-f47de3989b89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0bfa7dec-ada2-4074-84dd-495940553f10,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:17.453138 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8f163ed9-2e5e-4acc-b1bc-f47de3989b89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:17.454414 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8f163ed9-2e5e-4acc-b1bc-f47de3989b89 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4002991 Dec 10 14:33:17.457212 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60228) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:17.462215 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0b33d136-66c6-4d02-a20b-8a351cea7f40 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'security_group_rule': {'security_group_id': '2c72741b-ea46-4131-bb0f-063f5db929b6', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:17.577939 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.securitygroups_db [None req-0b33d136-66c6-4d02-a20b-8a351cea7f40 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Project c0bfba20c10d46e1abb38c3a54bd852b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 10 14:33:17.583809 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0b33d136-66c6-4d02-a20b-8a351cea7f40 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:17.642821 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0b33d136-66c6-4d02-a20b-8a351cea7f40 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:17.710097 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0b33d136-66c6-4d02-a20b-8a351cea7f40 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-384710'] for security_group_rule, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:17.729523 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b33d136-66c6-4d02-a20b-8a351cea7f40 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1fb786ed-4eda-4c49-9001-1223fcce0854,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:17.791270 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0b33d136-66c6-4d02-a20b-8a351cea7f40 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:17.792519 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0b33d136-66c6-4d02-a20b-8a351cea7f40 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3337779 Dec 10 14:33:17.988674 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-88e10aec-54e7-437b-8dee-65f08fb5e982 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-706354902&fields=id&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 267 time: 0.0440152 Dec 10 14:33:18.109124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-6487987b-611c-4210-abda-b1d04bea4f36 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:18.110611 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-6487987b-611c-4210-abda-b1d04bea4f36 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/networks?id=ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 200 len: 797 time: 0.1147435 Dec 10 14:33:18.125700 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-0c05af8c-7f73-40c6-ae59-9e62f88c4373 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/quotas/c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 375 time: 0.0088415 Dec 10 14:33:18.182452 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c2c8e9bc-79f3-427e-bfc3-4a12a23a5bf5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0510631 Dec 10 14:33:18.275034 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-7a142a3f-9b7c-4552-aad0-6e7cfc8d162c service neutron] 10.222.0.57 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802627 Dec 10 14:33:18.371857 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-2579f93d-1b61-40d2-9a64-816398d15680 service neutron] 10.222.0.57 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905535 Dec 10 14:33:18.685724 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-181290f6-da6f-49b8-bad3-53027dfd3a50 req-c42c4754-87f7-4f82-9632-310ed1af5160 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 210 time: 0.0276353 Dec 10 14:33:19.779366 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1484bfae-fec1-4e98-a20d-bd4d7cbac366 req-812e3622-554d-4876-b80a-bfa5ba8678d4 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 210 time: 0.0273986 Dec 10 14:33:20.673770 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-635b95c9-a2e8-4557-ba2a-77552c2ea985 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:20.675256 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-635b95c9-a2e8-4557-ba2a-77552c2ea985 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/networks?id=ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 200 len: 797 time: 0.0993252 Dec 10 14:33:20.765268 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-d062ebb6-3f85-4457-872d-6cf446541277 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c0bfba20c10d46e1abb38c3a54bd852b HTTP/1.1" status: 200 len: 472 time: 0.0796564 Dec 10 14:33:20.775533 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'port': {'device_id': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'admin_state_up': True, 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'security_groups': ['2c72741b-ea46-4131-bb0f-063f5db929b6']}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:20.890474 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-79f80157-4e75-4523-9453-26fcb9bbd459 req-c4ff55ae-8e82-4a28-ba17-a3d58e6ba334 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 210 time: 0.0391762 Dec 10 14:33:20.995092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'port': 1} {{(pid=103811) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:33:20.998692 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:21.122484 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.8 (ff92c14f-f9fb-4f05-9886-7825120a4f21/4f430ec7-91c3-4707-a417-018d2e296df6/62ca53bc-e32c-4df7-93cb-1e3776fcbe5b) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:33:21.258847 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:21.378572 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:21.398273 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:33:21.399734 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:33:21.401918 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:33:21.480732 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:21.481375 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:21.487735 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:21.499974 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.500327 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.500674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.501014 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.501346 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.501707 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.502037 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.502373 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.502698 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.503025 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.503349 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.503670 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.503989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:21.563923 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-c997052a-bc29-4d0c-91ca-107406b0cbca tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7920256 Dec 10 14:33:21.575822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Request body: {'port': {'device_id': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8214'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:21.617378 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-001a880b-416a-4733-9450-64c5d34b90e0 None None] Provisioning complete for port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:33:21.618034 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-001a880b-416a-4733-9450-64c5d34b90e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:21.629781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:21.650500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-001a880b-416a-4733-9450-64c5d34b90e0 None None] Port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:33:21.930207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b {{(pid=103811) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:33:21.937899 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:21.953793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.provisioning_blocks [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Transition to ACTIVE for port object 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b will not be triggered until provisioned by entity L2. {{(pid=103811) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 10 14:33:22.005570 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f661e861-a4a8-4acf-8dc5-202836320c0b req-5a484643-d488-4daa-afc9-124485c408ee tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:22.007037 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f661e861-a4a8-4acf-8dc5-202836320c0b req-5a484643-d488-4daa-afc9-124485c408ee tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 931 time: 0.0479169 Dec 10 14:33:22.051377 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:22.064275 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f661e861-a4a8-4acf-8dc5-202836320c0b req-4fdce91f-6166-4e3d-a361-66bf83175516 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0514097 Dec 10 14:33:22.110923 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Pushing event updated for resources: {'Port': ['ID=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:22.176185 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Attempting to bind port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b on host hv-neutron-8214 for vnic_type normal with profile {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:33:22.176606 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Attempting to bind port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b by drivers openvswitch,hyperv on host hv-neutron-8214 at level 0 using segments [{'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:33:22.176940 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Attempting to bind port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b on network ff92c14f-f9fb-4f05-9886-7825120a4f21 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:33:22.181626 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b on network ff92c14f-f9fb-4f05-9886-7825120a4f21 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8214 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 10 14:33:22.181947 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Attempting to bind port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b on network ff92c14f-f9fb-4f05-9886-7825120a4f21 {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:33:22.186855 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Checking agent: {'id': 'b7b4a10c-3674-4422-a48c-32cc5e5fe0d6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8214', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'started_at': datetime.datetime(2021, 12, 10, 14, 22, 31), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 33, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:33:22.187195 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Checking segment: {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103811) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:33:22.187594 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Bound using segment: {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'} {{(pid=103811) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:33:22.188010 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.managers [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Bound port: 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b, host: hv-neutron-8214, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '744b984b-20c9-438a-b07b-084c6734dffa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21'}}] {{(pid=103811) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:33:22.188369 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:22.253706 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] For port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b, host hv-neutron-8214, cleared binding levels {{(pid=103811) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:33:22.257618 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] For port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b, host hv-neutron-8214, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103811) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:33:22.331855 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:22.371957 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:22.372421 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:22.373922 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] 10.222.0.39 "PUT /v2.0/ports/62ca53bc-e32c-4df7-93cb-1e3776fcbe5b HTTP/1.1" status: 200 len: 1093 time: 0.8020749 Dec 10 14:33:22.374243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'tag': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:33:22.376469 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-73c37dbb-89f4-4989-b7a3-508131c023c2" -d '{"events": [{"name": "network-changed", "server_uuid": "2c598009-ee9a-40e3-af47-a3d4eed38795", "tag": "62ca53bc-e32c-4df7-93cb-1e3776fcbe5b"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:33:22.400427 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82fe97e0-59cf-4630-ab58-900c66ec5bd1 service neutron] Pushing event updated for resources: {'Port': ['ID=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,revision_number=3']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:22.416910 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:33:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7c98cee-24c2-47eb-955b-dfb52e8d9fcf x-openstack-request-id: req-e7c98cee-24c2-47eb-955b-dfb52e8d9fcf {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:33:22.417218 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2c598009-ee9a-40e3-af47-a3d4eed38795", "tag": "62ca53bc-e32c-4df7-93cb-1e3776fcbe5b", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:33:22.417543 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-e7c98cee-24c2-47eb-955b-dfb52e8d9fcf {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:33:22.417961 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'tag': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b', 'status': 'completed', 'code': 200} Dec 10 14:33:22.485106 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c37dbb-89f4-4989-b7a3-508131c023c2 req-f8cc78a1-4cc8-4169-a2c1-591cf28cc9dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:22.491488 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-73c37dbb-89f4-4989-b7a3-508131c023c2 req-f8cc78a1-4cc8-4169-a2c1-591cf28cc9dd service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 1096 time: 0.0447962 Dec 10 14:33:22.654172 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c37dbb-89f4-4989-b7a3-508131c023c2 req-8e3aff36-1193-4e04-8eda-1c0baa7bad19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:22.655554 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-73c37dbb-89f4-4989-b7a3-508131c023c2 req-8e3aff36-1193-4e04-8eda-1c0baa7bad19 service neutron] 10.222.0.39 "GET /v2.0/networks?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&shared=False HTTP/1.1" status: 200 len: 898 time: 0.1614056 Dec 10 14:33:22.814082 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c37dbb-89f4-4989-b7a3-508131c023c2 req-4791c717-815a-48cc-8fb2-00e5db37ce05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:22.815463 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-73c37dbb-89f4-4989-b7a3-508131c023c2 req-4791c717-815a-48cc-8fb2-00e5db37ce05 service neutron] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1537535 Dec 10 14:33:22.888134 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-d5396892-826e-48a2-a32c-b4077d0391d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:22.889636 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-d5396892-826e-48a2-a32c-b4077d0391d0 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 1096 time: 0.0397961 Dec 10 14:33:22.935721 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-b28d5404-3f70-4561-9c8c-1da85cbce02e service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b HTTP/1.1" status: 200 len: 217 time: 0.0386026 Dec 10 14:33:22.986207 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-903d2d36-0cf0-44d9-9a75-15b7728ae240 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:22.987613 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-903d2d36-0cf0-44d9-9a75-15b7728ae240 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=4f430ec7-91c3-4707-a417-018d2e296df6 HTTP/1.1" status: 200 len: 834 time: 0.0456030 Dec 10 14:33:23.031404 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-3eb45b4c-b04c-4255-a1fc-ba1c3966df33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:23.032811 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-3eb45b4c-b04c-4255-a1fc-ba1c3966df33 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=ff92c14f-f9fb-4f05-9886-7825120a4f21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0381789 Dec 10 14:33:23.119645 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-dfa81d75-584d-4943-a855-662b9379195e service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800216 Dec 10 14:33:23.228743 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6b6954-0690-4f96-9606-d6607a70bc95 req-c8d16fa0-9781-4f0c-bc31-25ce6e0ce56f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:23.230210 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3c6b6954-0690-4f96-9606-d6607a70bc95 req-c8d16fa0-9781-4f0c-bc31-25ce6e0ce56f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 943 time: 0.0968056 Dec 10 14:33:23.258052 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-4fd7805a-b5f5-40d9-9247-e911ddd79fc5 req-521b04db-8405-4061-9a1f-263b38e70d3a service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1315994 Dec 10 14:33:23.290155 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-3c6b6954-0690-4f96-9606-d6607a70bc95 req-29da1932-790c-432e-b852-3c370f5bbb7b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0524762 Dec 10 14:33:24.410238 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bb4fb6-6c77-40bc-9ba2-f9cdd2799fda req-9a3bd843-c55d-4799-8051-520838ff605f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:24.411752 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-16bb4fb6-6c77-40bc-9ba2-f9cdd2799fda req-9a3bd843-c55d-4799-8051-520838ff605f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 943 time: 0.0523150 Dec 10 14:33:24.460398 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-16bb4fb6-6c77-40bc-9ba2-f9cdd2799fda req-45f028bf-cc9d-4b1c-8e34-cd78bc5be1f8 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426466 Dec 10 14:33:25.575851 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2da01c5-db9c-4f8a-b5a4-802f19839af3 req-add1224d-45fc-475c-9d74-1fa82d7fc32a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:25.577299 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c2da01c5-db9c-4f8a-b5a4-802f19839af3 req-add1224d-45fc-475c-9d74-1fa82d7fc32a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 943 time: 0.0472219 Dec 10 14:33:25.624476 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c2da01c5-db9c-4f8a-b5a4-802f19839af3 req-979eb345-6349-4013-992e-97c7e0ca5023 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411723 Dec 10 14:33:26.330799 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b details requested by agent hyperv_hv-neutron-8214 with host hv-neutron-8214 {{(pid=103812) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 10 14:33:26.431195 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:33:26.442492 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Returning: {'device': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'port_id': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b', 'mac_address': 'fa:16:3e:01:d1:25', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103812) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 10 14:33:26.478554 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:26.491031 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b {{(pid=103812) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 10 14:33:26.509208 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:33:26.612180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:26.663447 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:26.670511 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.670870 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.671214 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.671557 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.671893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.672224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.672556 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.672884 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.673212 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.673579 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.673905 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.674230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.674551 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103812) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:33:26.739612 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de1c7835-2c0e-491d-a75c-82553179c826 req-d039dec3-7dd5-428e-9955-d295d99718cd tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:26.741082 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-de1c7835-2c0e-491d-a75c-82553179c826 req-d039dec3-7dd5-428e-9955-d295d99718cd tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 944 time: 0.0475531 Dec 10 14:33:26.793090 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-de1c7835-2c0e-491d-a75c-82553179c826 req-71acb9ab-e123-4e9d-ace8-0dcc483952a0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459812 Dec 10 14:33:26.822747 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] get_ports_and_sgs() called for port_ids ['62ca53bc-e32c-4df7-93cb-1e3776fcbe5b'] {{(pid=103812) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 10 14:33:27.907836 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cfa1a56-399e-4b0b-9da5-37fc0e91e953 req-b3f7ec7f-3ea2-4192-a0ae-1540e281e019 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:27.909291 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1cfa1a56-399e-4b0b-9da5-37fc0e91e953 req-b3f7ec7f-3ea2-4192-a0ae-1540e281e019 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 944 time: 0.0507991 Dec 10 14:33:27.957081 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1cfa1a56-399e-4b0b-9da5-37fc0e91e953 req-85e0ae54-762c-47db-aad0-2928f00bd1d2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411999 Dec 10 14:33:28.346215 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b up at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:33:28.428915 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning for port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b completed by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 10 14:33:28.432872 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Provisioning complete for port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:33:28.433240 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:28.508103 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:28.533018 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b'}] {{(pid=103812) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:33:28.535280 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}686b79364c5cde4c4aa753cd5772aafdc26c86514b8a38cbe0513a2a2a055bf1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2629e26f-2a3a-4b39-9b85-a8de7b5a394f" -d '{"events": [{"server_uuid": "2c598009-ee9a-40e3-af47-a3d4eed38795", "name": "network-vif-plugged", "status": "completed", "tag": "62ca53bc-e32c-4df7-93cb-1e3776fcbe5b"}]}' {{(pid=103812) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:33:28.547885 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] For port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:33:28.571118 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:33:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b019119b-07f2-42d5-a420-72eb519916f0 x-openstack-request-id: req-b019119b-07f2-42d5-a420-72eb519916f0 {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:33:28.571426 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2c598009-ee9a-40e3-af47-a3d4eed38795", "name": "network-vif-plugged", "status": "completed", "tag": "62ca53bc-e32c-4df7-93cb-1e3776fcbe5b", "code": 200}]} {{(pid=103812) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:33:28.571680 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-b019119b-07f2-42d5-a420-72eb519916f0 {{(pid=103812) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:33:28.572091 dv-neutron-821401-2-hyperv neutron-server[103812]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b', 'code': 200} Dec 10 14:33:28.628050 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:28.674120 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Pushing event updated for resources: {'Port': ['ID=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:33:28.836602 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1409e060-e582-4fbb-b314-94979113da30 req-1f6efab4-6966-4622-aac0-8cb13411f53c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:28.838155 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1409e060-e582-4fbb-b314-94979113da30 req-1f6efab4-6966-4622-aac0-8cb13411f53c service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 1098 time: 0.0390830 Dec 10 14:33:28.885109 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-1409e060-e582-4fbb-b314-94979113da30 req-77c6e4be-2583-407e-92aa-20ffa5cf6c57 service neutron] 10.222.0.39 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389998 Dec 10 14:33:29.073621 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d38f03-010b-4c16-b029-f1c7834ba548 req-5a0238f0-6ca8-461b-85af-bf398856158a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:29.075071 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-74d38f03-010b-4c16-b029-f1c7834ba548 req-5a0238f0-6ca8-461b-85af-bf398856158a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 945 time: 0.0512719 Dec 10 14:33:29.122819 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-74d38f03-010b-4c16-b029-f1c7834ba548 req-fe5738a8-4bd1-4eb0-bfea-66acdd912975 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418692 Dec 10 14:33:30.237978 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a20f1368-136f-45c3-8649-668becc702f4 req-f2dbd295-6b12-4788-818d-9b108f27b424 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:30.239524 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a20f1368-136f-45c3-8649-668becc702f4 req-f2dbd295-6b12-4788-818d-9b108f27b424 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 945 time: 0.0485861 Dec 10 14:33:30.288221 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-a20f1368-136f-45c3-8649-668becc702f4 req-2f88f104-94a7-4d21-a8d0-6584a6b4d1b3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427651 Dec 10 14:33:30.404927 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba83e29-3e65-4f45-97d7-0c9ea84979cc req-30b05e3b-5149-406c-a78b-3deb55b95704 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:30.406428 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6ba83e29-3e65-4f45-97d7-0c9ea84979cc req-30b05e3b-5149-406c-a78b-3deb55b95704 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 945 time: 0.0522082 Dec 10 14:33:30.455179 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-6ba83e29-3e65-4f45-97d7-0c9ea84979cc req-03a7ae69-6133-458a-996d-0782551b0b20 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423625 Dec 10 14:33:30.476585 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60282) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:30.515349 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68ca850c-bbf7-48f3-b7df-e9771e527311 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:30.516897 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-68ca850c-bbf7-48f3-b7df-e9771e527311 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 1093 time: 0.0393264 Dec 10 14:33:30.519650 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60284) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:30.523976 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.v2.base [None req-11eea442-e148-4481-920f-998864b7e01a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'floatingip': {'port_id': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b'}} {{(pid=103811) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:33:30.563090 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-11eea442-e148-4481-920f-998864b7e01a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:30.991508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-11eea442-e148-4481-920f-998864b7e01a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:31.046404 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-11eea442-e148-4481-920f-998864b7e01a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:31.069351 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:31.451407 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [None req-11eea442-e148-4481-920f-998864b7e01a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Floating IP 529eeae4-12df-409f-b0c7-cb50814eba97 associated. External IP: 172.26.2.17, port: 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b. Dec 10 14:33:31.649897 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11eea442-e148-4481-920f-998864b7e01a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9e515e57-cb88-4daa-8042-7c6664cc1317 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:33:31.755048 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11eea442-e148-4481-920f-998864b7e01a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:33:31.759631 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-11eea442-e148-4481-920f-998864b7e01a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:31.764973 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] Sync routers for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:33:31.777498 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:33:31.778379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:33:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:33:31.790100 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-11eea442-e148-4481-920f-998864b7e01a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 990 time: 1.2693386 Dec 10 14:33:31.790695 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'tag': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:33:31.792964 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cff14872-c692-4e2c-a67d-cfe292646e99" -d '{"events": [{"name": "network-changed", "server_uuid": "2c598009-ee9a-40e3-af47-a3d4eed38795", "tag": "62ca53bc-e32c-4df7-93cb-1e3776fcbe5b"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:33:31.793346 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60286) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:31.827949 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 10 Dec 2021 14:33:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3b2c4d1f-dd13-4da3-9f8d-48eec1397627 x-openstack-request-id: req-3b2c4d1f-dd13-4da3-9f8d-48eec1397627 {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:33:31.828243 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2c598009-ee9a-40e3-af47-a3d4eed38795", "tag": "62ca53bc-e32c-4df7-93cb-1e3776fcbe5b", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:33:31.828496 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-3b2c4d1f-dd13-4da3-9f8d-48eec1397627 {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:33:31.828898 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'tag': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b', 'status': 'completed', 'code': 200} Dec 10 14:33:31.881389 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ee3d9d45-20f4-4ac1-adf6-f1c88f49744d tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 990 time: 0.0864146 Dec 10 14:33:31.889517 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-affe1539-8300-4378-87fc-f18292a60f31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:31.891007 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-affe1539-8300-4378-87fc-f18292a60f31 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 1098 time: 0.0406036 Dec 10 14:33:31.899004 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:33:31.982331 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-d8824866-ddc1-4e5b-b222-65af7ea08c31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:31.983822 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-d8824866-ddc1-4e5b-b222-65af7ea08c31 service neutron] 10.222.0.39 "GET /v2.0/networks?id=ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 200 len: 898 time: 0.0858402 Dec 10 14:33:32.052780 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-e2c68ddb-9f9f-4bf8-a3d2-b4a1b06cf388 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b HTTP/1.1" status: 200 len: 998 time: 0.0589542 Dec 10 14:33:32.102891 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-868809ed-f8d7-44e5-9ee2-0f40661b3549 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:32.104339 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-868809ed-f8d7-44e5-9ee2-0f40661b3549 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=4f430ec7-91c3-4707-a417-018d2e296df6 HTTP/1.1" status: 200 len: 834 time: 0.0434241 Dec 10 14:33:32.121785 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '529eeae4-12df-409f-b0c7-cb50814eba97', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.17', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'port_id': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1398, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'mac_address': 'fa:16:3e:01:d1:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:32:33Z', 'updated_at': '2021-12-10T14:33:30Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:33:32.149148 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] Checking router: 9e515e57-cb88-4daa-8042-7c6664cc1317 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:33:32.155154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-6ba33d0a-c3eb-4139-b598-1040e69f9912 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:32.156694 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-6ba33d0a-c3eb-4139-b598-1040e69f9912 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=ff92c14f-f9fb-4f05-9886-7825120a4f21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0447390 Dec 10 14:33:32.160822 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:33:32.161978 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:33:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:33:32.247316 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-b12bcb4c-3a2d-4a49-9293-c20608916e5a service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833127 Dec 10 14:33:32.271599 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:33:32.342157 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-cff14872-c692-4e2c-a67d-cfe292646e99 req-ad784683-2f03-462f-aa96-6bb476e6dfe4 service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881708 Dec 10 14:33:32.489519 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '529eeae4-12df-409f-b0c7-cb50814eba97', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.17', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'port_id': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1398, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'mac_address': 'fa:16:3e:01:d1:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:32:33Z', 'updated_at': '2021-12-10T14:33:30Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:33:32.518790 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08e16de9-8bd7-4e65-b61d-a7a683de6ab0 None None] The sync data for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv is: [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_floatingips': [{'id': '529eeae4-12df-409f-b0c7-cb50814eba97', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'floating_ip_address': '172.26.2.17', 'floating_network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'router_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'port_id': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1398, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'mac_address': 'fa:16:3e:01:d1:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-10T14:32:33Z', 'updated_at': '2021-12-10T14:33:30Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:33:32.700613 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50da9ef9-8f67-4607-a074-3cf34e8a0201 None None] New status for floating IP 529eeae4-12df-409f-b0c7-cb50814eba97: ACTIVE {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:33:32.885146 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60290) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:32.892219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-0cdf3789-9846-4a93-959f-fad22be47a48 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:32.948853 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-c269f630-94c5-421e-83af-7334da46d9b6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 990 time: 0.0625451 Dec 10 14:33:33.952812 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60292) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:33:34.016211 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-00624e3a-35a4-4c0a-a573-83aef280c829 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 200 len: 992 time: 0.0620737 Dec 10 14:33:35.131802 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3f0388de-0813-44a8-bc3e-794df0000e4b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:36.217506 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:37.566253 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:38.771017 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:33:38.870764 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:33:41.298774 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-7aee8032-de6d-4977-8a75-d2d41d24f8fa service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0401318 Dec 10 14:33:41.357791 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-a4b3a834-eb12-4951-a857-4716636f6d2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:41.359275 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-a4b3a834-eb12-4951-a857-4716636f6d2c service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=c0bfba20c10d46e1abb38c3a54bd852b&device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 1099 time: 0.0398257 Dec 10 14:33:41.464225 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-e3ef80ab-7d60-480a-b469-f1906a9bbe02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:41.465719 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-e3ef80ab-7d60-480a-b469-f1906a9bbe02 service neutron] 10.222.0.39 "GET /v2.0/networks?id=ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 200 len: 898 time: 0.0852439 Dec 10 14:33:41.509671 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-912761fe-da12-49e0-8d69-0263ab191f30 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37d9fbb5-c2f9-411a-ae51-98084b4cbb01 HTTP/1.1" status: 200 len: 217 time: 0.0351014 Dec 10 14:33:41.562277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-c1e3e4c2-983e-4032-b99a-3ad1bcb21bdd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:41.563937 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-c1e3e4c2-983e-4032-b99a-3ad1bcb21bdd service neutron] 10.222.0.39 "GET /v2.0/subnets?id=4f430ec7-91c3-4707-a417-018d2e296df6 HTTP/1.1" status: 200 len: 834 time: 0.0432873 Dec 10 14:33:41.620136 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-82b1e6c9-479c-475e-be34-32870f0f1b64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:33:41.621727 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-82b1e6c9-479c-475e-be34-32870f0f1b64 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=ff92c14f-f9fb-4f05-9886-7825120a4f21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0497868 Dec 10 14:33:41.715628 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-e403a117-dd4b-4805-9f6d-71304ae02dc6 service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865836 Dec 10 14:33:41.810001 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9443f2e9-1e94-41c3-94a6-55129dcab35e req-cf531934-bdb4-4e81-8613-36fb935693c5 service neutron] 10.222.0.39 "GET /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860431 Dec 10 14:34:01.077732 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:02.860541 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9e0ea17c-5b55-4210-bfa1-e1c2acf9d0f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:05.135023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-710a15e3-dce1-4742-ae6e-8e3451de32d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:05.787760 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e6a394-7985-4eb3-a82d-76a50f40bb33 req-e000308b-b840-4e07-9ad6-5a3d1d793691 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:05.789766 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-02e6a394-7985-4eb3-a82d-76a50f40bb33 req-e000308b-b840-4e07-9ad6-5a3d1d793691 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 945 time: 0.0544064 Dec 10 14:34:05.839160 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-02e6a394-7985-4eb3-a82d-76a50f40bb33 req-9c0d1117-42e4-4a6e-ba4d-c1e75604e102 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435603 Dec 10 14:34:06.220464 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:06.956909 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f40f321d-2a65-43b5-8465-807e168fa171 req-d297e308-0d28-4cd6-9449-78a098ef53e7 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:06.958585 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f40f321d-2a65-43b5-8465-807e168fa171 req-d297e308-0d28-4cd6-9449-78a098ef53e7 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 945 time: 0.0501099 Dec 10 14:34:07.006363 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-f40f321d-2a65-43b5-8465-807e168fa171 req-417bf895-3806-4e43-910b-17b6537f3e77 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=2c72741b-ea46-4131-bb0f-063f5db929b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419750 Dec 10 14:34:07.109400 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-e10a1f0a-984e-43db-8845-4565693fe02f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:07.110874 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-e10a1f0a-984e-43db-8845-4565693fe02f tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 945 time: 0.0514627 Dec 10 14:34:07.198820 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:34:07.199160 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:07.287566 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:34:07.287922 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:07.507223 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:07.507603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-550932'] for floatingip, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:07.507908 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.db.l3_db [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Floating IP 529eeae4-12df-409f-b0c7-cb50814eba97 disassociated. External IP: 172.26.2.17, port: 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b. Dec 10 14:34:07.508296 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b owned by compute:nova {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:34:07.605979 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:07.689646 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:07.722471 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=62ca53bc-e32c-4df7-93cb-1e3776fcbe5b,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:07.835066 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9e515e57-cb88-4daa-8042-7c6664cc1317 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:34:07.937358 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:34:07.947180 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] Sync routers for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:34:07.957331 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:34:07.957964 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:34:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:07.978842 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] No DVR routers for this DVR port 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b on host hv-neutron-8214 {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:34:07.981476 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:07.985066 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-170c0567-1b26-4f6c-9a7d-938bc5a86a98 req-23e6dc0f-7fbc-4b27-98d8-b168f2c62d1b tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "DELETE /v2.0/ports/62ca53bc-e32c-4df7-93cb-1e3776fcbe5b HTTP/1.1" status: 204 len: 173 time: 0.8678598 Dec 10 14:34:07.985589 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'name': 'network-vif-deleted', 'tag': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:34:07.987822 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40c7525d-3bd1-4e1c-a49c-968427b03e60" -d '{"events": [{"server_uuid": "2c598009-ee9a-40e3-af47-a3d4eed38795", "name": "network-vif-deleted", "tag": "62ca53bc-e32c-4df7-93cb-1e3776fcbe5b"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:34:08.023003 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:34:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d79dd3a5-8070-4f7c-82b9-961f5f4807c8 x-openstack-request-id: req-d79dd3a5-8070-4f7c-82b9-961f5f4807c8 {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:34:08.023944 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2c598009-ee9a-40e3-af47-a3d4eed38795", "name": "network-vif-deleted", "tag": "62ca53bc-e32c-4df7-93cb-1e3776fcbe5b", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:34:08.024210 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-d79dd3a5-8070-4f7c-82b9-961f5f4807c8 {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:34:08.024616 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c598009-ee9a-40e3-af47-a3d4eed38795', 'name': 'network-vif-deleted', 'tag': '62ca53bc-e32c-4df7-93cb-1e3776fcbe5b', 'status': 'completed', 'code': 200} Dec 10 14:34:08.120670 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-c9c53d2e-0590-496d-907d-f272e0326bea req-4d1d0add-e9ce-41c7-b7fd-5e9314010778 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=2c598009-ee9a-40e3-af47-a3d4eed38795 HTTP/1.1" status: 200 len: 210 time: 0.0293977 Dec 10 14:34:08.218902 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:34:08.418130 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:08.448818 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] Checking router: 9e515e57-cb88-4daa-8042-7c6664cc1317 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:34:08.457173 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:34:08.457829 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:34:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:08.566559 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:34:08.772845 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:08.800669 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e09ce89-b5b6-4ee3-b2c4-eb41d6dabb2c None None] The sync data for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv is: [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:11Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '347bc2eb-e3db-42a3-b785-8d842864077c', 'name': '', 'network_id': 'ff92c14f-f9fb-4f05-9886-7825120a4f21', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:e6:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:08Z', 'updated_at': '2021-12-10T14:32:16Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '4f430ec7-91c3-4707-a417-018d2e296df6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:34:08.802237 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.030153 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c51bd59-0954-480c-8946-9f817268a156 None None] New status for floating IP 529eeae4-12df-409f-b0c7-cb50814eba97: DOWN {{(pid=103813) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 10 14:34:09.181301 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60318) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:09.236804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-06b54307-072e-44e5-9a1d-0c96bb2d25af tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.261339 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-06b54307-072e-44e5-9a1d-0c96bb2d25af tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.392156 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-06b54307-072e-44e5-9a1d-0c96bb2d25af tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.394835 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-06b54307-072e-44e5-9a1d-0c96bb2d25af tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.396045 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-06b54307-072e-44e5-9a1d-0c96bb2d25af tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/security-groups/2c72741b-ea46-4131-bb0f-063f5db929b6 HTTP/1.1" status: 204 len: 168 time: 0.2137151 Dec 10 14:34:09.406286 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b54307-072e-44e5-9a1d-0c96bb2d25af tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c72741b-ea46-4131-bb0f-063f5db929b6,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:09.491953 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60322) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:09.612692 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 8d6d3c26-6f73-451b-9101-5cecfaf1b614 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:34:09.613030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.687937 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.688260 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.700114 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 8d6d3c26-6f73-451b-9101-5cecfaf1b614 owned by network:floatingip {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:34:09.906462 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.929334 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=8d6d3c26-6f73-451b-9101-5cecfaf1b614,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:09.994875 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for floatingip, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.997563 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for floatingip, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:09.998700 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9974ff15-0e55-454b-8e5a-c14c2fd36ca6 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/floatingips/529eeae4-12df-409f-b0c7-cb50814eba97 HTTP/1.1" status: 204 len: 168 time: 0.5057528 Dec 10 14:34:10.431674 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae98cdd-897f-43c3-a26a-9cfa341ab46c req-394dac66-8480-415a-8471-9949c58672e3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:10.433147 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9ae98cdd-897f-43c3-a26a-9cfa341ab46c req-394dac66-8480-415a-8471-9949c58672e3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 946 time: 0.0526724 Dec 10 14:34:10.481620 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9ae98cdd-897f-43c3-a26a-9cfa341ab46c req-77385cf5-c538-4cfa-8831-570761e61a07 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424030 Dec 10 14:34:10.607422 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:34:10.627336 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:34:10.627674 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 62ca53bc-e32c-4df7-93cb-1e3776fcbe5b not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:34:11.597508 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793a5c2d-b6fc-45db-885e-f04938dfbd39 req-8bb200b4-e737-494c-8c74-9d9342a83c3a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:11.598878 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-793a5c2d-b6fc-45db-885e-f04938dfbd39 req-8bb200b4-e737-494c-8c74-9d9342a83c3a tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 946 time: 0.0495555 Dec 10 14:34:11.647928 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-793a5c2d-b6fc-45db-885e-f04938dfbd39 req-a21537e3-dea7-462b-8584-2de542961f75 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/security-groups?id=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426159 Dec 10 14:34:11.809859 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-e3edc51c-ac08-486b-9caf-0e048f015897 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:11.812433 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-e3edc51c-ac08-486b-9caf-0e048f015897 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 946 time: 0.0510969 Dec 10 14:34:11.902902 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:34:11.903135 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:11.996861 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01, host hv-neutron-8214, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8214',level=0,port_id=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:34:11.997528 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:12.009337 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 owned by compute:nova {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:34:12.194282 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:12.222630 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=37d9fbb5-c2f9-411a-ae51-98084b4cbb01,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:12.266277 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] No DVR routers for this DVR port 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 on host hv-neutron-8214 {{(pid=103811) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:34:12.268622 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-234001'] for port, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:12.271916 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-9ccb26d7-731d-4ef4-80bd-d210e0be0c36 req-53d534fc-3e00-45ec-b6b6-a6fea3b466e2 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.39 "DELETE /v2.0/ports/37d9fbb5-c2f9-411a-ae51-98084b4cbb01 HTTP/1.1" status: 204 len: 173 time: 0.4532032 Dec 10 14:34:12.272366 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'name': 'network-vif-deleted', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01'}] {{(pid=103811) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 10 14:34:12.275198 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.57/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d7d954a0122f77aa8b068adcda1011d33384482c201ac36812104416ed03790f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-19bad00e-2a8f-46ff-8b5a-a7d4e039f5e2" -d '{"events": [{"server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "name": "network-vif-deleted", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01"}]}' {{(pid=103811) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 10 14:34:12.319804 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 10 Dec 2021 14:34:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7ef707f-6a92-4300-bde4-783aaf83489b x-openstack-request-id: req-c7ef707f-6a92-4300-bde4-783aaf83489b {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 10 14:34:12.320659 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1b602b30-9f1c-4b7d-a901-4440a48df4f4", "name": "network-vif-deleted", "tag": "37d9fbb5-c2f9-411a-ae51-98084b4cbb01", "status": "completed", "code": 200}]} {{(pid=103811) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 10 14:34:12.320912 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.57/compute/v2.1/os-server-external-events used request id req-c7ef707f-6a92-4300-bde4-783aaf83489b {{(pid=103811) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 10 14:34:12.321306 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b602b30-9f1c-4b7d-a901-4440a48df4f4', 'name': 'network-vif-deleted', 'tag': '37d9fbb5-c2f9-411a-ae51-98084b4cbb01', 'status': 'completed', 'code': 200} Dec 10 14:34:12.756794 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5de6ec67-27fa-4e25-a14b-3a7ad89f9811 req-f2ff8869-860a-4959-8235-d0e1f560bed9 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "GET /v2.0/ports?device_id=1b602b30-9f1c-4b7d-a901-4440a48df4f4 HTTP/1.1" status: 200 len: 210 time: 0.0257897 Dec 10 14:34:13.812444 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60336) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:13.868639 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-919e1b7c-0611-4284-84b9-bb1a17530691 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:13.893470 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-919e1b7c-0611-4284-84b9-bb1a17530691 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:14.034538 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-919e1b7c-0611-4284-84b9-bb1a17530691 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370507'] for security_group, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:14.037231 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-919e1b7c-0611-4284-84b9-bb1a17530691 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for security_group, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:14.038418 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-919e1b7c-0611-4284-84b9-bb1a17530691 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/security-groups/c40cfa2a-e16a-4a4e-ba09-a7e9a602332c HTTP/1.1" status: 204 len: 168 time: 0.2249756 Dec 10 14:34:14.048799 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-919e1b7c-0611-4284-84b9-bb1a17530691 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c40cfa2a-e16a-4a4e-ba09-a7e9a602332c,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:14.124748 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60340) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:14.470178 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-551956'] for router_interface, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:14.721259 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port 347bc2eb-e3db-42a3-b785-8d842864077c {{(pid=103810) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:34:14.721638 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:14.811973 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.db [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port 347bc2eb-e3db-42a3-b785-8d842864077c, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=347bc2eb-e3db-42a3-b785-8d842864077c,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103810) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:34:14.812338 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:14.824071 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.plugin [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for 347bc2eb-e3db-42a3-b785-8d842864077c owned by network:router_interface {{(pid=103810) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:34:15.083709 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:15.107818 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=347bc2eb-e3db-42a3-b785-8d842864077c,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:15.283839 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-569415', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-552072'] for router_interface, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:15.496760 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 9e515e57-cb88-4daa-8042-7c6664cc1317 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103810) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:34:15.602891 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:34:15.608168 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ba276d2f-dc42-4ebd-bb79-474d52509d81 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/routers/9e515e57-cb88-4daa-8042-7c6664cc1317/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4823501 Dec 10 14:34:15.610928 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60342) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:15.612456 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] Sync routers for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:34:15.623030 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:34:15.623645 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:34:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:15.661842 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_v2 [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting subnet 4f430ec7-91c3-4707-a417-018d2e296df6 {{(pid=103810) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 10 14:34:15.665640 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:15.704428 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-127408360'] for subnet, precommit_delete_associations {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:15.728383 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:34:15.792556 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1389728'] for subnet, precommit_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:15.869234 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:34:15.908825 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1389739', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-127408583', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127044038'] for subnet, after_delete {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:15.911640 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:34:14Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:15.937794 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Subnet': ['ID=4f430ec7-91c3-4707-a417-018d2e296df6,revision_number=None']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:15.938365 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] Checking router: 9e515e57-cb88-4daa-8042-7c6664cc1317 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:34:15.941183 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:15.944439 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/subnets/4f430ec7-91c3-4707-a417-018d2e296df6 HTTP/1.1" status: 204 len: 168 time: 0.3323767 Dec 10 14:34:15.945258 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fbb568e-2460-4c26-84f6-0146c1ea1b92 None None] Network ff92c14f-f9fb-4f05-9886-7825120a4f21 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:34:15.947989 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60344) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:15.950233 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.950714 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.951046 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.951358 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.951700 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.952039 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.952378 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.952715 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.953048 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.953381 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.953738 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.954076 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.954396 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af5b316-4462-4481-bc32-db9791eaf2a5 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103810) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:15.985446 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] Routers {'9e515e57-cb88-4daa-8042-7c6664cc1317'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:34:15.986077 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:34:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['9e515e57-cb88-4daa-8042-7c6664cc1317'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:16.057874 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.130693 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] Set router 9e515e57-cb88-4daa-8042-7c6664cc1317 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:34:16.172592 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.186892 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5dd7c2c3-bbb3-4a1c-a72a-23cd6b7aef5a None None] DHCP port deletion for ff92c14f-f9fb-4f05-9886-7825120a4f21 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:34:16.296722 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Deleting port d3220285-7992-4fb1-9ccf-a69cee14808d {{(pid=103811) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:34:16.297060 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.318867 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-5dd7c2c3-bbb3-4a1c-a72a-23cd6b7aef5a None None] Deleting port 1af57c2e-8c3e-4123-86ea-7a0896813e59 {{(pid=103812) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 10 14:34:16.319250 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5dd7c2c3-bbb3-4a1c-a72a-23cd6b7aef5a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8745562596720'] for port, before_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.377793 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.db [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] For port d3220285-7992-4fb1-9ccf-a69cee14808d, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=d3220285-7992-4fb1-9ccf-a69cee14808d,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103811) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:34:16.378154 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.390810 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.plugin [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Calling delete_port for d3220285-7992-4fb1-9ccf-a69cee14808d owned by network:router_gateway {{(pid=103811) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:34:16.398500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-5dd7c2c3-bbb3-4a1c-a72a-23cd6b7aef5a None None] For port 1af57c2e-8c3e-4123-86ea-7a0896813e59, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=1af57c2e-8c3e-4123-86ea-7a0896813e59,segment=NetworkSegment(744b984b-20c9-438a-b07b-084c6734dffa),segment_id=744b984b-20c9-438a-b07b-084c6734dffa)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:34:16.398845 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5dd7c2c3-bbb3-4a1c-a72a-23cd6b7aef5a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-450177'] for port, precommit_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.413625 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-5dd7c2c3-bbb3-4a1c-a72a-23cd6b7aef5a None None] Calling delete_port for 1af57c2e-8c3e-4123-86ea-7a0896813e59 owned by network:dhcp {{(pid=103812) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 10 14:34:16.420716 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:34:14Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:16.451077 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2123b087-e0d1-40a7-a924-22237aff2af9 None None] The sync data for ids ['9e515e57-cb88-4daa-8042-7c6664cc1317'] in dv-neutron-821401-2-hyperv is: [{'id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'name': 'tempest-TestNetworkBasicOps-router-313184532', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72'}], 'enable_snat': True}, 'gw_port_id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:34:14Z', 'revision_number': 5, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'd3220285-7992-4fb1-9ccf-a69cee14808d', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:b3:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e515e57-cb88-4daa-8042-7c6664cc1317', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1321, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:32:03Z', 'updated_at': '2021-12-10T14:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:34:16.594291 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5dd7c2c3-bbb3-4a1c-a72a-23cd6b7aef5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641'] for port, after_delete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.617381 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd7c2c3-bbb3-4a1c-a72a-23cd6b7aef5a None None] Pushing event deleted for resources: {'Port': ['ID=1af57c2e-8c3e-4123-86ea-7a0896813e59,revision_number=None']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:16.623067 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8745562688979', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8745562120641', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.625049 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dd7c2c3-bbb3-4a1c-a72a-23cd6b7aef5a None None] No DVR routers for this DVR port 1af57c2e-8c3e-4123-86ea-7a0896813e59 on host dv-neutron-821401-2-hyperv {{(pid=103812) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 10 14:34:16.628307 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 no longer exists at agent hyperv_hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:34:16.650796 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] No Port match for: 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:34:16.651143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Device 37d9fbb5-c2f9-411a-ae51-98084b4cbb01 not bound to the agent host hv-neutron-8214 {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:34:16.651534 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Port': ['ID=d3220285-7992-4fb1-9ccf-a69cee14808d,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:16.667535 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74b64766-9cc4-4edd-8eca-cad981154ccf None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:34:16.713074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-550954'] for router_gateway, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.807033 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-549562', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30331'] for router, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.809350 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.931448 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-549555'] for router, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.931983 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Fanout notify agent at l3_agent the message router_deleted on router 9e515e57-cb88-4daa-8042-7c6664cc1317 {{(pid=103811) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 10 14:34:16.938904 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:16.939994 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-b8cb80fb-d093-4600-94d3-e251ca2637f3 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/routers/9e515e57-cb88-4daa-8042-7c6664cc1317 HTTP/1.1" status: 204 len: 168 time: 0.9897709 Dec 10 14:34:16.942614 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60346) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:17.019910 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1507726'] for network, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.118600 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388087', 'neutron.services.segments.db._delete_segments_for_network-8745562671234'] for network, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.138586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ff92c14f-f9fb-4f05-9886-7825120a4f21']}} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:17.147419 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '744b984b-20c9-438a-b07b-084c6734dffa') {'for_net_delete': True} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:17.147716 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.services.segments.db [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '744b984b-20c9-438a-b07b-084c6734dffa') {} {{(pid=103811) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:17.157603 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8745562675851', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126500361'] for segment, before_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.170559 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.176143 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Releasing vlan 389 on physical network physnet1 to pool {{(pid=103811) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 10 14:34:17.176518 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126567507'] for segment, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: Traceback (most recent call last): Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: timer() Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: cb(*args, **kw) Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: return func(*args, **kwargs) Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: self._notify() Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: self.callback(batched_events) Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: event.method(event) Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: aggregate_uuid = self.p_client.list_aggregates( Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: return f(self, *a, **k) Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._get(url).json() Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: return self.request(url, 'GET', **kwargs) Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: base_url = self.get_endpoint(auth, allow=allow, Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 10 14:34:17.179434 dv-neutron-821401-2-hyperv neutron-server[103811]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 10 14:34:17.622952 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388094', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-550918'] for network, after_delete {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.630351 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for network, before_response {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.633520 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "DELETE /v2.0/networks/ff92c14f-f9fb-4f05-9886-7825120a4f21 HTTP/1.1" status: 204 len: 168 time: 0.6898947 Dec 10 14:34:17.644965 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24be6355-39f5-4f80-9d92-84cd98ab158c tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event deleted for resources: {'Network': ['ID=ff92c14f-f9fb-4f05-9886-7825120a4f21,revision_number=None']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:17.654788 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60348) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:17.659991 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'network': {'name': 'tempest-network-smoke--161046004', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'port_security_enabled': True}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:34:17.770900 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'network': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:34:17.774967 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for network, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.798718 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] vlan segment allocate from pool success with {'vlan_id': 366, 'physical_network': 'physnet1'} {{(pid=103810) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 10 14:34:17.808606 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1391145'] for segment, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.809397 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.db.segments_db [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Added segment 515be0f9-ffe5-43f8-8ece-736787fa838e of type vlan for network eb03c0bf-578d-424e-8e67-1f0686f29562 Dec 10 14:34:17.852807 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8745562136351'] for network, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.942714 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-370491', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470'] for network, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:17.948990 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:17.949611 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for network, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:18.013243 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Network': ['ID=eb03c0bf-578d-424e-8e67-1f0686f29562,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:18.024210 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Network eb03c0bf-578d-424e-8e67-1f0686f29562 details requested by agent ovs-agent-dv-neutron-821401-2-hyperv with host dv-neutron-821401-2-hyperv {{(pid=103812) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 10 14:34:18.073034 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-efaf3922-5526-4e4a-a82c-d045b6e4b324 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.4161494 Dec 10 14:34:18.080681 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60350) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:18.085947 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1999917412', 'admin_state_up': True, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:34:18.104481 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 347bc2eb-e3db-42a3-b785-8d842864077c no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:34:18.124174 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 347bc2eb-e3db-42a3-b785-8d842864077c {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:34:18.124507 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 347bc2eb-e3db-42a3-b785-8d842864077c not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:34:18.124910 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1af57c2e-8c3e-4123-86ea-7a0896813e59 no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:34:18.143419 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: 1af57c2e-8c3e-4123-86ea-7a0896813e59 {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:34:18.143762 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 1af57c2e-8c3e-4123-86ea-7a0896813e59 not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:34:18.144157 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d3220285-7992-4fb1-9ccf-a69cee14808d no longer exists at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 10 14:34:18.162216 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] No Port match for: d3220285-7992-4fb1-9ccf-a69cee14808d {{(pid=103812) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 10 14:34:18.164717 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device d3220285-7992-4fb1-9ccf-a69cee14808d not bound to the agent host dv-neutron-821401-2-hyperv {{(pid=103812) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 10 14:34:18.180945 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-550592', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30313'] for router, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:18.182054 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-549488', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-551553', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-531136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30322'] for router, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:18.235929 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:18.432684 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:18.707055 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:18.725732 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:18.828800 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.db_base_plugin_common [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.26.2.13 (d3f722ee-cbe4-47a4-9a81-587513423c57/0a301be8-98a1-419e-a7a8-56be819ae1b9/bb0a1eae-ea5d-46e9-9106-c3c673011601) {{(pid=103810) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:34:18.925186 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:19.011176 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-127408624'] for port, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:19.052439 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network d3f722ee-cbe4-47a4-9a81-587513423c57 is already hosted by enough agents. {{(pid=103810) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:34:19.057387 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:34:19.059603 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=bb0a1eae-ea5d-46e9-9106-c3c673011601,revision_number=1']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:19.062407 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103810) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:34:19.072729 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6dee3255-213b-47de-ac33-62261626c79b None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:34:19.163175 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-3dc54655-585a-47ee-9bc8-6f3aa29e225c None None] Provisioning complete for port bb0a1eae-ea5d-46e9-9106-c3c673011601 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:19.163565 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3dc54655-585a-47ee-9bc8-6f3aa29e225c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:19.196224 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-3dc54655-585a-47ee-9bc8-6f3aa29e225c None None] Port bb0a1eae-ea5d-46e9-9106-c3c673011601 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:34:19.413910 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router_gateway, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:19.888584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-549449', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-551666'] for router, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:20.122896 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 3584b59b-c40b-4dc7-82d2-5c455f34ed40 is scheduled to L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b with binding_index 1 {{(pid=103810) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 10 14:34:20.224066 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103810) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:34:20.234003 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Sync routers for ids ['3584b59b-c40b-4dc7-82d2-5c455f34ed40'] in dv-neutron-821401-2-hyperv {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:34:20.243630 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Routers {'3584b59b-c40b-4dc7-82d2-5c455f34ed40'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:34:20.244241 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:34:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['3584b59b-c40b-4dc7-82d2-5c455f34ed40'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:20.302547 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for router, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:20.303824 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-0e6d4988-ee10-4ab7-bc6e-86a80e5bdc79 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 2.2214377 Dec 10 14:34:20.307026 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60352) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:20.338284 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-97bc9780-d955-4bc1-9a0f-16ab6cc25185 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?project_id=c0bfba20c10d46e1abb38c3a54bd852b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0301726 Dec 10 14:34:20.340899 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60354) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:20.348171 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Set router 3584b59b-c40b-4dc7-82d2-5c455f34ed40 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:34:20.425235 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9beb282c-cfe7-43b0-9ac6-8116840b6c4d tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:20.426772 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-9beb282c-cfe7-43b0-9ac6-8116840b6c4d tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0848758 Dec 10 14:34:20.429723 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60356) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:20.464895 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-ee875586-bb35-46d8-afdd-b77dab3ebb21 tempest-TestNetworkBasicOps-1765004027 tempest-TestNetworkBasicOps-1765004027-project-admin] 10.222.0.57 "GET /v2.0/subnets?network_id=d3f722ee-cbe4-47a4-9a81-587513423c57&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0341098 Dec 10 14:34:20.467478 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.wsgi [-] (103810) accepted ('10.222.0.57', 60358) {{(pid=103810) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:20.472205 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.v2.base [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-932285863', 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103810) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 10 14:34:20.527844 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'name': 'tempest-TestNetworkBasicOps-router-1999917412', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13'}], 'enable_snat': True}, 'gw_port_id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:19Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:d5:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1412, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:20.553286 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Checking router: 3584b59b-c40b-4dc7-82d2-5c455f34ed40 for host: dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:34:20.553658 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Updating router 3584b59b-c40b-4dc7-82d2-5c455f34ed40 port bb0a1eae-ea5d-46e9-9106-c3c673011601 binding host dv-neutron-821401-2-hyperv {{(pid=103813) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:34:20.581487 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:20.634052 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Made reservation on behalf of c0bfba20c10d46e1abb38c3a54bd852b for: {'subnet': 1} {{(pid=103810) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 10 14:34:20.637905 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127044001'] for subnet, before_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:20.833686 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Publish callbacks [] for port, precommit_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:20.957059 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:20.957584 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-375687', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-127408128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127044031'] for subnet, after_create {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.003538 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Pushing event updated for resources: {'Port': ['ID=bb0a1eae-ea5d-46e9-9106-c3c673011601,revision_number=2']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:21.006467 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8c607cb-3ab3-498e-8af3-5c93fc916f94 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:34:21.017175 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.017742 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.017949 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.018258 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.018688 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.018909 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.019242 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.019966 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.019966 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.020369 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.020470 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Subnet': ['ID=3fae7dbf-a172-4e94-9346-9da86726d37d,revision_number=0']} {{(pid=103810) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:21.020565 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.020851 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.021329 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103813) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:21.027466 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Attempting to bind port bb0a1eae-ea5d-46e9-9106-c3c673011601 on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:34:21.027956 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Attempting to bind port bb0a1eae-ea5d-46e9-9106-c3c673011601 by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:34:21.028644 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Attempting to bind port bb0a1eae-ea5d-46e9-9106-c3c673011601 on network d3f722ee-cbe4-47a4-9a81-587513423c57 {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:34:21.031194 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Checking segment: {'id': '515be0f9-ffe5-43f8-8ece-736787fa838e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103810) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:34:21.031928 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network hostable DHCP agents. Network: eb03c0bf-578d-424e-8e67-1f0686f29562, hostable agents: ['49f757ec-c878-47c2-8703-2255ce9b2f6c'], hosted agents: [] {{(pid=103810) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 10 14:34:21.034817 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 34, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:34:21.035197 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Checking segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103813) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:34:21.035596 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.035985 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Bound using segment: {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'} {{(pid=103813) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:34:21.036593 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.managers [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Bound port: bb0a1eae-ea5d-46e9-9106-c3c673011601, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6785f633-8195-41aa-a37a-3ccc06131823', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57'}}] {{(pid=103813) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:34:21.036828 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.092206 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] For port bb0a1eae-ea5d-46e9-9106-c3c673011601, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103813) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:34:21.095493 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.plugins.ml2.db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] For port bb0a1eae-ea5d-46e9-9106-c3c673011601, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=bb0a1eae-ea5d-46e9-9106-c3c673011601,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103813) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:34:21.113874 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network eb03c0bf-578d-424e-8e67-1f0686f29562 is scheduled to be hosted by DHCP agent 49f757ec-c878-47c2-8703-2255ce9b2f6c with binding_index 1 {{(pid=103810) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 10 14:34:21.126663 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-75c80cd0-704b-4f2c-8a88-e3ed3880faa9 None None] Provisioning complete for port bb0a1eae-ea5d-46e9-9106-c3c673011601 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:21.127041 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-75c80cd0-704b-4f2c-8a88-e3ed3880faa9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.159854 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-75c80cd0-704b-4f2c-8a88-e3ed3880faa9 None None] Port bb0a1eae-ea5d-46e9-9106-c3c673011601 cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:34:21.171797 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron_lib.callbacks.manager [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103813) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.216183 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bef87db-60c4-4fcf-8ce9-90f154d71610 None None] DHCP port deletion for d3f722ee-cbe4-47a4-9a81-587513423c57 request from dv-neutron-821401-2-hyperv {{(pid=103812) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 10 14:34:21.223498 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Routers {'3584b59b-c40b-4dc7-82d2-5c455f34ed40'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103813) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:34:21.224083 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:34:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['3584b59b-c40b-4dc7-82d2-5c455f34ed40'], 'active': True} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:21.231937 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.scheduler.base_scheduler [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-821401-2-hyperv, eb03c0bf-578d-424e-8e67-1f0686f29562) {{(pid=103810) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:34:21.236537 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103810) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:21.237188 dv-neutron-821401-2-hyperv neutron-server[103810]: DEBUG neutron_lib.callbacks.manager [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for subnet, before_response {{(pid=103810) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.240164 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-808d79c5-36aa-47d9-a1bf-e86360cb68de None None] Network eb03c0bf-578d-424e-8e67-1f0686f29562 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:34:21.272966 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc07208-e8bb-4908-b3bc-76032bb2c595 None None] Pushing event updated for resources: {'Port': ['ID=bb0a1eae-ea5d-46e9-9106-c3c673011601,revision_number=3']} {{(pid=103813) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:21.313817 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-df1142e6-eaca-405b-939d-8fe99be0ca1e None None] Provisioning complete for port bb0a1eae-ea5d-46e9-9106-c3c673011601 triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:21.314332 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-df1142e6-eaca-405b-939d-8fe99be0ca1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.319124 dv-neutron-821401-2-hyperv neutron-server[103810]: INFO neutron.wsgi [None req-85ac65e5-f65e-4f7d-bb34-5be6e2d614b0 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.8506384 Dec 10 14:34:21.324827 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [-] (103811) accepted ('10.222.0.57', 60360) {{(pid=103811) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 10 14:34:21.354038 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_dvr_db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] Set router 3584b59b-c40b-4dc7-82d2-5c455f34ed40 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103813) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:34:21.389402 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8442ecee-7332-57d8-be83-1cbdc0d633d3-eb03c0bf-578d-424e-8e67-1f0686f29562', 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562', 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'fixed_ips': [{'subnet_id': '3fae7dbf-a172-4e94-9346-9da86726d37d'}]}} from dv-neutron-821401-2-hyperv. {{(pid=103812) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 10 14:34:21.390276 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.546767 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.l3_hamode_db [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'name': 'tempest-TestNetworkBasicOps-router-1999917412', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13'}], 'enable_snat': True}, 'gw_port_id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:19Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:d5:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1412, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103813) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:21.578410 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff8630c-9a37-49da-914a-8b0cf6673a22 None None] The sync data for ids ['3584b59b-c40b-4dc7-82d2-5c455f34ed40'] in dv-neutron-821401-2-hyperv is: [{'id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'name': 'tempest-TestNetworkBasicOps-router-1999917412', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13'}], 'enable_snat': True}, 'gw_port_id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:19Z', 'revision_number': 3, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:d5:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1412, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv'}] {{(pid=103813) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:34:21.647023 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-df1142e6-eaca-405b-939d-8fe99be0ca1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.684480 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-df1142e6-eaca-405b-939d-8fe99be0ca1e None None] For port bb0a1eae-ea5d-46e9-9106-c3c673011601, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=bb0a1eae-ea5d-46e9-9106-c3c673011601,segment=NetworkSegment(6785f633-8195-41aa-a37a-3ccc06131823),segment_id=6785f633-8195-41aa-a37a-3ccc06131823)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:34:21.734564 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.db_base_plugin_common [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Allocated IP 172.20.0.2 (eb03c0bf-578d-424e-8e67-1f0686f29562/3fae7dbf-a172-4e94-9346-9da86726d37d/0fdd3154-d882-488c-84a7-54efc9a7326a) {{(pid=103812) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:34:21.760588 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-df1142e6-eaca-405b-939d-8fe99be0ca1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.781300 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:21.868667 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1142e6-eaca-405b-939d-8fe99be0ca1e None None] Pushing event updated for resources: {'Port': ['ID=bb0a1eae-ea5d-46e9-9106-c3c673011601,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:21.952477 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Publish callbacks [] for port, precommit_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:22.049143 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632'] for port, after_create {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:22.098994 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Network eb03c0bf-578d-424e-8e67-1f0686f29562 is already hosted by enough agents. {{(pid=103812) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:34:22.106246 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.scheduler.base_scheduler [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Resources bound (agent type, host, resource id): {{(pid=103812) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:34:22.110459 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Received port after_create {{(pid=103812) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:34:22.127620 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.db_base_plugin_common [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Allocated IP 172.20.0.1 (eb03c0bf-578d-424e-8e67-1f0686f29562/3fae7dbf-a172-4e94-9346-9da86726d37d/2056bb23-aacb-4bf1-8046-dc619bb4e3ba) {{(pid=103811) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 10 14:34:22.128179 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Pushing event updated for resources: {'Port': ['ID=0fdd3154-d882-488c-84a7-54efc9a7326a,revision_number=1']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:22.178252 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device bb0a1eae-ea5d-46e9-9106-c3c673011601 up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:34:22.194909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Attempting to bind port 0fdd3154-d882-488c-84a7-54efc9a7326a on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:34:22.195290 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Attempting to bind port 0fdd3154-d882-488c-84a7-54efc9a7326a by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '515be0f9-ffe5-43f8-8ece-736787fa838e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:34:22.195657 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Attempting to bind port 0fdd3154-d882-488c-84a7-54efc9a7326a on network eb03c0bf-578d-424e-8e67-1f0686f29562 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:34:22.223160 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 34, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:34:22.223585 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Checking segment: {'id': '515be0f9-ffe5-43f8-8ece-736787fa838e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:34:22.223955 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:22.224355 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Bound using segment: {'id': '515be0f9-ffe5-43f8-8ece-736787fa838e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:34:22.224839 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Bound port: 0fdd3154-d882-488c-84a7-54efc9a7326a, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '515be0f9-ffe5-43f8-8ece-736787fa838e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:34:22.225219 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:22.274194 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:22.302466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port bb0a1eae-ea5d-46e9-9106-c3c673011601 triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:22.302837 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:22.331276 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] For port 0fdd3154-d882-488c-84a7-54efc9a7326a, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:34:22.359345 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] For port 0fdd3154-d882-488c-84a7-54efc9a7326a, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0fdd3154-d882-488c-84a7-54efc9a7326a,segment=NetworkSegment(515be0f9-ffe5-43f8-8ece-736787fa838e),segment_id=515be0f9-ffe5-43f8-8ece-736787fa838e)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:34:22.394882 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8745562120632', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126567438'] for port, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:22.442021 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network eb03c0bf-578d-424e-8e67-1f0686f29562 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:34:22.445340 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:34:22.449353 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:22.449549 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Received port after_create {{(pid=103811) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 10 14:34:22.456101 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=2056bb23-aacb-4bf1-8046-dc619bb4e3ba,revision_number=1']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:22.497018 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.497553 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.497933 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.498279 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.498619 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.499076 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.499424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.499759 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.500092 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.500424 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.500768 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.501158 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.501586 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-821401-2-hyperv {{(pid=103811) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 10 14:34:22.510672 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9df52f2b-1efc-4c4c-b180-fd1a32e17d71 None None] Pushing event updated for resources: {'Port': ['ID=0fdd3154-d882-488c-84a7-54efc9a7326a,revision_number=2']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:22.518103 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-551041'] for router_interface, before_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:22.780384 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:23.063400 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks [] for port, precommit_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:23.119448 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126567543'] for port, after_update {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:23.196002 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron_lib.callbacks.manager [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-569420', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-551985'] for router_interface, after_create {{(pid=103811) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:23.197972 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Pushing event updated for resources: {'Port': ['ID=2056bb23-aacb-4bf1-8046-dc619bb4e3ba,revision_number=2']} {{(pid=103811) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:23.296616 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Network eb03c0bf-578d-424e-8e67-1f0686f29562 is already hosted by enough agents. {{(pid=103811) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 10 14:34:23.298044 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.base_scheduler [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Resources bound (agent type, host, resource id): {{(pid=103811) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 10 14:34:23.413866 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Router 3584b59b-c40b-4dc7-82d2-5c455f34ed40 has already been hosted by L3 agent 681c99ea-10aa-43e5-b85e-17cd486d1b8b {{(pid=103811) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 10 14:34:23.521100 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] Notify agent at l3_agent.dv-neutron-821401-2-hyperv the message routers_updated {{(pid=103811) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 10 14:34:23.533177 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [None req-9c4443db-7bdf-4300-a9c3-e64dc608f395 tempest-TestNetworkBasicOps-1274146187 tempest-TestNetworkBasicOps-1274146187-project] 10.222.0.57 "PUT /v2.0/routers/3584b59b-c40b-4dc7-82d2-5c455f34ed40/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2019994 Dec 10 14:34:23.533299 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Sync routers for ids ['3584b59b-c40b-4dc7-82d2-5c455f34ed40'] in dv-neutron-821401-2-hyperv {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 10 14:34:23.541183 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Routers {'3584b59b-c40b-4dc7-82d2-5c455f34ed40'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:34:23.541833 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:34:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['3584b59b-c40b-4dc7-82d2-5c455f34ed40'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:23.650658 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Set router 3584b59b-c40b-4dc7-82d2-5c455f34ed40 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:34:23.852264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'name': 'tempest-TestNetworkBasicOps-router-1999917412', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13'}], 'enable_snat': True}, 'gw_port_id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:22Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:d5:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1412, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '2056bb23-aacb-4bf1-8046-dc619bb4e3ba', 'name': '', 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:93:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'device_owner': 'network:router_interface', 'standard_attr_id': 1415, 'fixed_ips': [{'subnet_id': '3fae7dbf-a172-4e94-9346-9da86726d37d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:34:21Z', 'updated_at': '2021-12-10T14:34:22Z', 'revision_number': 2, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '3fae7dbf-a172-4e94-9346-9da86726d37d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:23.879515 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Checking router: 3584b59b-c40b-4dc7-82d2-5c455f34ed40 for host: dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 10 14:34:23.879909 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Updating router 3584b59b-c40b-4dc7-82d2-5c455f34ed40 port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba binding host dv-neutron-821401-2-hyperv {{(pid=103812) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 10 14:34:23.907671 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.002264 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9941f4c7-d86c-4ee2-9c2b-5e33c5c25684 None None] Network eb03c0bf-578d-424e-8e67-1f0686f29562 requested from dv-neutron-821401-2-hyperv {{(pid=103812) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 10 14:34:24.133323 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0fdd3154-d882-488c-84a7-54efc9a7326a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:34:24.198293 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-40f6d805-3841-4057-969f-6cc68c9a6ae5 None None] Provisioning complete for port 0fdd3154-d882-488c-84a7-54efc9a7326a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:24.198666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40f6d805-3841-4057-969f-6cc68c9a6ae5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.302021 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0fdd3154-d882-488c-84a7-54efc9a7326a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:24.302320 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.413768 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40f6d805-3841-4057-969f-6cc68c9a6ae5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.428552 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Publish callbacks [] for port, precommit_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.481542 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-40f6d805-3841-4057-969f-6cc68c9a6ae5 None None] For port 0fdd3154-d882-488c-84a7-54efc9a7326a, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=0fdd3154-d882-488c-84a7-54efc9a7326a,segment=NetworkSegment(515be0f9-ffe5-43f8-8ece-736787fa838e),segment_id=515be0f9-ffe5-43f8-8ece-736787fa838e)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:34:24.489655 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.504695 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.546047 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-40f6d805-3841-4057-969f-6cc68c9a6ae5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.590787 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71929d3f-5b5a-4317-97a7-3b637aedd1ba None None] Pushing event updated for resources: {'Port': ['ID=2056bb23-aacb-4bf1-8046-dc619bb4e3ba,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:24.640040 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103812) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 10 14:34:24.640418 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG oslo_db.api [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 10 14:34:24.698572 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Attempting to bind port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba on host dv-neutron-821401-2-hyperv for vnic_type normal with profile {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 10 14:34:24.698947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Attempting to bind port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba by drivers openvswitch,hyperv on host dv-neutron-821401-2-hyperv at level 0 using segments [{'id': '515be0f9-ffe5-43f8-8ece-736787fa838e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562'}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 10 14:34:24.699314 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Attempting to bind port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba on network eb03c0bf-578d-424e-8e67-1f0686f29562 {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 10 14:34:24.704851 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40f6d805-3841-4057-969f-6cc68c9a6ae5 None None] Pushing event updated for resources: {'Port': ['ID=0fdd3154-d882-488c-84a7-54efc9a7326a,revision_number=3']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:24.710941 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Checking agent: {'id': '0138e112-9f17-40b7-a971-6ad305c3dea5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-821401-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 10, 14, 16, 39), 'started_at': datetime.datetime(2021, 12, 10, 14, 17, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 10, 14, 34, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-821401-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 10 14:34:24.711325 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Checking segment: {'id': '515be0f9-ffe5-43f8-8ece-736787fa838e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103812) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 10 14:34:24.711745 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.712141 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Bound using segment: {'id': '515be0f9-ffe5-43f8-8ece-736787fa838e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562'} {{(pid=103812) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 10 14:34:24.712622 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.managers [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Bound port: 2056bb23-aacb-4bf1-8046-dc619bb4e3ba, host: dv-neutron-821401-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '515be0f9-ffe5-43f8-8ece-736787fa838e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562'}}] {{(pid=103812) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 10 14:34:24.713010 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.715432 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-189a702d-22b0-4096-9df5-4939c09ab786 None None] Provisioning complete for port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:24.715795 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-189a702d-22b0-4096-9df5-4939c09ab786 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.781012 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.plugin [None req-189a702d-22b0-4096-9df5-4939c09ab786 None None] Port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba cannot update to ACTIVE because it is not bound. {{(pid=103812) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 10 14:34:24.812947 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-189a702d-22b0-4096-9df5-4939c09ab786 None None] Provisioning complete for port 0fdd3154-d882-488c-84a7-54efc9a7326a triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:24.813327 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-189a702d-22b0-4096-9df5-4939c09ab786 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:24.817207 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] For port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba, host dv-neutron-821401-2-hyperv, cleared binding levels {{(pid=103812) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 10 14:34:24.854230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] For port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba, host dv-neutron-821401-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=2056bb23-aacb-4bf1-8046-dc619bb4e3ba,segment=NetworkSegment(515be0f9-ffe5-43f8-8ece-736787fa838e),segment_id=515be0f9-ffe5-43f8-8ece-736787fa838e)] {{(pid=103812) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 10 14:34:25.046161 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:25.116102 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Routers {'3584b59b-c40b-4dc7-82d2-5c455f34ed40'} bound to L3 agent in host dv-neutron-821401-2-hyperv {{(pid=103812) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 10 14:34:25.116864 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-821401-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-10T14:16:35Z,description=,heartbeat_timestamp=2021-12-10T14:34:05Z,host='dv-neutron-821401-2-hyperv',id=681c99ea-10aa-43e5-b85e-17cd486d1b8b,load=0,resource_versions=,resources_synced=,started_at=2021-12-10T14:16:36Z,topic='l3_agent')) {'router_ids': ['3584b59b-c40b-4dc7-82d2-5c455f34ed40'], 'active': True} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:25.162019 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71929d3f-5b5a-4317-97a7-3b637aedd1ba None None] Pushing event updated for resources: {'Port': ['ID=2056bb23-aacb-4bf1-8046-dc619bb4e3ba,revision_number=4']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:25.268003 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-32784724-1ac5-4ae5-8a99-fd2f1c417cdf None None] Provisioning complete for port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:25.268377 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-32784724-1ac5-4ae5-8a99-fd2f1c417cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:25.270897 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_dvr_db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] Set router 3584b59b-c40b-4dc7-82d2-5c455f34ed40 gateway port host: dv-neutron-821401-2-hyperv {{(pid=103812) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 10 14:34:25.462532 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-32784724-1ac5-4ae5-8a99-fd2f1c417cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1526911'] for port, before_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:25.528656 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.db [None req-32784724-1ac5-4ae5-8a99-fd2f1c417cdf None None] For port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba, host dv-neutron-821401-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-821401-2-hyperv',level=0,port_id=2056bb23-aacb-4bf1-8046-dc619bb4e3ba,segment=NetworkSegment(515be0f9-ffe5-43f8-8ece-736787fa838e),segment_id=515be0f9-ffe5-43f8-8ece-736787fa838e)] {{(pid=103812) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 10 14:34:25.551060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.l3_hamode_db [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'name': 'tempest-TestNetworkBasicOps-router-1999917412', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13'}], 'enable_snat': True}, 'gw_port_id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:22Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:d5:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1412, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '2056bb23-aacb-4bf1-8046-dc619bb4e3ba', 'name': '', 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:93:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'device_owner': 'network:router_interface', 'standard_attr_id': 1415, 'fixed_ips': [{'subnet_id': '3fae7dbf-a172-4e94-9346-9da86726d37d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:34:21Z', 'updated_at': '2021-12-10T14:34:24Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '3fae7dbf-a172-4e94-9346-9da86726d37d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-821401-2-hyperv', False) {} {{(pid=103812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 10 14:34:25.576906 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63773d9c-d117-4a7d-9522-924f2d69315d None None] The sync data for ids ['3584b59b-c40b-4dc7-82d2-5c455f34ed40'] in dv-neutron-821401-2-hyperv is: [{'id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'name': 'tempest-TestNetworkBasicOps-router-1999917412', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'external_fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13'}], 'enable_snat': True}, 'gw_port_id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:22Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'gw_port': {'id': 'bb0a1eae-ea5d-46e9-9106-c3c673011601', 'name': '', 'network_id': 'd3f722ee-cbe4-47a4-9a81-587513423c57', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:d5:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1412, 'fixed_ips': [{'subnet_id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'ip_address': '172.26.2.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:34:18Z', 'updated_at': '2021-12-10T14:34:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0a301be8-98a1-419e-a7a8-56be819ae1b9', 'cidr': '172.26.2.0/24', 'gateway_ip': '172.26.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-821401-2-hyperv', '_interfaces': [{'id': '2056bb23-aacb-4bf1-8046-dc619bb4e3ba', 'name': '', 'network_id': 'eb03c0bf-578d-424e-8e67-1f0686f29562', 'tenant_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'mac_address': 'fa:16:3e:4d:93:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3584b59b-c40b-4dc7-82d2-5c455f34ed40', 'device_owner': 'network:router_interface', 'standard_attr_id': 1415, 'fixed_ips': [{'subnet_id': '3fae7dbf-a172-4e94-9346-9da86726d37d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-821401-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-10T14:34:21Z', 'updated_at': '2021-12-10T14:34:24Z', 'revision_number': 4, 'project_id': 'c0bfba20c10d46e1abb38c3a54bd852b', 'subnets': [{'id': '3fae7dbf-a172-4e94-9346-9da86726d37d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103812) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 10 14:34:25.591797 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-32784724-1ac5-4ae5-8a99-fd2f1c417cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1527456', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-43405', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-569470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8745562688997', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8745562120650', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8745562120668'] for port, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:25.655664 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32784724-1ac5-4ae5-8a99-fd2f1c417cdf None None] Pushing event updated for resources: {'Port': ['ID=2056bb23-aacb-4bf1-8046-dc619bb4e3ba,revision_number=5']} {{(pid=103812) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 10 14:34:25.711630 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-7cbdb492-4dd9-43ff-9d29-c20d2ab2e312 None None] Provisioning complete for port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba triggered by entity DHCP. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:25.712016 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-7cbdb492-4dd9-43ff-9d29-c20d2ab2e312 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:26.192640 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 0fdd3154-d882-488c-84a7-54efc9a7326a up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:34:26.242772 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 0fdd3154-d882-488c-84a7-54efc9a7326a triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:26.243146 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:26.334828 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.plugins.ml2.rpc [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Device 2056bb23-aacb-4bf1-8046-dc619bb4e3ba up at agent ovs-agent-dv-neutron-821401-2-hyperv {{(pid=103812) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 10 14:34:26.394743 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron.db.provisioning_blocks [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Provisioning complete for port 2056bb23-aacb-4bf1-8046-dc619bb4e3ba triggered by entity L2. {{(pid=103812) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 10 14:34:26.395122 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1386382'] for port, provisioning_complete {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:31.111479 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:32.879637 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3bfd39ed-d9b0-457b-9228-ffa59f16a0b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:35.156821 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-78b9533e-4781-4e4d-ad34-3c06b9fa2f84 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:36.216830 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:37.573627 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:38.865149 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:34:42.065405 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-a26d9c85-bb07-4474-b640-0264d8f3ba76 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1348503 Dec 10 14:34:42.151074 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-e55a9ba9-ba67-4b82-ab44-6581a414b60c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:42.152529 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-e55a9ba9-ba67-4b82-ab44-6581a414b60c service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1098 time: 0.0418987 Dec 10 14:34:42.254914 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-ca0f07f3-a249-49cd-9311-32b1ae2d6c9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:42.256265 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-ca0f07f3-a249-49cd-9311-32b1ae2d6c9c service neutron] 10.222.0.39 "GET /v2.0/networks?id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f HTTP/1.1" status: 200 len: 913 time: 0.0846062 Dec 10 14:34:42.320172 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-d0af8f3c-bbf2-4af5-b5f1-6963da206ec9 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1 HTTP/1.1" status: 200 len: 1001 time: 0.0569296 Dec 10 14:34:42.368575 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-b9c3242d-fb83-4a8c-9325-8bddea69fb4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:42.370044 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-b9c3242d-fb83-4a8c-9325-8bddea69fb4f service neutron] 10.222.0.39 "GET /v2.0/subnets?id=d34297eb-b45e-40a3-93a5-fff721097da7 HTTP/1.1" status: 200 len: 851 time: 0.0431907 Dec 10 14:34:42.424354 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-cfe6a28e-25f4-4438-9140-67615b6e406a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:34:42.426648 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-cfe6a28e-25f4-4438-9140-67615b6e406a service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0479531 Dec 10 14:34:42.438124 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-db785e40-75ea-4512-8efd-8d04adce3a46 service neutron] http://10.222.0.57:9696/v2.0/extensions returned with HTTP 200 {{(pid=103811) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 10 14:34:42.439097 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-db785e40-75ea-4512-8efd-8d04adce3a46 service neutron] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049109 Dec 10 14:34:42.526804 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-2c491545-c2d5-4c24-97a8-12e0c787976d service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806940 Dec 10 14:34:42.618466 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-b90ac0c8-127d-466f-b370-3765589a0f4b req-f4afa2a0-484e-48f1-b963-b3c0dbf16452 service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839038 Dec 10 14:34:52.868145 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:35:01.081279 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:02.861708 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-a7c4fab2-ba5e-4a18-aa52-6b74514e32c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:05.132709 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-10eaacc8-1a3e-404c-817d-b346616a746b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:06.224067 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:07.636251 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:08.784182 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:29.866784 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:35:31.083823 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:32.862935 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-1db28d6b-f820-42ec-8462-887ab82c730d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:35.147061 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-04222a08-8805-4a82-843e-01c333a5c615 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:36.223351 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:37.577213 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:38.782813 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:35:42.873900 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-33d489f5-a958-4cea-9caa-6900cece83b2 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0410340 Dec 10 14:35:42.953471 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-302f30ee-7f87-4925-9cc2-586438b08e0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:35:42.954907 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-302f30ee-7f87-4925-9cc2-586438b08e0a service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1098 time: 0.0404732 Dec 10 14:35:43.058436 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-8f3ead8b-d93e-42ac-8cd8-c083bae346e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:35:43.059931 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-8f3ead8b-d93e-42ac-8cd8-c083bae346e8 service neutron] 10.222.0.39 "GET /v2.0/networks?id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f HTTP/1.1" status: 200 len: 913 time: 0.0877306 Dec 10 14:35:43.124185 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-1c56b06d-7146-4cae-a467-5d2c767acd4e service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1 HTTP/1.1" status: 200 len: 1001 time: 0.0570161 Dec 10 14:35:43.171998 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-c6ee725b-cd0d-4dbf-810c-212244a37ee9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:35:43.173457 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-c6ee725b-cd0d-4dbf-810c-212244a37ee9 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=d34297eb-b45e-40a3-93a5-fff721097da7 HTTP/1.1" status: 200 len: 851 time: 0.0422692 Dec 10 14:35:43.222621 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-51360e3c-ce73-4b77-aed9-071cc0369710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:35:43.224074 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-51360e3c-ce73-4b77-aed9-071cc0369710 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0430484 Dec 10 14:35:43.310606 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-ccce0513-a51f-4890-a036-109131cabedb service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0790668 Dec 10 14:35:43.404863 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-48ea59f4-2cbf-4920-9965-afcb25c6628f req-5f1132f5-b2e6-4ffb-bf19-5cb5f26f8170 service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876362 Dec 10 14:36:01.107796 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:02.901867 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5b818895-32b5-456f-bba1-975294676e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:05.136273 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-4f68ba4d-a428-4f2d-b591-75023be419aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:06.248943 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:06.865681 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:36:07.581914 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:08.787187 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:31.146500 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:32.889820 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-5e06827b-906e-4dca-b90d-9ecf909b0ff4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:35.135355 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-91baf607-8a6d-4eca-9b47-1d42c677e8ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:36.232145 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:37.630767 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:38.826466 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:36:43.292772 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-4e97f440-cf55-498b-a700-d14bb775d94a service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0399241 Dec 10 14:36:43.382030 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-82ae06d5-28db-44f3-8674-af34eceb4b52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:36:43.383588 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-82ae06d5-28db-44f3-8674-af34eceb4b52 service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1098 time: 0.0406671 Dec 10 14:36:43.487761 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-8629ea93-8976-4f0a-ac07-2cf5b3f79ac9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:36:43.489349 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-8629ea93-8976-4f0a-ac07-2cf5b3f79ac9 service neutron] 10.222.0.39 "GET /v2.0/networks?id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f HTTP/1.1" status: 200 len: 913 time: 0.0875072 Dec 10 14:36:43.555088 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-1d5ca424-b58f-4480-8454-6f8c06b892f8 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1 HTTP/1.1" status: 200 len: 1001 time: 0.0582249 Dec 10 14:36:43.602783 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-09a15efb-47b2-4ee7-9c77-a696a7a1fd95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:36:43.604185 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-09a15efb-47b2-4ee7-9c77-a696a7a1fd95 service neutron] 10.222.0.39 "GET /v2.0/subnets?id=d34297eb-b45e-40a3-93a5-fff721097da7 HTTP/1.1" status: 200 len: 851 time: 0.0425730 Dec 10 14:36:43.651781 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-56ac6b96-8a22-49f6-ba90-83a0f4d64fcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:36:43.653224 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-56ac6b96-8a22-49f6-ba90-83a0f4d64fcf service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0422604 Dec 10 14:36:43.739426 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-f95dc51f-5bc0-4f9f-b951-987ef462f88c service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789888 Dec 10 14:36:43.829117 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-5525facf-7781-470a-95cb-a92c27b0ff4e req-e7a928ac-67b4-4a08-9486-755df1c5bbfa service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825949 Dec 10 14:36:43.863943 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:37:01.116856 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:02.865230 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ad8fd749-dac1-4028-bf0f-01e094a38905 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:05.162379 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d2ee552-a18c-4bec-9a84-be56bac1504a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:06.225205 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:07.620060 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:08.785119 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:20.863831 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:37:31.173072 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:32.875484 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-ef176b4c-c95c-48a2-ae75-0b6c0a2d5297 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:35.149975 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-d6e677f0-62c6-44ca-8c3e-0765ef93d63e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:36.236178 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:37.567174 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:38.784512 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:37:44.167159 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-39d99260-12ba-4dba-9284-5f5084fad27e req-c25bea7d-728e-4739-a1ef-ddc30b53a859 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0411170 Dec 10 14:37:44.248853 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39d99260-12ba-4dba-9284-5f5084fad27e req-17d3f183-8d83-4e69-b1cb-f78ecac5364f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:37:44.250324 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-39d99260-12ba-4dba-9284-5f5084fad27e req-17d3f183-8d83-4e69-b1cb-f78ecac5364f service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1098 time: 0.0398111 Dec 10 14:37:44.355750 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39d99260-12ba-4dba-9284-5f5084fad27e req-22a25fc2-06cd-4bf6-87dd-59eb2d907932 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:37:44.357205 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-39d99260-12ba-4dba-9284-5f5084fad27e req-22a25fc2-06cd-4bf6-87dd-59eb2d907932 service neutron] 10.222.0.39 "GET /v2.0/networks?id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f HTTP/1.1" status: 200 len: 913 time: 0.0877995 Dec 10 14:37:44.429948 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-39d99260-12ba-4dba-9284-5f5084fad27e req-0765c878-8c7e-4453-90ed-11b8e0826089 service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1 HTTP/1.1" status: 200 len: 1001 time: 0.0575182 Dec 10 14:37:44.470862 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39d99260-12ba-4dba-9284-5f5084fad27e req-3917c8b0-e2a8-49a3-aeb0-411f87d8184e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:37:44.472232 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-39d99260-12ba-4dba-9284-5f5084fad27e req-3917c8b0-e2a8-49a3-aeb0-411f87d8184e service neutron] 10.222.0.39 "GET /v2.0/subnets?id=d34297eb-b45e-40a3-93a5-fff721097da7 HTTP/1.1" status: 200 len: 851 time: 0.0420408 Dec 10 14:37:44.521574 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39d99260-12ba-4dba-9284-5f5084fad27e req-b0411c53-3bc8-492c-bb86-9b0b915a51a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:37:44.523045 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-39d99260-12ba-4dba-9284-5f5084fad27e req-b0411c53-3bc8-492c-bb86-9b0b915a51a9 service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0432577 Dec 10 14:37:44.608866 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-39d99260-12ba-4dba-9284-5f5084fad27e req-2faa247e-2d59-43c7-a05c-d00a942ee57c service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0784216 Dec 10 14:37:44.701619 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-39d99260-12ba-4dba-9284-5f5084fad27e req-536d1741-f7ba-455a-8317-b4be9347dbf5 service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859087 Dec 10 14:37:57.862975 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:38:01.115566 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:02.858490 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-284b847b-05fd-4ff3-8a35-a1cb1d60330b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:05.131593 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-89cd6b52-5942-48b8-9ed3-512194563284 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:06.218577 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:07.629698 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:08.789262 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:31.147766 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-3e733a79-e34c-40cd-a005-9cdc96c865e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:32.874666 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-fa65f72b-10d6-4341-809a-abee5225e144 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:34.861957 dv-neutron-821401-2-hyperv neutron-server[103813]: DEBUG neutron.db.agents_db [None req-3515a48f-6a3f-4dbe-a241-2465079ad0d8 None None] Agent healthcheck: found 6 active agents {{(pid=103813) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 10 14:38:35.137455 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-47e2d4be-a6cd-4dc2-9c2e-555405bd2e54 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:36.257893 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-9d51c640-01f6-4da3-acba-363c7b4cc9e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:37.613058 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-61086bcb-1a41-4255-994c-78307a434e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:38.787877 dv-neutron-821401-2-hyperv neutron-server[103812]: DEBUG neutron_lib.callbacks.manager [None req-b05b0675-c3b7-4ffb-a1b8-ece9ecc01bae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8745562671189', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1386465'] for agent, after_update {{(pid=103812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 10 14:38:44.841084 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d48383ff-5128-4264-8ad5-29e294adc785 req-7ddcdaf4-d872-4273-b2d5-b3f4d00168b1 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=639cb4fb-fcb2-41bb-8528-734e490b8575&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0415559 Dec 10 14:38:44.920482 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48383ff-5128-4264-8ad5-29e294adc785 req-4dbd129e-ba48-4407-8f01-3228d579ac0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:38:44.922088 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d48383ff-5128-4264-8ad5-29e294adc785 req-4dbd129e-ba48-4407-8f01-3228d579ac0b service neutron] 10.222.0.39 "GET /v2.0/ports?tenant_id=a1d5a7f281834a22aee867878a76c226&device_id=639cb4fb-fcb2-41bb-8528-734e490b8575 HTTP/1.1" status: 200 len: 1098 time: 0.0396655 Dec 10 14:38:45.364213 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48383ff-5128-4264-8ad5-29e294adc785 req-9b15698d-e5f9-4941-a23f-7c2f0849b190 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:38:45.365724 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d48383ff-5128-4264-8ad5-29e294adc785 req-9b15698d-e5f9-4941-a23f-7c2f0849b190 service neutron] 10.222.0.39 "GET /v2.0/networks?id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f HTTP/1.1" status: 200 len: 913 time: 0.4245079 Dec 10 14:38:45.430765 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d48383ff-5128-4264-8ad5-29e294adc785 req-1b290127-1d6f-4a16-966a-50586102269b service neutron] 10.222.0.39 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=aaad23d0-018e-4bc3-96f5-29b61ee40dc1 HTTP/1.1" status: 200 len: 1001 time: 0.0577350 Dec 10 14:38:45.479184 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48383ff-5128-4264-8ad5-29e294adc785 req-baec2ef8-64e2-4ded-9f06-32b233fc55ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:38:45.480755 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d48383ff-5128-4264-8ad5-29e294adc785 req-baec2ef8-64e2-4ded-9f06-32b233fc55ef service neutron] 10.222.0.39 "GET /v2.0/subnets?id=d34297eb-b45e-40a3-93a5-fff721097da7 HTTP/1.1" status: 200 len: 851 time: 0.0429289 Dec 10 14:38:45.529247 dv-neutron-821401-2-hyperv neutron-server[103811]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48383ff-5128-4264-8ad5-29e294adc785 req-c6439c8f-9e02-4b70-8f74-3610c0ddb5fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103811) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 10 14:38:45.530795 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d48383ff-5128-4264-8ad5-29e294adc785 req-c6439c8f-9e02-4b70-8f74-3610c0ddb5fb service neutron] 10.222.0.39 "GET /v2.0/ports?network_id=e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0423460 Dec 10 14:38:45.618501 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d48383ff-5128-4264-8ad5-29e294adc785 req-d471b653-87e8-4f36-924a-aedaa0dc463f service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0796428 Dec 10 14:38:45.710641 dv-neutron-821401-2-hyperv neutron-server[103811]: INFO neutron.wsgi [req-d48383ff-5128-4264-8ad5-29e294adc785 req-6baa9f9d-8747-496b-b535-6938f5b31244 service neutron] 10.222.0.39 "GET /v2.0/networks/e8d3ea86-d9c2-49d1-bbd2-2c9d7f7a934f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848694